Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 951764 Details for
Bug 1158096
Guest operating system of hosted engine VM is wrong
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
vdsm.log
vdsm.log (text/plain), 10.24 MB, created by
Nikolai Sednev
on 2014-10-29 12:39:03 UTC
(
hide
)
Description:
vdsm.log
Filename:
MIME Type:
Creator:
Nikolai Sednev
Created:
2014-10-29 12:39:03 UTC
Size:
10.24 MB
patch
obsolete
>Detector thread::DEBUG::2014-10-29 11:01:01,954::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53615 >Detector thread::DEBUG::2014-10-29 11:01:01,956::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53615 >Detector thread::DEBUG::2014-10-29 11:01:01,956::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53615 >Detector thread::DEBUG::2014-10-29 11:01:01,957::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53615) >Thread-134775::DEBUG::2014-10-29 11:01:02,007::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134775::DEBUG::2014-10-29 11:01:02,011::task::595::Storage.TaskManager.Task::(_updateState) Task=`e8955070-0613-478e-9b98-012bad52d507`::moving from state init -> state preparing >Thread-134775::INFO::2014-10-29 11:01:02,014::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-134775::DEBUG::2014-10-29 11:01:02,032::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:01:02,037::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:02,040::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-134775::DEBUG::2014-10-29 11:01:02,044::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:01:02,044::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-134775::DEBUG::2014-10-29 11:01:02,047::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-17::DEBUG::2014-10-29 11:01:02,048::__init__::232::IOProcess::(_processLogs) (198623) Got request for method 'glob' >Thread-134775::INFO::2014-10-29 11:01:02,050::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-134775::DEBUG::2014-10-29 11:01:02,053::task::1191::Storage.TaskManager.Task::(prepare) Task=`e8955070-0613-478e-9b98-012bad52d507`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-17::DEBUG::2014-10-29 11:01:02,052::__init__::232::IOProcess::(_processLogs) (198623) Queuing response >Thread-134775::DEBUG::2014-10-29 11:01:02,055::task::595::Storage.TaskManager.Task::(_updateState) Task=`e8955070-0613-478e-9b98-012bad52d507`::moving from state preparing -> state finished >Thread-134775::DEBUG::2014-10-29 11:01:02,057::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134775::DEBUG::2014-10-29 11:01:02,058::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134775::DEBUG::2014-10-29 11:01:02,060::task::993::Storage.TaskManager.Task::(_decref) Task=`e8955070-0613-478e-9b98-012bad52d507`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:01:02,112::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53616 >Detector thread::DEBUG::2014-10-29 11:01:02,112::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53616 >Detector thread::DEBUG::2014-10-29 11:01:02,113::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53616 >Detector thread::DEBUG::2014-10-29 11:01:02,113::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53616) >Thread-134776::DEBUG::2014-10-29 11:01:02,152::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134776::DEBUG::2014-10-29 11:01:02,153::task::595::Storage.TaskManager.Task::(_updateState) Task=`35ad8393-ca97-4957-a868-d505b15aeb4b`::moving from state init -> state preparing >Thread-134776::INFO::2014-10-29 11:01:02,153::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-134776::DEBUG::2014-10-29 11:01:02,153::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-134776::DEBUG::2014-10-29 11:01:02,154::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-134776::DEBUG::2014-10-29 11:01:02,154::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-134776::DEBUG::2014-10-29 11:01:02,154::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-134776::DEBUG::2014-10-29 11:01:02,154::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-134776::DEBUG::2014-10-29 11:01:02,155::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-134776::DEBUG::2014-10-29 11:01:02,269::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-134776::DEBUG::2014-10-29 11:01:02,270::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-134776::DEBUG::2014-10-29 11:01:02,498::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-134776::DEBUG::2014-10-29 11:01:02,499::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134776::DEBUG::2014-10-29 11:01:02,500::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134776::DEBUG::2014-10-29 11:01:02,500::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134776::DEBUG::2014-10-29 11:01:02,501::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134776::DEBUG::2014-10-29 11:01:02,501::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134776::DEBUG::2014-10-29 11:01:02,501::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134776::DEBUG::2014-10-29 11:01:02,502::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:01:02,508::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:02,509::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:02,509::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:02,510::__init__::232::IOProcess::(_processLogs) (198624) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:02,511::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198624) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:02,511::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:02,512::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:02,512::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:02,512::__init__::232::IOProcess::(_processLogs) (198625) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:02,513::__init__::232::IOProcess::(_processLogs) (198625) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:02,519::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:02,519::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:02,520::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:02,520::__init__::232::IOProcess::(_processLogs) (198626) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:02,521::__init__::232::IOProcess::(_processLogs) (198626) Queuing response >Thread-134776::DEBUG::2014-10-29 11:01:02,524::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:01:02,526::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:02,528::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:02,528::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:02,528::__init__::232::IOProcess::(_processLogs) (198627) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:02,528::__init__::232::IOProcess::(_processLogs) (198627) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:02,529::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:02,529::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:02,530::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:02,530::__init__::232::IOProcess::(_processLogs) (198628) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:01:02,531::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198628) Queuing response >Thread-134776::DEBUG::2014-10-29 11:01:02,532::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:01:02,533::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:02,533::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:02,534::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:02,534::__init__::232::IOProcess::(_processLogs) (198629) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:01:02,535::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198629) Queuing response >Thread-134776::DEBUG::2014-10-29 11:01:02,535::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:01:02,536::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:02,537::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:02,537::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:02,537::__init__::232::IOProcess::(_processLogs) (198630) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:02,538::__init__::232::IOProcess::(_processLogs) (198630) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:02,538::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:02,539::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:02,539::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:02,539::__init__::232::IOProcess::(_processLogs) (198631) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:02,540::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198631) Queuing response >Thread-134776::DEBUG::2014-10-29 11:01:02,540::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-134776::INFO::2014-10-29 11:01:02,541::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-134776::INFO::2014-10-29 11:01:02,541::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-134776::INFO::2014-10-29 11:01:02,541::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:01:02,542::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:02,543::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:02,543::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:02,544::__init__::232::IOProcess::(_processLogs) (198632) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:01:02,544::__init__::232::IOProcess::(_processLogs) (198632) Queuing response >Thread-134776::DEBUG::2014-10-29 11:01:02,544::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-134776::DEBUG::2014-10-29 11:01:02,546::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`e04b6b57-9d07-460c-843a-e3c3d8ca7334`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-134776::DEBUG::2014-10-29 11:01:02,546::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-134776::DEBUG::2014-10-29 11:01:02,546::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-134776::DEBUG::2014-10-29 11:01:02,547::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`e04b6b57-9d07-460c-843a-e3c3d8ca7334`::Granted request >Thread-134776::DEBUG::2014-10-29 11:01:02,547::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`35ad8393-ca97-4957-a868-d505b15aeb4b`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-134776::DEBUG::2014-10-29 11:01:02,548::task::993::Storage.TaskManager.Task::(_decref) Task=`35ad8393-ca97-4957-a868-d505b15aeb4b`::ref 1 aborting False >Thread-134776::INFO::2014-10-29 11:01:02,550::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-134776::DEBUG::2014-10-29 11:01:02,551::task::1191::Storage.TaskManager.Task::(prepare) Task=`35ad8393-ca97-4957-a868-d505b15aeb4b`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-134776::DEBUG::2014-10-29 11:01:02,551::task::595::Storage.TaskManager.Task::(_updateState) Task=`35ad8393-ca97-4957-a868-d505b15aeb4b`::moving from state preparing -> state finished >Thread-134776::DEBUG::2014-10-29 11:01:02,551::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-134776::DEBUG::2014-10-29 11:01:02,552::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134776::DEBUG::2014-10-29 11:01:02,552::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-134776::DEBUG::2014-10-29 11:01:02,552::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-134776::DEBUG::2014-10-29 11:01:02,553::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-134776::DEBUG::2014-10-29 11:01:02,553::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-134776::DEBUG::2014-10-29 11:01:02,553::task::993::Storage.TaskManager.Task::(_decref) Task=`35ad8393-ca97-4957-a868-d505b15aeb4b`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:01:02,577::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53617 >Detector thread::DEBUG::2014-10-29 11:01:02,578::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53617 >Detector thread::DEBUG::2014-10-29 11:01:02,578::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53617 >Detector thread::DEBUG::2014-10-29 11:01:02,578::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53617) >Thread-134781::DEBUG::2014-10-29 11:01:02,617::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134781::DEBUG::2014-10-29 11:01:02,618::task::595::Storage.TaskManager.Task::(_updateState) Task=`046b4526-dbb2-42eb-8fde-f644a4abab4e`::moving from state init -> state preparing >Thread-134781::INFO::2014-10-29 11:01:02,618::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134781::INFO::2014-10-29 11:01:02,619::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565759', 'lastCheck': '4.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539596', 'lastCheck': '4.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000450367', 'lastCheck': '8.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000563699', 'lastCheck': '8.4', 'valid': True}} >Thread-134781::DEBUG::2014-10-29 11:01:02,619::task::1191::Storage.TaskManager.Task::(prepare) Task=`046b4526-dbb2-42eb-8fde-f644a4abab4e`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565759', 'lastCheck': '4.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539596', 'lastCheck': '4.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000450367', 'lastCheck': '8.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000563699', 'lastCheck': '8.4', 'valid': True}} >Thread-134781::DEBUG::2014-10-29 11:01:02,619::task::595::Storage.TaskManager.Task::(_updateState) Task=`046b4526-dbb2-42eb-8fde-f644a4abab4e`::moving from state preparing -> state finished >Thread-134781::DEBUG::2014-10-29 11:01:02,619::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134781::DEBUG::2014-10-29 11:01:02,620::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134781::DEBUG::2014-10-29 11:01:02,620::task::993::Storage.TaskManager.Task::(_decref) Task=`046b4526-dbb2-42eb-8fde-f644a4abab4e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-10-29 11:01:02,708::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:02,881::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:02,883::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:02,884::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:03,564::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:03,567::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134782::DEBUG::2014-10-29 11:01:03,571::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:03,576::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:03,577::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134783::DEBUG::2014-10-29 11:01:03,581::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134783::DEBUG::2014-10-29 11:01:03,583::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:01:04,133::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:04,133::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:04,134::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:04,134::__init__::232::IOProcess::(_processLogs) (198633) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:04,138::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198633) Queuing response >Thread-179::DEBUG::2014-10-29 11:01:04,140::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:01:04,160::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000826832 s, 450 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:01:04,161::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:04,162::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:04,162::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:04,162::__init__::232::IOProcess::(_processLogs) (198634) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:04,163::__init__::232::IOProcess::(_processLogs) (198634) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:04,177::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:04,177::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:04,177::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:04,178::__init__::232::IOProcess::(_processLogs) (198635) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:04,178::__init__::232::IOProcess::(_processLogs) (198635) Queuing response >Thread-10269::DEBUG::2014-10-29 11:01:04,179::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:01:04,198::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000433791 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:01:04,200::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:04,201::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:04,201::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:04,203::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198636) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:04,204::__init__::232::IOProcess::(_processLogs) (198636) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:06,597::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:06,601::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134784::DEBUG::2014-10-29 11:01:06,605::task::595::Storage.TaskManager.Task::(_updateState) Task=`772375ec-a203-4a64-a608-ace56cc3e965`::moving from state init -> state preparing >Thread-134784::INFO::2014-10-29 11:01:06,606::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134784::INFO::2014-10-29 11:01:06,606::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565759', 'lastCheck': '8.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539596', 'lastCheck': '8.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000826832', 'lastCheck': '2.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000433791', 'lastCheck': '2.4', 'valid': True}} >Thread-134784::DEBUG::2014-10-29 11:01:06,607::task::1191::Storage.TaskManager.Task::(prepare) Task=`772375ec-a203-4a64-a608-ace56cc3e965`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565759', 'lastCheck': '8.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539596', 'lastCheck': '8.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000826832', 'lastCheck': '2.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000433791', 'lastCheck': '2.4', 'valid': True}} >Thread-134784::DEBUG::2014-10-29 11:01:06,607::task::595::Storage.TaskManager.Task::(_updateState) Task=`772375ec-a203-4a64-a608-ace56cc3e965`::moving from state preparing -> state finished >Thread-134784::DEBUG::2014-10-29 11:01:06,607::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134784::DEBUG::2014-10-29 11:01:06,607::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134784::DEBUG::2014-10-29 11:01:06,608::task::993::Storage.TaskManager.Task::(_decref) Task=`772375ec-a203-4a64-a608-ace56cc3e965`::ref 0 aborting False >Thread-134784::DEBUG::2014-10-29 11:01:06,651::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:06,676::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:06,678::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134785::DEBUG::2014-10-29 11:01:06,682::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134785::DEBUG::2014-10-29 11:01:06,684::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:07,886::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:07,887::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:07,888::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:01:08,295::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:08,296::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:08,297::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:08,297::__init__::232::IOProcess::(_processLogs) (198637) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:01:08,299::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:01:08,316::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198637) Queuing response >Thread-178::DEBUG::2014-10-29 11:01:08,334::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.0015942 s, 319 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:01:08,336::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:08,336::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:08,338::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:08,338::__init__::232::IOProcess::(_processLogs) (198638) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:08,338::__init__::232::IOProcess::(_processLogs) (198638) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:08,339::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:08,339::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:08,340::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:08,341::__init__::232::IOProcess::(_processLogs) (198639) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:08,341::__init__::232::IOProcess::(_processLogs) (198639) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:08,341::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:08,342::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:08,342::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:08,343::__init__::232::IOProcess::(_processLogs) (198640) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:08,343::__init__::232::IOProcess::(_processLogs) (198640) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:08,344::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:08,344::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:08,345::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:08,347::__init__::232::IOProcess::(_processLogs) (198641) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:08,347::__init__::232::IOProcess::(_processLogs) (198641) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:08,368::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:08,368::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:08,369::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:08,369::__init__::232::IOProcess::(_processLogs) (198642) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:08,370::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198642) Queuing response >Thread-33::DEBUG::2014-10-29 11:01:08,371::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:01:08,391::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000427241 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:01:08,392::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:08,393::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:08,393::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:08,393::__init__::232::IOProcess::(_processLogs) (198643) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:08,393::__init__::232::IOProcess::(_processLogs) (198643) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:08,396::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:08,397::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:08,398::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:08,398::__init__::232::IOProcess::(_processLogs) (198644) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:08,399::__init__::232::IOProcess::(_processLogs) (198644) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:08,399::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:08,400::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:08,401::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:08,401::__init__::232::IOProcess::(_processLogs) (198645) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:08,401::__init__::232::IOProcess::(_processLogs) (198645) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:08,402::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:08,402::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:08,403::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:08,404::__init__::232::IOProcess::(_processLogs) (198646) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:08,405::__init__::232::IOProcess::(_processLogs) (198646) Queuing response >Detector thread::DEBUG::2014-10-29 11:01:09,043::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53618 >Detector thread::DEBUG::2014-10-29 11:01:09,044::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53618 >Detector thread::DEBUG::2014-10-29 11:01:09,044::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53618 >Detector thread::DEBUG::2014-10-29 11:01:09,045::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53618) >Thread-134786::DEBUG::2014-10-29 11:01:09,084::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-134786::DEBUG::2014-10-29 11:01:09,086::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-134786::DEBUG::2014-10-29 11:01:09,109::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-134786::DEBUG::2014-10-29 11:01:09,159::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '25', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '25', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:01:09,675::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53619 >Detector thread::DEBUG::2014-10-29 11:01:09,676::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53619 >Detector thread::DEBUG::2014-10-29 11:01:09,676::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53619 >Detector thread::DEBUG::2014-10-29 11:01:09,677::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53619) >Thread-134787::DEBUG::2014-10-29 11:01:09,716::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-134787::DEBUG::2014-10-29 11:01:09,718::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134787::DEBUG::2014-10-29 11:01:09,718::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.07', 'elapsedTime': '513102', 'displayType': 'vnc', 'cpuSys': '0.80', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '58701430', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '56592', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '44437.33'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.85', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:09,744::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:09,746::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134788::DEBUG::2014-10-29 11:01:09,749::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:09,752::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:09,754::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134789::DEBUG::2014-10-29 11:01:09,757::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134789::DEBUG::2014-10-29 11:01:09,759::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:01:10,980::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53621 >Detector thread::DEBUG::2014-10-29 11:01:10,982::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53621 >Detector thread::DEBUG::2014-10-29 11:01:10,982::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53621 >Detector thread::DEBUG::2014-10-29 11:01:10,983::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53621) >Thread-134790::DEBUG::2014-10-29 11:01:11,021::task::595::Storage.TaskManager.Task::(_updateState) Task=`12bda11e-d2ce-4170-a16a-aa58b10664fc`::moving from state init -> state preparing >Thread-134790::INFO::2014-10-29 11:01:11,021::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134790::INFO::2014-10-29 11:01:11,022::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0015942', 'lastCheck': '2.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000427241', 'lastCheck': '2.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000826832', 'lastCheck': '6.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000433791', 'lastCheck': '6.8', 'valid': True}} >Thread-134790::DEBUG::2014-10-29 11:01:11,022::task::1191::Storage.TaskManager.Task::(prepare) Task=`12bda11e-d2ce-4170-a16a-aa58b10664fc`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0015942', 'lastCheck': '2.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000427241', 'lastCheck': '2.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000826832', 'lastCheck': '6.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000433791', 'lastCheck': '6.8', 'valid': True}} >Thread-134790::DEBUG::2014-10-29 11:01:11,023::task::595::Storage.TaskManager.Task::(_updateState) Task=`12bda11e-d2ce-4170-a16a-aa58b10664fc`::moving from state preparing -> state finished >Thread-134790::DEBUG::2014-10-29 11:01:11,023::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134790::DEBUG::2014-10-29 11:01:11,023::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134790::DEBUG::2014-10-29 11:01:11,023::task::993::Storage.TaskManager.Task::(_decref) Task=`12bda11e-d2ce-4170-a16a-aa58b10664fc`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:01:11,896::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:12,890::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:12,892::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:12,893::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:01:14,168::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:14,168::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:14,171::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:14,171::__init__::232::IOProcess::(_processLogs) (198647) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:14,205::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:14,206::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:14,206::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:14,206::__init__::232::IOProcess::(_processLogs) (198648) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:15,796::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198648) Queuing response >Thread-10269::DEBUG::2014-10-29 11:01:15,798::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:01:15,799::__init__::232::IOProcess::(_processLogs) (198647) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:15,824::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-10269::DEBUG::2014-10-29 11:01:15,827::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000707604 s, 709 kB/s\n'; <rc> = 0 >JsonRpcServer::DEBUG::2014-10-29 11:01:15,837::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-179::DEBUG::2014-10-29 11:01:15,842::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:01:15,842::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:15,862::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-179::DEBUG::2014-10-29 11:01:15,865::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000548834 s, 678 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:01:15,865::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:15,869::__init__::232::IOProcess::(_processLogs) (198649) Got request for method 'statvfs' >Thread-134791::DEBUG::2014-10-29 11:01:15,871::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:01:15,871::__init__::232::IOProcess::(_processLogs) (198649) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:15,879::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-17::DEBUG::2014-10-29 11:01:15,879::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:15,883::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:15,885::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:15,888::__init__::232::IOProcess::(_processLogs) (198650) Got request for method 'statvfs' >JsonRpcServer::DEBUG::2014-10-29 11:01:15,887::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:01:15,900::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198650) Queuing response >Thread-134792::DEBUG::2014-10-29 11:01:15,901::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134792::DEBUG::2014-10-29 11:01:15,905::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:01:16,193::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53623 >Detector thread::DEBUG::2014-10-29 11:01:16,194::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53623 >Detector thread::DEBUG::2014-10-29 11:01:16,195::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53623 >Detector thread::DEBUG::2014-10-29 11:01:16,195::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53623) >Thread-134793::DEBUG::2014-10-29 11:01:16,239::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134793::DEBUG::2014-10-29 11:01:16,242::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f652b51-b9c7-4790-903d-3420d2caf3a9`::moving from state init -> state preparing >Thread-134793::INFO::2014-10-29 11:01:16,244::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-134793::DEBUG::2014-10-29 11:01:16,259::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:01:16,262::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:16,264::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:16,265::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:16,266::__init__::232::IOProcess::(_processLogs) (198651) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:16,270::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198651) Queuing response >Thread-134793::DEBUG::2014-10-29 11:01:16,270::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-134793::DEBUG::2014-10-29 11:01:16,273::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-134793::INFO::2014-10-29 11:01:16,274::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-134793::DEBUG::2014-10-29 11:01:16,276::task::1191::Storage.TaskManager.Task::(prepare) Task=`2f652b51-b9c7-4790-903d-3420d2caf3a9`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-134793::DEBUG::2014-10-29 11:01:16,278::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f652b51-b9c7-4790-903d-3420d2caf3a9`::moving from state preparing -> state finished >Thread-134793::DEBUG::2014-10-29 11:01:16,279::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134793::DEBUG::2014-10-29 11:01:16,280::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134793::DEBUG::2014-10-29 11:01:16,282::task::993::Storage.TaskManager.Task::(_decref) Task=`2f652b51-b9c7-4790-903d-3420d2caf3a9`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:01:16,332::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53624 >Detector thread::DEBUG::2014-10-29 11:01:16,332::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53624 >Detector thread::DEBUG::2014-10-29 11:01:16,333::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53624 >Detector thread::DEBUG::2014-10-29 11:01:16,333::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53624) >Thread-134794::DEBUG::2014-10-29 11:01:16,374::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134794::DEBUG::2014-10-29 11:01:16,377::task::595::Storage.TaskManager.Task::(_updateState) Task=`1476d683-6112-49a5-9e61-07472a424524`::moving from state init -> state preparing >Thread-134794::INFO::2014-10-29 11:01:16,378::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-134794::DEBUG::2014-10-29 11:01:16,380::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-134794::DEBUG::2014-10-29 11:01:16,382::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-134794::DEBUG::2014-10-29 11:01:16,383::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-134794::DEBUG::2014-10-29 11:01:16,384::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-134794::DEBUG::2014-10-29 11:01:16,385::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-134794::DEBUG::2014-10-29 11:01:16,388::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-134794::DEBUG::2014-10-29 11:01:16,468::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-134794::DEBUG::2014-10-29 11:01:16,481::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-134794::DEBUG::2014-10-29 11:01:16,691::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-134794::DEBUG::2014-10-29 11:01:16,695::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134794::DEBUG::2014-10-29 11:01:16,698::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134794::DEBUG::2014-10-29 11:01:16,701::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134794::DEBUG::2014-10-29 11:01:16,703::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134794::DEBUG::2014-10-29 11:01:16,706::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134794::DEBUG::2014-10-29 11:01:16,709::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134794::DEBUG::2014-10-29 11:01:16,711::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:01:16,733::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:16,733::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:16,734::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:16,734::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:16,734::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:16,734::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:16,735::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:16,747::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:16,750::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:16,752::__init__::232::IOProcess::(_processLogs) (198652) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:16,754::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:16,756::__init__::232::IOProcess::(_processLogs) (198653) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:16,758::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:16,761::__init__::232::IOProcess::(_processLogs) (198654) Got request for method 'glob' >Thread-134794::DEBUG::2014-10-29 11:01:16,761::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:01:16,763::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:16,765::__init__::232::IOProcess::(_processLogs) (198655) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:16,766::__init__::232::IOProcess::(_processLogs) (198653) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:16,768::__init__::232::IOProcess::(_processLogs) (198652) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:16,769::__init__::232::IOProcess::(_processLogs) (198654) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:16,771::__init__::232::IOProcess::(_processLogs) (198655) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:16,776::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:16,777::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:16,781::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-134794::DEBUG::2014-10-29 11:01:16,782::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:01:16,783::__init__::232::IOProcess::(_processLogs) (198656) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:01:16,785::__init__::232::IOProcess::(_processLogs) (198656) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:16,789::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:16,790::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:16,792::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:16,793::__init__::232::IOProcess::(_processLogs) (198657) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:01:16,797::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198657) Queuing response >Thread-134794::DEBUG::2014-10-29 11:01:16,797::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:01:16,803::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:16,804::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:16,806::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:16,807::__init__::232::IOProcess::(_processLogs) (198658) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:16,809::__init__::232::IOProcess::(_processLogs) (198658) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:16,814::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-134794::DEBUG::2014-10-29 11:01:16,817::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:01:16,817::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-134794::INFO::2014-10-29 11:01:16,818::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:01:16,820::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-134794::INFO::2014-10-29 11:01:16,820::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:01:16,822::__init__::232::IOProcess::(_processLogs) (198659) Got request for method 'glob' >Thread-134794::INFO::2014-10-29 11:01:16,823::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:01:16,825::__init__::232::IOProcess::(_processLogs) (198659) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:16,828::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:16,829::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:16,830::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:16,832::__init__::232::IOProcess::(_processLogs) (198660) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:01:16,835::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198660) Queuing response >Thread-134794::DEBUG::2014-10-29 11:01:16,836::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-134794::DEBUG::2014-10-29 11:01:16,843::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`413af4e0-c85d-4d21-bfed-113ebdbfcfb5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-134794::DEBUG::2014-10-29 11:01:16,844::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-134794::DEBUG::2014-10-29 11:01:16,846::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-134794::DEBUG::2014-10-29 11:01:16,847::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`413af4e0-c85d-4d21-bfed-113ebdbfcfb5`::Granted request >Thread-134794::DEBUG::2014-10-29 11:01:16,851::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1476d683-6112-49a5-9e61-07472a424524`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-134794::DEBUG::2014-10-29 11:01:16,852::task::993::Storage.TaskManager.Task::(_decref) Task=`1476d683-6112-49a5-9e61-07472a424524`::ref 1 aborting False >Thread-134794::INFO::2014-10-29 11:01:16,865::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-134794::DEBUG::2014-10-29 11:01:16,867::task::1191::Storage.TaskManager.Task::(prepare) Task=`1476d683-6112-49a5-9e61-07472a424524`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-134794::DEBUG::2014-10-29 11:01:16,869::task::595::Storage.TaskManager.Task::(_updateState) Task=`1476d683-6112-49a5-9e61-07472a424524`::moving from state preparing -> state finished >Thread-134794::DEBUG::2014-10-29 11:01:16,870::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-134794::DEBUG::2014-10-29 11:01:16,871::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134794::DEBUG::2014-10-29 11:01:16,873::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-134794::DEBUG::2014-10-29 11:01:16,875::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-134794::DEBUG::2014-10-29 11:01:16,876::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-134794::DEBUG::2014-10-29 11:01:16,877::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-134794::DEBUG::2014-10-29 11:01:16,879::task::993::Storage.TaskManager.Task::(_decref) Task=`1476d683-6112-49a5-9e61-07472a424524`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:01:16,917::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53625 >Detector thread::DEBUG::2014-10-29 11:01:16,918::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53625 >Detector thread::DEBUG::2014-10-29 11:01:16,918::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53625 >Detector thread::DEBUG::2014-10-29 11:01:16,919::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53625) >Thread-134799::DEBUG::2014-10-29 11:01:16,957::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134799::DEBUG::2014-10-29 11:01:16,960::task::595::Storage.TaskManager.Task::(_updateState) Task=`f47dda10-f3ab-436e-bd54-81be6cd6e052`::moving from state init -> state preparing >Thread-134799::INFO::2014-10-29 11:01:16,962::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134799::INFO::2014-10-29 11:01:16,965::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0015942', 'lastCheck': '8.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000427241', 'lastCheck': '8.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548834', 'lastCheck': '1.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000707604', 'lastCheck': '1.1', 'valid': True}} >Thread-134799::DEBUG::2014-10-29 11:01:16,967::task::1191::Storage.TaskManager.Task::(prepare) Task=`f47dda10-f3ab-436e-bd54-81be6cd6e052`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0015942', 'lastCheck': '8.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000427241', 'lastCheck': '8.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548834', 'lastCheck': '1.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000707604', 'lastCheck': '1.1', 'valid': True}} >Thread-134799::DEBUG::2014-10-29 11:01:16,968::task::595::Storage.TaskManager.Task::(_updateState) Task=`f47dda10-f3ab-436e-bd54-81be6cd6e052`::moving from state preparing -> state finished >Thread-134799::DEBUG::2014-10-29 11:01:16,969::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134799::DEBUG::2014-10-29 11:01:16,970::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134799::DEBUG::2014-10-29 11:01:16,972::task::993::Storage.TaskManager.Task::(_decref) Task=`f47dda10-f3ab-436e-bd54-81be6cd6e052`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:17,900::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:17,902::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:17,903::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:01:18,348::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:18,348::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:18,348::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:18,349::__init__::232::IOProcess::(_processLogs) (198661) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:18,350::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198661) Queuing response >Thread-178::DEBUG::2014-10-29 11:01:18,352::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:01:18,369::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000481241 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:01:18,370::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:18,371::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:18,371::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:18,371::__init__::232::IOProcess::(_processLogs) (198662) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:18,371::__init__::232::IOProcess::(_processLogs) (198662) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:18,374::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:18,374::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:18,375::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:18,375::__init__::232::IOProcess::(_processLogs) (198663) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:18,376::__init__::232::IOProcess::(_processLogs) (198663) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:18,376::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:18,377::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:18,378::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:18,378::__init__::232::IOProcess::(_processLogs) (198664) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:18,378::__init__::232::IOProcess::(_processLogs) (198664) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:18,379::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:18,379::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:18,380::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:18,380::__init__::232::IOProcess::(_processLogs) (198665) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:18,380::__init__::232::IOProcess::(_processLogs) (198665) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:18,406::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:18,406::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:18,407::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-33::DEBUG::2014-10-29 11:01:18,409::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:01:18,409::__init__::232::IOProcess::(_processLogs) (198666) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:18,429::__init__::232::IOProcess::(_processLogs) (198666) Queuing response >Thread-33::DEBUG::2014-10-29 11:01:18,431::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00057929 s, 841 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:01:18,433::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:18,433::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:18,433::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:18,433::__init__::232::IOProcess::(_processLogs) (198667) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:18,435::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198667) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:18,437::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:18,439::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:18,439::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:18,439::__init__::232::IOProcess::(_processLogs) (198668) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:18,440::__init__::232::IOProcess::(_processLogs) (198668) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:18,440::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:18,441::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:18,442::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:18,442::__init__::232::IOProcess::(_processLogs) (198669) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:18,442::__init__::232::IOProcess::(_processLogs) (198669) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:18,443::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:18,444::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:18,444::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:18,445::__init__::232::IOProcess::(_processLogs) (198670) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:18,446::__init__::232::IOProcess::(_processLogs) (198670) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:18,922::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:18,925::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134800::DEBUG::2014-10-29 11:01:18,928::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:18,931::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:18,933::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134801::DEBUG::2014-10-29 11:01:18,936::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134801::DEBUG::2014-10-29 11:01:18,939::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:01:19,212::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53626 >Detector thread::DEBUG::2014-10-29 11:01:19,212::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53626 >Detector thread::DEBUG::2014-10-29 11:01:19,214::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53626 >Detector thread::DEBUG::2014-10-29 11:01:19,214::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53626) >Thread-134802::DEBUG::2014-10-29 11:01:19,252::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-134802::DEBUG::2014-10-29 11:01:19,254::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-134802::DEBUG::2014-10-29 11:01:19,271::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-134802::DEBUG::2014-10-29 11:01:19,321::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '9', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '9', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:01:19,873::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53627 >Detector thread::DEBUG::2014-10-29 11:01:19,873::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53627 >Detector thread::DEBUG::2014-10-29 11:01:19,874::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53627 >Detector thread::DEBUG::2014-10-29 11:01:19,874::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53627) >Thread-134803::DEBUG::2014-10-29 11:01:19,913::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-134803::DEBUG::2014-10-29 11:01:19,914::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134803::DEBUG::2014-10-29 11:01:19,915::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.83', 'elapsedTime': '513112', 'displayType': 'vnc', 'cpuSys': '1.33', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '58701430', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '56592', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '44437.33'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.01', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:01:20,378::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53629 >Detector thread::DEBUG::2014-10-29 11:01:20,378::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53629 >Detector thread::DEBUG::2014-10-29 11:01:20,378::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53629 >Detector thread::DEBUG::2014-10-29 11:01:20,379::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53629) >Thread-134804::DEBUG::2014-10-29 11:01:20,419::task::595::Storage.TaskManager.Task::(_updateState) Task=`d42ad413-173e-44fc-9960-25518b228c57`::moving from state init -> state preparing >Thread-134804::INFO::2014-10-29 11:01:20,419::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134804::INFO::2014-10-29 11:01:20,420::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481241', 'lastCheck': '2.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057929', 'lastCheck': '2.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548834', 'lastCheck': '4.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000707604', 'lastCheck': '4.5', 'valid': True}} >Thread-134804::DEBUG::2014-10-29 11:01:20,421::task::1191::Storage.TaskManager.Task::(prepare) Task=`d42ad413-173e-44fc-9960-25518b228c57`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481241', 'lastCheck': '2.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057929', 'lastCheck': '2.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548834', 'lastCheck': '4.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000707604', 'lastCheck': '4.5', 'valid': True}} >Thread-134804::DEBUG::2014-10-29 11:01:20,421::task::595::Storage.TaskManager.Task::(_updateState) Task=`d42ad413-173e-44fc-9960-25518b228c57`::moving from state preparing -> state finished >Thread-134804::DEBUG::2014-10-29 11:01:20,421::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134804::DEBUG::2014-10-29 11:01:20,421::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134804::DEBUG::2014-10-29 11:01:20,422::task::993::Storage.TaskManager.Task::(_decref) Task=`d42ad413-173e-44fc-9960-25518b228c57`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:21,953::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:21,956::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134805::DEBUG::2014-10-29 11:01:21,960::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:21,962::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:21,964::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134806::DEBUG::2014-10-29 11:01:21,967::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134806::DEBUG::2014-10-29 11:01:21,970::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:22,910::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:22,911::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:22,912::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:24,985::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:24,987::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134807::DEBUG::2014-10-29 11:01:24,990::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc2dfb4d-277c-430f-9fee-0fcb160fb721`::moving from state init -> state preparing >Thread-134807::INFO::2014-10-29 11:01:24,991::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134807::INFO::2014-10-29 11:01:24,992::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481241', 'lastCheck': '6.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057929', 'lastCheck': '6.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548834', 'lastCheck': '9.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000707604', 'lastCheck': '9.1', 'valid': True}} >Thread-134807::DEBUG::2014-10-29 11:01:24,992::task::1191::Storage.TaskManager.Task::(prepare) Task=`dc2dfb4d-277c-430f-9fee-0fcb160fb721`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481241', 'lastCheck': '6.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057929', 'lastCheck': '6.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548834', 'lastCheck': '9.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000707604', 'lastCheck': '9.1', 'valid': True}} >Thread-134807::DEBUG::2014-10-29 11:01:24,992::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc2dfb4d-277c-430f-9fee-0fcb160fb721`::moving from state preparing -> state finished >Thread-134807::DEBUG::2014-10-29 11:01:24,992::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134807::DEBUG::2014-10-29 11:01:24,993::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134807::DEBUG::2014-10-29 11:01:24,993::task::993::Storage.TaskManager.Task::(_decref) Task=`dc2dfb4d-277c-430f-9fee-0fcb160fb721`::ref 0 aborting False >Thread-134807::DEBUG::2014-10-29 11:01:25,016::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:25,038::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:25,040::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134808::DEBUG::2014-10-29 11:01:25,043::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134808::DEBUG::2014-10-29 11:01:25,046::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:01:25,882::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:25,882::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:25,883::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:25,883::__init__::232::IOProcess::(_processLogs) (198671) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:25,884::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198671) Queuing response >Thread-10269::DEBUG::2014-10-29 11:01:25,886::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:01:25,904::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00107961 s, 465 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:01:25,906::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:25,906::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-179::DEBUG::2014-10-29 11:01:25,906::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 38dc6c98-2b6a-45c0-b765-c5ce685415f9 >Thread-17::DEBUG::2014-10-29 11:01:25,914::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:25,919::__init__::232::IOProcess::(_processLogs) (198672) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:25,921::__init__::232::IOProcess::(_processLogs) (198672) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:25,922::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:25,922::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:25,923::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:25,923::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:25,923::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:25,924::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:25,924::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:25,925::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:25,925::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:25,926::__init__::232::IOProcess::(_processLogs) (198673) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:25,926::__init__::232::IOProcess::(_processLogs) (198674) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:25,926::__init__::232::IOProcess::(_processLogs) (198674) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:25,927::__init__::232::IOProcess::(_processLogs) (198673) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:25,927::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:25,928::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:25,928::__init__::232::IOProcess::(_processLogs) (198675) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:25,929::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:25,930::__init__::232::IOProcess::(_processLogs) (198676) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:25,930::__init__::232::IOProcess::(_processLogs) (198676) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:25,930::__init__::232::IOProcess::(_processLogs) (198675) Queuing response >Thread-179::DEBUG::2014-10-29 11:01:25,935::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9 >Thread-17::DEBUG::2014-10-29 11:01:25,936::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:25,937::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:25,937::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:25,937::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198677) Got request for method 'touch' >Thread-179::DEBUG::2014-10-29 11:01:25,938::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:01:25,938::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198677) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:25,940::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:25,940::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:25,941::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:25,941::__init__::232::IOProcess::(_processLogs) (198678) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:01:25,942::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198678) Queuing response >Thread-179::DEBUG::2014-10-29 11:01:25,942::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nsednev_rhevm_3_5_second_SD', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=00000002-0002-0002-0002-000000000321', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_rhevm_3_5_second_SD', 'ROLE=Regular', 'SDUUID=38dc6c98-2b6a-45c0-b765-c5ce685415f9', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ea5c54387b91bc1e37853d7501f0d1b2d7d233e7'] >Thread-17::DEBUG::2014-10-29 11:01:25,944::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:25,944::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:25,945::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:25,945::__init__::232::IOProcess::(_processLogs) (198679) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:25,946::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198679) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:25,947::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:25,947::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:25,947::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:25,947::__init__::232::IOProcess::(_processLogs) (198680) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:25,948::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198680) Queuing response >Thread-179::DEBUG::2014-10-29 11:01:25,948::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-179::INFO::2014-10-29 11:01:25,949::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 38dc6c98-2b6a-45c0-b765-c5ce685415f9_imageNS already registered >Thread-179::INFO::2014-10-29 11:01:25,950::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 38dc6c98-2b6a-45c0-b765-c5ce685415f9_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:01:25,950::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:25,951::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:25,951::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:25,952::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198681) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:25,954::__init__::232::IOProcess::(_processLogs) (198681) Queuing response >Thread-179::DEBUG::2014-10-29 11:01:25,954::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:01:25,971::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000510287 s, 729 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:01:25,973::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:25,974::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:25,975::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:25,976::__init__::232::IOProcess::(_processLogs) (198682) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:25,978::__init__::232::IOProcess::(_processLogs) (198682) Queuing response >Thread-22::DEBUG::2014-10-29 11:01:26,927::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Detector thread::DEBUG::2014-10-29 11:01:27,599::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53631 >Detector thread::DEBUG::2014-10-29 11:01:27,600::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53631 >Detector thread::DEBUG::2014-10-29 11:01:27,600::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53631 >Detector thread::DEBUG::2014-10-29 11:01:27,600::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53631) >Thread-134813::DEBUG::2014-10-29 11:01:27,640::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134813::DEBUG::2014-10-29 11:01:27,641::task::595::Storage.TaskManager.Task::(_updateState) Task=`22ada8be-e63a-42ec-8e41-8680c3fd9e7c`::moving from state init -> state preparing >Thread-134813::INFO::2014-10-29 11:01:27,641::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-134813::DEBUG::2014-10-29 11:01:27,646::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:01:27,647::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:27,647::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-134813::DEBUG::2014-10-29 11:01:27,648::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:01:27,648::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:27,650::__init__::232::IOProcess::(_processLogs) (198683) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:27,650::__init__::232::IOProcess::(_processLogs) (198683) Queuing response >Thread-134813::DEBUG::2014-10-29 11:01:27,650::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-134813::INFO::2014-10-29 11:01:27,651::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-134813::DEBUG::2014-10-29 11:01:27,651::task::1191::Storage.TaskManager.Task::(prepare) Task=`22ada8be-e63a-42ec-8e41-8680c3fd9e7c`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-134813::DEBUG::2014-10-29 11:01:27,651::task::595::Storage.TaskManager.Task::(_updateState) Task=`22ada8be-e63a-42ec-8e41-8680c3fd9e7c`::moving from state preparing -> state finished >Thread-134813::DEBUG::2014-10-29 11:01:27,652::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134813::DEBUG::2014-10-29 11:01:27,652::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134813::DEBUG::2014-10-29 11:01:27,652::task::993::Storage.TaskManager.Task::(_decref) Task=`22ada8be-e63a-42ec-8e41-8680c3fd9e7c`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:01:27,696::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53632 >Detector thread::DEBUG::2014-10-29 11:01:27,696::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53632 >Detector thread::DEBUG::2014-10-29 11:01:27,696::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53632 >Detector thread::DEBUG::2014-10-29 11:01:27,697::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53632) >Thread-134814::DEBUG::2014-10-29 11:01:27,736::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134814::DEBUG::2014-10-29 11:01:27,737::task::595::Storage.TaskManager.Task::(_updateState) Task=`394f618d-b274-42da-90f5-25e497cb4f91`::moving from state init -> state preparing >Thread-134814::INFO::2014-10-29 11:01:27,737::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-134814::DEBUG::2014-10-29 11:01:27,737::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-134814::DEBUG::2014-10-29 11:01:27,738::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-134814::DEBUG::2014-10-29 11:01:27,738::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-134814::DEBUG::2014-10-29 11:01:27,739::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-134814::DEBUG::2014-10-29 11:01:27,739::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-134814::DEBUG::2014-10-29 11:01:27,739::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-134814::DEBUG::2014-10-29 11:01:27,828::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-134814::DEBUG::2014-10-29 11:01:27,829::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:27,920::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:27,921::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:27,922::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134814::DEBUG::2014-10-29 11:01:28,053::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-134814::DEBUG::2014-10-29 11:01:28,055::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134814::DEBUG::2014-10-29 11:01:28,056::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134814::DEBUG::2014-10-29 11:01:28,056::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134814::DEBUG::2014-10-29 11:01:28,057::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134814::DEBUG::2014-10-29 11:01:28,057::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134814::DEBUG::2014-10-29 11:01:28,057::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134814::DEBUG::2014-10-29 11:01:28,058::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:01:28,065::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:28,068::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:28,068::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:28,069::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198684) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:28,070::__init__::232::IOProcess::(_processLogs) (198684) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:28,071::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:28,071::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:28,071::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:28,072::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:28,072::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:28,073::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:28,074::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:28,074::__init__::232::IOProcess::(_processLogs) (198685) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:28,074::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:28,075::__init__::232::IOProcess::(_processLogs) (198687) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:28,075::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:28,075::__init__::232::IOProcess::(_processLogs) (198686) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:28,075::__init__::232::IOProcess::(_processLogs) (198687) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:28,076::__init__::232::IOProcess::(_processLogs) (198685) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:28,076::__init__::232::IOProcess::(_processLogs) (198686) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:28,093::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:28,098::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134819::DEBUG::2014-10-29 11:01:28,108::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-134814::DEBUG::2014-10-29 11:01:28,109::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:01:28,112::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:28,113::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:28,113::__init__::232::IOProcess::(_processLogs) Extracting request information... >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:28,114::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-17::DEBUG::2014-10-29 11:01:28,115::__init__::232::IOProcess::(_processLogs) (198688) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:01:28,119::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198688) Queuing response >Thread-134814::DEBUG::2014-10-29 11:01:28,119::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >JsonRpcServer::DEBUG::2014-10-29 11:01:28,122::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:01:28,127::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:28,129::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-134820::DEBUG::2014-10-29 11:01:28,129::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:01:28,130::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:28,131::__init__::232::IOProcess::(_processLogs) (198689) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:01:28,134::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198689) Queuing response >Thread-134814::DEBUG::2014-10-29 11:01:28,135::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:01:28,141::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:28,142::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:28,143::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:28,144::__init__::232::IOProcess::(_processLogs) (198690) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:28,145::__init__::232::IOProcess::(_processLogs) (198690) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:28,148::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-134820::DEBUG::2014-10-29 11:01:28,150::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:01:28,149::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:28,152::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:28,152::__init__::232::IOProcess::(_processLogs) (198691) Got request for method 'glob' >Thread-134814::DEBUG::2014-10-29 11:01:28,153::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:01:28,153::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198691) Queuing response >Thread-134814::INFO::2014-10-29 11:01:28,154::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-134814::INFO::2014-10-29 11:01:28,155::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-134814::INFO::2014-10-29 11:01:28,156::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:01:28,157::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:28,157::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:28,157::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:28,158::__init__::232::IOProcess::(_processLogs) (198692) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:01:28,158::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198692) Queuing response >Thread-134814::DEBUG::2014-10-29 11:01:28,159::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-134814::DEBUG::2014-10-29 11:01:28,160::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`4a057ed9-0b3c-4a7f-980e-d209382c46db`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-134814::DEBUG::2014-10-29 11:01:28,160::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-134814::DEBUG::2014-10-29 11:01:28,161::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-134814::DEBUG::2014-10-29 11:01:28,161::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`4a057ed9-0b3c-4a7f-980e-d209382c46db`::Granted request >Thread-134814::DEBUG::2014-10-29 11:01:28,162::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`394f618d-b274-42da-90f5-25e497cb4f91`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-134814::DEBUG::2014-10-29 11:01:28,162::task::993::Storage.TaskManager.Task::(_decref) Task=`394f618d-b274-42da-90f5-25e497cb4f91`::ref 1 aborting False >Thread-134814::INFO::2014-10-29 11:01:28,165::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-134814::DEBUG::2014-10-29 11:01:28,165::task::1191::Storage.TaskManager.Task::(prepare) Task=`394f618d-b274-42da-90f5-25e497cb4f91`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-134814::DEBUG::2014-10-29 11:01:28,166::task::595::Storage.TaskManager.Task::(_updateState) Task=`394f618d-b274-42da-90f5-25e497cb4f91`::moving from state preparing -> state finished >Thread-134814::DEBUG::2014-10-29 11:01:28,166::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-134814::DEBUG::2014-10-29 11:01:28,166::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134814::DEBUG::2014-10-29 11:01:28,167::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-134814::DEBUG::2014-10-29 11:01:28,167::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-134814::DEBUG::2014-10-29 11:01:28,167::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-134814::DEBUG::2014-10-29 11:01:28,168::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-134814::DEBUG::2014-10-29 11:01:28,168::task::993::Storage.TaskManager.Task::(_decref) Task=`394f618d-b274-42da-90f5-25e497cb4f91`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:01:28,197::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53633 >Detector thread::DEBUG::2014-10-29 11:01:28,198::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53633 >Detector thread::DEBUG::2014-10-29 11:01:28,198::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53633 >Detector thread::DEBUG::2014-10-29 11:01:28,199::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53633) >Thread-134821::DEBUG::2014-10-29 11:01:28,237::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134821::DEBUG::2014-10-29 11:01:28,238::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ff09f2d-6cdc-48d1-9764-f73f3445756c`::moving from state init -> state preparing >Thread-134821::INFO::2014-10-29 11:01:28,238::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134821::INFO::2014-10-29 11:01:28,239::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481241', 'lastCheck': '9.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057929', 'lastCheck': '9.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000510287', 'lastCheck': '2.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107961', 'lastCheck': '2.3', 'valid': True}} >Thread-134821::DEBUG::2014-10-29 11:01:28,239::task::1191::Storage.TaskManager.Task::(prepare) Task=`4ff09f2d-6cdc-48d1-9764-f73f3445756c`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481241', 'lastCheck': '9.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057929', 'lastCheck': '9.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000510287', 'lastCheck': '2.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107961', 'lastCheck': '2.3', 'valid': True}} >Thread-134821::DEBUG::2014-10-29 11:01:28,239::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ff09f2d-6cdc-48d1-9764-f73f3445756c`::moving from state preparing -> state finished >Thread-134821::DEBUG::2014-10-29 11:01:28,240::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134821::DEBUG::2014-10-29 11:01:28,240::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134821::DEBUG::2014-10-29 11:01:28,240::task::993::Storage.TaskManager.Task::(_decref) Task=`4ff09f2d-6cdc-48d1-9764-f73f3445756c`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:01:28,370::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53634 >Detector thread::DEBUG::2014-10-29 11:01:28,370::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53634 >Detector thread::DEBUG::2014-10-29 11:01:28,371::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53634 >Detector thread::DEBUG::2014-10-29 11:01:28,371::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53634) >Thread-17::DEBUG::2014-10-29 11:01:28,393::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:28,393::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:28,394::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:28,394::__init__::232::IOProcess::(_processLogs) (198693) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:28,395::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198693) Queuing response >Thread-178::DEBUG::2014-10-29 11:01:28,396::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-134822::DEBUG::2014-10-29 11:01:28,414::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-178::DEBUG::2014-10-29 11:01:28,416::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000478004 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:01:28,422::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-134822::DEBUG::2014-10-29 11:01:28,424::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-17::DEBUG::2014-10-29 11:01:28,425::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:28,445::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:28,445::__init__::232::IOProcess::(_processLogs) (198694) Got request for method 'statvfs' >Thread-33::DEBUG::2014-10-29 11:01:28,446::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-134822::DEBUG::2014-10-29 11:01:28,456::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:01:28,458::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198694) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:28,466::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:28,466::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:28,466::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:28,467::__init__::232::IOProcess::(_processLogs) (198695) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:28,468::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198695) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:28,470::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:28,471::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:28,473::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:28,475::__init__::232::IOProcess::(_processLogs) (198696) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:28,478::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198696) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:28,483::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:28,487::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:28,491::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:28,493::__init__::232::IOProcess::(_processLogs) (198697) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:28,495::__init__::232::IOProcess::(_processLogs) (198697) Queuing response >Thread-33::DEBUG::2014-10-29 11:01:28,502::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:01:28,505::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:28,506::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:28,508::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:28,510::__init__::232::IOProcess::(_processLogs) (198698) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:28,511::__init__::232::IOProcess::(_processLogs) (198698) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:28,515::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:28,517::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:28,519::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:28,519::__init__::232::IOProcess::(_processLogs) (198699) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:28,523::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198699) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:28,526::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:28,527::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:28,528::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:28,529::__init__::232::IOProcess::(_processLogs) (198700) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:28,530::__init__::232::IOProcess::(_processLogs) (198700) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:28,535::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:28,535::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:28,536::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:28,536::__init__::232::IOProcess::(_processLogs) (198701) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:01:28,537::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198701) Queuing response >Thread-33::DEBUG::2014-10-29 11:01:28,538::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:01:28,545::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:28,546::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:28,548::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:28,550::__init__::232::IOProcess::(_processLogs) (198702) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:28,551::__init__::232::IOProcess::(_processLogs) (198702) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:28,554::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:28,556::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:28,557::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:28,559::__init__::232::IOProcess::(_processLogs) (198703) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:01:28,563::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198703) Queuing response >Thread-33::DEBUG::2014-10-29 11:01:28,564::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:01:28,570::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:28,572::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:28,574::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:28,577::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198704) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:28,579::__init__::232::IOProcess::(_processLogs) (198704) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:28,581::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:28,582::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-33::DEBUG::2014-10-29 11:01:28,586::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:01:28,586::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-33::INFO::2014-10-29 11:01:28,588::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:01:28,590::__init__::232::IOProcess::(_processLogs) (198705) Got request for method 'glob' >Thread-33::INFO::2014-10-29 11:01:28,591::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:01:28,593::__init__::232::IOProcess::(_processLogs) (198705) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:28,597::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:28,600::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:28,602::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:28,603::__init__::232::IOProcess::(_processLogs) (198706) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:28,611::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198706) Queuing response >Thread-33::DEBUG::2014-10-29 11:01:28,614::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:01:28,651::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000473523 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:01:28,658::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:28,660::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-134822::DEBUG::2014-10-29 11:01:28,662::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '80', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '80', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-17::DEBUG::2014-10-29 11:01:28,663::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:28,666::__init__::232::IOProcess::(_processLogs) (198707) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:28,672::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198707) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:28,676::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:28,680::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:28,681::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:28,683::__init__::232::IOProcess::(_processLogs) (198708) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:28,685::__init__::232::IOProcess::(_processLogs) (198708) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:28,689::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:28,690::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:28,692::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:28,693::__init__::232::IOProcess::(_processLogs) (198709) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:28,697::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198709) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:28,700::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:28,702::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:28,704::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:28,706::__init__::232::IOProcess::(_processLogs) (198710) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:28,709::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198710) Queuing response >Detector thread::DEBUG::2014-10-29 11:01:30,064::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53635 >Detector thread::DEBUG::2014-10-29 11:01:30,065::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53635 >Detector thread::DEBUG::2014-10-29 11:01:30,069::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53635 >Detector thread::DEBUG::2014-10-29 11:01:30,070::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53635) >Thread-134827::DEBUG::2014-10-29 11:01:30,104::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-134827::DEBUG::2014-10-29 11:01:30,105::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134827::DEBUG::2014-10-29 11:01:30,106::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.77', 'elapsedTime': '513122', 'displayType': 'vnc', 'cpuSys': '0.60', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '58701430', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '56592', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '44437.33'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.18', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:01:30,482::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53637 >Detector thread::DEBUG::2014-10-29 11:01:30,483::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53637 >Detector thread::DEBUG::2014-10-29 11:01:30,483::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53637 >Detector thread::DEBUG::2014-10-29 11:01:30,483::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53637) >Thread-134828::DEBUG::2014-10-29 11:01:30,523::task::595::Storage.TaskManager.Task::(_updateState) Task=`84d9c4b5-9f14-457b-add9-8f05b739b5b3`::moving from state init -> state preparing >Thread-134828::INFO::2014-10-29 11:01:30,523::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134828::INFO::2014-10-29 11:01:30,524::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478004', 'lastCheck': '2.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473523', 'lastCheck': '1.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000510287', 'lastCheck': '4.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107961', 'lastCheck': '4.6', 'valid': True}} >Thread-134828::DEBUG::2014-10-29 11:01:30,524::task::1191::Storage.TaskManager.Task::(prepare) Task=`84d9c4b5-9f14-457b-add9-8f05b739b5b3`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478004', 'lastCheck': '2.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473523', 'lastCheck': '1.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000510287', 'lastCheck': '4.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00107961', 'lastCheck': '4.6', 'valid': True}} >Thread-134828::DEBUG::2014-10-29 11:01:30,525::task::595::Storage.TaskManager.Task::(_updateState) Task=`84d9c4b5-9f14-457b-add9-8f05b739b5b3`::moving from state preparing -> state finished >Thread-134828::DEBUG::2014-10-29 11:01:30,525::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134828::DEBUG::2014-10-29 11:01:30,525::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134828::DEBUG::2014-10-29 11:01:30,525::task::993::Storage.TaskManager.Task::(_decref) Task=`84d9c4b5-9f14-457b-add9-8f05b739b5b3`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:31,181::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:31,184::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134829::DEBUG::2014-10-29 11:01:31,187::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:31,190::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:31,191::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134830::DEBUG::2014-10-29 11:01:31,194::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134830::DEBUG::2014-10-29 11:01:31,196::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:01:32,744::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:32,929::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:32,931::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:32,932::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:34,210::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:34,212::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134831::DEBUG::2014-10-29 11:01:34,216::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:34,218::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:34,220::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134832::DEBUG::2014-10-29 11:01:34,223::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134832::DEBUG::2014-10-29 11:01:34,225::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:01:35,920::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:35,921::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10269::DEBUG::2014-10-29 11:01:35,922::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:01:35,939::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:35,942::__init__::232::IOProcess::(_processLogs) (198711) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:35,943::__init__::232::IOProcess::(_processLogs) (198711) Queuing response >Thread-10269::DEBUG::2014-10-29 11:01:35,943::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000611326 s, 821 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:01:35,945::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:35,945::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:35,947::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:35,948::__init__::232::IOProcess::(_processLogs) (198712) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:35,949::__init__::232::IOProcess::(_processLogs) (198712) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:35,979::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:35,980::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-179::DEBUG::2014-10-29 11:01:35,982::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:01:35,982::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:35,998::__init__::232::IOProcess::(_processLogs) (198713) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:35,999::__init__::232::IOProcess::(_processLogs) (198713) Queuing response >Thread-179::DEBUG::2014-10-29 11:01:36,000::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000823621 s, 452 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:01:36,002::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:36,002::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:36,002::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:36,002::__init__::232::IOProcess::(_processLogs) (198714) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:36,004::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198714) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:37,238::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:37,241::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134833::DEBUG::2014-10-29 11:01:37,245::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:37,247::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:37,249::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134834::DEBUG::2014-10-29 11:01:37,253::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134834::DEBUG::2014-10-29 11:01:37,255::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:37,938::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:37,940::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:37,941::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:01:38,549::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:38,550::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:38,550::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:38,550::__init__::232::IOProcess::(_processLogs) (198715) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:38,552::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198715) Queuing response >Thread-178::DEBUG::2014-10-29 11:01:38,554::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:01:38,575::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00138974 s, 366 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:01:38,577::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:38,578::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:38,578::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:38,578::__init__::232::IOProcess::(_processLogs) (198716) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:38,580::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198716) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:38,582::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:38,582::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:38,583::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:38,584::__init__::232::IOProcess::(_processLogs) (198717) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:38,584::__init__::232::IOProcess::(_processLogs) (198717) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:38,585::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:38,585::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:38,586::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:38,586::__init__::232::IOProcess::(_processLogs) (198718) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:38,587::__init__::232::IOProcess::(_processLogs) (198718) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:38,587::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:38,587::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:38,588::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:38,589::__init__::232::IOProcess::(_processLogs) (198719) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:38,589::__init__::232::IOProcess::(_processLogs) (198719) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:38,713::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:38,713::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:38,714::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:38,714::__init__::232::IOProcess::(_processLogs) (198720) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:38,715::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198720) Queuing response >Thread-33::DEBUG::2014-10-29 11:01:38,716::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:01:38,735::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000565608 s, 861 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:01:38,737::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:38,738::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:38,738::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:38,738::__init__::232::IOProcess::(_processLogs) (198721) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:38,740::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198721) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:38,741::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:38,741::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:38,742::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:38,742::__init__::232::IOProcess::(_processLogs) (198722) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:38,743::__init__::232::IOProcess::(_processLogs) (198722) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:38,743::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:38,744::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:38,744::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:38,745::__init__::232::IOProcess::(_processLogs) (198723) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:38,745::__init__::232::IOProcess::(_processLogs) (198723) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:38,746::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:38,746::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:38,747::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:38,747::__init__::232::IOProcess::(_processLogs) (198724) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:38,747::__init__::232::IOProcess::(_processLogs) (198724) Queuing response >Detector thread::DEBUG::2014-10-29 11:01:38,762::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53638 >Detector thread::DEBUG::2014-10-29 11:01:38,763::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53638 >Detector thread::DEBUG::2014-10-29 11:01:38,763::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53638 >Detector thread::DEBUG::2014-10-29 11:01:38,764::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53638) >Thread-134835::DEBUG::2014-10-29 11:01:38,802::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Detector thread::DEBUG::2014-10-29 11:01:38,803::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53640 >Detector thread::DEBUG::2014-10-29 11:01:38,806::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53640 >Thread-134835::DEBUG::2014-10-29 11:01:38,808::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Detector thread::DEBUG::2014-10-29 11:01:38,809::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53640 >Detector thread::DEBUG::2014-10-29 11:01:38,828::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53640) >Thread-134835::DEBUG::2014-10-29 11:01:38,831::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-134836::DEBUG::2014-10-29 11:01:38,844::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134836::DEBUG::2014-10-29 11:01:38,845::task::595::Storage.TaskManager.Task::(_updateState) Task=`0bc090e8-5f72-488d-8f76-4ea2e50abc94`::moving from state init -> state preparing >Thread-134836::INFO::2014-10-29 11:01:38,846::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-134836::DEBUG::2014-10-29 11:01:38,858::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:01:38,862::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:38,864::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:38,866::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:38,866::__init__::232::IOProcess::(_processLogs) (198725) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:38,867::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198725) Queuing response >Thread-134836::DEBUG::2014-10-29 11:01:38,868::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-134836::DEBUG::2014-10-29 11:01:38,871::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-134836::INFO::2014-10-29 11:01:38,873::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-134836::DEBUG::2014-10-29 11:01:38,875::task::1191::Storage.TaskManager.Task::(prepare) Task=`0bc090e8-5f72-488d-8f76-4ea2e50abc94`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-134836::DEBUG::2014-10-29 11:01:38,876::task::595::Storage.TaskManager.Task::(_updateState) Task=`0bc090e8-5f72-488d-8f76-4ea2e50abc94`::moving from state preparing -> state finished >Thread-134836::DEBUG::2014-10-29 11:01:38,878::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134836::DEBUG::2014-10-29 11:01:38,880::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134836::DEBUG::2014-10-29 11:01:38,882::task::993::Storage.TaskManager.Task::(_decref) Task=`0bc090e8-5f72-488d-8f76-4ea2e50abc94`::ref 0 aborting False >Thread-134835::DEBUG::2014-10-29 11:01:38,924::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '48', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '48', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:01:38,934::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53641 >Detector thread::DEBUG::2014-10-29 11:01:38,935::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53641 >Detector thread::DEBUG::2014-10-29 11:01:38,935::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53641 >Detector thread::DEBUG::2014-10-29 11:01:38,936::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53641) >Thread-134837::DEBUG::2014-10-29 11:01:38,974::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134837::DEBUG::2014-10-29 11:01:38,975::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5218d0d-23ee-4f8a-8998-7cd35ebefaf9`::moving from state init -> state preparing >Thread-134837::INFO::2014-10-29 11:01:38,975::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-134837::DEBUG::2014-10-29 11:01:38,975::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-134837::DEBUG::2014-10-29 11:01:38,976::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-134837::DEBUG::2014-10-29 11:01:38,976::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-134837::DEBUG::2014-10-29 11:01:38,976::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-134837::DEBUG::2014-10-29 11:01:38,976::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-134837::DEBUG::2014-10-29 11:01:38,977::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-134837::DEBUG::2014-10-29 11:01:39,059::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-134837::DEBUG::2014-10-29 11:01:39,059::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-134837::DEBUG::2014-10-29 11:01:39,230::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-134837::DEBUG::2014-10-29 11:01:39,231::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134837::DEBUG::2014-10-29 11:01:39,231::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134837::DEBUG::2014-10-29 11:01:39,232::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134837::DEBUG::2014-10-29 11:01:39,232::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134837::DEBUG::2014-10-29 11:01:39,232::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134837::DEBUG::2014-10-29 11:01:39,233::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134837::DEBUG::2014-10-29 11:01:39,233::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:01:39,239::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:39,240::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:39,240::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:39,240::__init__::232::IOProcess::(_processLogs) (198726) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:39,241::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198726) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:39,243::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:39,247::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:39,247::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:39,248::__init__::232::IOProcess::(_processLogs) (198727) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:39,249::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198727) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:39,254::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:39,257::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Detector thread::DEBUG::2014-10-29 11:01:39,261::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53642 >Thread-17::DEBUG::2014-10-29 11:01:39,261::__init__::232::IOProcess::(_processLogs) Extracting request information... >Detector thread::DEBUG::2014-10-29 11:01:39,265::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53642 >Thread-17::DEBUG::2014-10-29 11:01:39,265::__init__::232::IOProcess::(_processLogs) (198728) Got request for method 'glob' >Thread-134837::DEBUG::2014-10-29 11:01:39,266::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Detector thread::DEBUG::2014-10-29 11:01:39,268::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53642 >Thread-17::DEBUG::2014-10-29 11:01:39,269::__init__::232::IOProcess::(_processLogs) (198728) Queuing response >Detector thread::DEBUG::2014-10-29 11:01:39,271::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53642) >Thread-17::DEBUG::2014-10-29 11:01:39,272::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:39,275::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:39,276::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:39,276::__init__::232::IOProcess::(_processLogs) (198729) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:39,277::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198729) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:39,279::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:39,279::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:39,279::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:39,279::__init__::232::IOProcess::(_processLogs) (198730) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:01:39,281::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198730) Queuing response >Thread-134837::DEBUG::2014-10-29 11:01:39,282::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:01:39,283::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:39,283::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:39,283::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:39,284::__init__::232::IOProcess::(_processLogs) (198731) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:01:39,284::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198731) Queuing response >Thread-134837::DEBUG::2014-10-29 11:01:39,285::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:01:39,286::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:39,287::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:39,288::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:39,288::__init__::232::IOProcess::(_processLogs) (198732) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:39,288::__init__::232::IOProcess::(_processLogs) (198732) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:39,289::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:39,289::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:39,289::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:39,289::__init__::232::IOProcess::(_processLogs) (198733) Got request for method 'glob' >Thread-134837::DEBUG::2014-10-29 11:01:39,290::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:01:39,290::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198733) Queuing response >Thread-134837::INFO::2014-10-29 11:01:39,291::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-134837::INFO::2014-10-29 11:01:39,292::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-134837::INFO::2014-10-29 11:01:39,293::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:01:39,293::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:39,294::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:39,294::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:39,294::__init__::232::IOProcess::(_processLogs) (198734) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:01:39,295::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198734) Queuing response >Thread-134837::DEBUG::2014-10-29 11:01:39,295::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-134837::DEBUG::2014-10-29 11:01:39,298::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`38a8a02d-4620-472a-9fb1-eae013e9072d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-134837::DEBUG::2014-10-29 11:01:39,298::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-134837::DEBUG::2014-10-29 11:01:39,298::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-134837::DEBUG::2014-10-29 11:01:39,299::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`38a8a02d-4620-472a-9fb1-eae013e9072d`::Granted request >Thread-134837::DEBUG::2014-10-29 11:01:39,299::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b5218d0d-23ee-4f8a-8998-7cd35ebefaf9`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-134837::DEBUG::2014-10-29 11:01:39,300::task::993::Storage.TaskManager.Task::(_decref) Task=`b5218d0d-23ee-4f8a-8998-7cd35ebefaf9`::ref 1 aborting False >Thread-134842::DEBUG::2014-10-29 11:01:39,302::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-134842::DEBUG::2014-10-29 11:01:39,307::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134842::DEBUG::2014-10-29 11:01:39,311::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.77', 'elapsedTime': '513131', 'displayType': 'vnc', 'cpuSys': '0.60', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '58701430', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '56592', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '44437.33'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.36', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-134837::INFO::2014-10-29 11:01:39,314::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-134837::DEBUG::2014-10-29 11:01:39,316::task::1191::Storage.TaskManager.Task::(prepare) Task=`b5218d0d-23ee-4f8a-8998-7cd35ebefaf9`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-134837::DEBUG::2014-10-29 11:01:39,317::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5218d0d-23ee-4f8a-8998-7cd35ebefaf9`::moving from state preparing -> state finished >Thread-134837::DEBUG::2014-10-29 11:01:39,318::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-134837::DEBUG::2014-10-29 11:01:39,320::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134837::DEBUG::2014-10-29 11:01:39,322::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-134837::DEBUG::2014-10-29 11:01:39,324::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-134837::DEBUG::2014-10-29 11:01:39,324::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-134837::DEBUG::2014-10-29 11:01:39,326::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-134837::DEBUG::2014-10-29 11:01:39,327::task::993::Storage.TaskManager.Task::(_decref) Task=`b5218d0d-23ee-4f8a-8998-7cd35ebefaf9`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:01:39,348::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53643 >Detector thread::DEBUG::2014-10-29 11:01:39,349::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53643 >Detector thread::DEBUG::2014-10-29 11:01:39,349::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53643 >Detector thread::DEBUG::2014-10-29 11:01:39,350::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53643) >Thread-134843::DEBUG::2014-10-29 11:01:39,388::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134843::DEBUG::2014-10-29 11:01:39,389::task::595::Storage.TaskManager.Task::(_updateState) Task=`d750dd46-a840-4550-8fb1-c68700dfc1c1`::moving from state init -> state preparing >Thread-134843::INFO::2014-10-29 11:01:39,389::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134843::INFO::2014-10-29 11:01:39,390::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00138974', 'lastCheck': '0.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565608', 'lastCheck': '0.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000823621', 'lastCheck': '3.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000611326', 'lastCheck': '3.4', 'valid': True}} >Thread-134843::DEBUG::2014-10-29 11:01:39,390::task::1191::Storage.TaskManager.Task::(prepare) Task=`d750dd46-a840-4550-8fb1-c68700dfc1c1`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00138974', 'lastCheck': '0.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565608', 'lastCheck': '0.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000823621', 'lastCheck': '3.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000611326', 'lastCheck': '3.4', 'valid': True}} >Thread-134843::DEBUG::2014-10-29 11:01:39,391::task::595::Storage.TaskManager.Task::(_updateState) Task=`d750dd46-a840-4550-8fb1-c68700dfc1c1`::moving from state preparing -> state finished >Thread-134843::DEBUG::2014-10-29 11:01:39,391::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134843::DEBUG::2014-10-29 11:01:39,391::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134843::DEBUG::2014-10-29 11:01:39,391::task::993::Storage.TaskManager.Task::(_decref) Task=`d750dd46-a840-4550-8fb1-c68700dfc1c1`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:40,266::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:40,269::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134844::DEBUG::2014-10-29 11:01:40,273::task::595::Storage.TaskManager.Task::(_updateState) Task=`fbd6e42e-11f1-4775-9132-fcde40b0ec15`::moving from state init -> state preparing >Thread-134844::INFO::2014-10-29 11:01:40,273::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134844::INFO::2014-10-29 11:01:40,274::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00138974', 'lastCheck': '1.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565608', 'lastCheck': '1.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000823621', 'lastCheck': '4.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000611326', 'lastCheck': '4.3', 'valid': True}} >Thread-134844::DEBUG::2014-10-29 11:01:40,274::task::1191::Storage.TaskManager.Task::(prepare) Task=`fbd6e42e-11f1-4775-9132-fcde40b0ec15`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00138974', 'lastCheck': '1.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565608', 'lastCheck': '1.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000823621', 'lastCheck': '4.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000611326', 'lastCheck': '4.3', 'valid': True}} >Thread-134844::DEBUG::2014-10-29 11:01:40,274::task::595::Storage.TaskManager.Task::(_updateState) Task=`fbd6e42e-11f1-4775-9132-fcde40b0ec15`::moving from state preparing -> state finished >Thread-134844::DEBUG::2014-10-29 11:01:40,274::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134844::DEBUG::2014-10-29 11:01:40,275::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134844::DEBUG::2014-10-29 11:01:40,275::task::993::Storage.TaskManager.Task::(_decref) Task=`fbd6e42e-11f1-4775-9132-fcde40b0ec15`::ref 0 aborting False >Thread-134844::DEBUG::2014-10-29 11:01:40,310::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:40,337::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:40,339::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134845::DEBUG::2014-10-29 11:01:40,342::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134845::DEBUG::2014-10-29 11:01:40,344::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:01:40,598::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53645 >Detector thread::DEBUG::2014-10-29 11:01:40,598::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53645 >Detector thread::DEBUG::2014-10-29 11:01:40,599::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53645 >Detector thread::DEBUG::2014-10-29 11:01:40,599::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53645) >Thread-134846::DEBUG::2014-10-29 11:01:40,639::task::595::Storage.TaskManager.Task::(_updateState) Task=`169a3066-2a01-40ed-bfcc-c21659059710`::moving from state init -> state preparing >Thread-134846::INFO::2014-10-29 11:01:40,639::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134846::INFO::2014-10-29 11:01:40,640::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00138974', 'lastCheck': '2.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565608', 'lastCheck': '1.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000823621', 'lastCheck': '4.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000611326', 'lastCheck': '4.7', 'valid': True}} >Thread-134846::DEBUG::2014-10-29 11:01:40,640::task::1191::Storage.TaskManager.Task::(prepare) Task=`169a3066-2a01-40ed-bfcc-c21659059710`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00138974', 'lastCheck': '2.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565608', 'lastCheck': '1.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000823621', 'lastCheck': '4.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000611326', 'lastCheck': '4.7', 'valid': True}} >Thread-134846::DEBUG::2014-10-29 11:01:40,640::task::595::Storage.TaskManager.Task::(_updateState) Task=`169a3066-2a01-40ed-bfcc-c21659059710`::moving from state preparing -> state finished >Thread-134846::DEBUG::2014-10-29 11:01:40,640::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134846::DEBUG::2014-10-29 11:01:40,641::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134846::DEBUG::2014-10-29 11:01:40,641::task::993::Storage.TaskManager.Task::(_decref) Task=`169a3066-2a01-40ed-bfcc-c21659059710`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:01:41,943::task::595::Storage.TaskManager.Task::(_updateState) Task=`30de7c51-d981-495a-a981-abe1943d5831`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:01:41,944::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:01:41,945::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:41,945::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:41,945::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:41,946::__init__::232::IOProcess::(_processLogs) (198735) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:01:41,946::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198735) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:41,948::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:41,948::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:41,949::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-22::INFO::2014-10-29 11:01:41,950::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010855424', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:01:41,951::__init__::232::IOProcess::(_processLogs) (198736) Got request for method 'stat' >Thread-22::DEBUG::2014-10-29 11:01:41,951::task::1191::Storage.TaskManager.Task::(prepare) Task=`30de7c51-d981-495a-a981-abe1943d5831`::finished: {'truesize': '6010855424', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:01:41,952::__init__::232::IOProcess::(_processLogs) (198736) Queuing response >Thread-22::DEBUG::2014-10-29 11:01:41,953::task::595::Storage.TaskManager.Task::(_updateState) Task=`30de7c51-d981-495a-a981-abe1943d5831`::moving from state preparing -> state finished >Thread-22::DEBUG::2014-10-29 11:01:41,954::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-10-29 11:01:41,954::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2014-10-29 11:01:41,954::task::993::Storage.TaskManager.Task::(_decref) Task=`30de7c51-d981-495a-a981-abe1943d5831`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:01:42,028::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:42,948::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:42,951::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:42,952::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:43,399::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:43,401::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134847::DEBUG::2014-10-29 11:01:43,406::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:43,408::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:43,410::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134848::DEBUG::2014-10-29 11:01:43,414::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134848::DEBUG::2014-10-29 11:01:43,416::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:01:45,949::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:45,950::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:45,950::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:45,950::__init__::232::IOProcess::(_processLogs) (198737) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:45,952::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198737) Queuing response >Thread-10269::DEBUG::2014-10-29 11:01:45,953::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:01:45,972::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000452826 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:01:45,975::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:45,975::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:45,975::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:45,976::__init__::232::IOProcess::(_processLogs) (198738) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:45,976::__init__::232::IOProcess::(_processLogs) (198738) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:46,006::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:46,007::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:46,007::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:46,007::__init__::232::IOProcess::(_processLogs) (198739) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:46,008::__init__::232::IOProcess::(_processLogs) (198739) Queuing response >Thread-179::DEBUG::2014-10-29 11:01:46,009::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:01:46,028::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000437295 s, 851 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:01:46,031::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:46,032::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:46,032::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:46,032::__init__::232::IOProcess::(_processLogs) (198740) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:46,034::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198740) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:46,433::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:46,439::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134849::DEBUG::2014-10-29 11:01:46,448::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:46,453::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:46,458::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134850::DEBUG::2014-10-29 11:01:46,465::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134850::DEBUG::2014-10-29 11:01:46,480::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:47,959::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:47,960::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:47,961::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:01:48,591::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:48,592::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:48,592::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:48,592::__init__::232::IOProcess::(_processLogs) (198741) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:48,594::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198741) Queuing response >Thread-178::DEBUG::2014-10-29 11:01:48,595::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:01:48,614::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000503944 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:01:48,616::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:48,616::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:48,616::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:48,617::__init__::232::IOProcess::(_processLogs) (198742) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:48,617::__init__::232::IOProcess::(_processLogs) (198742) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:48,619::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:48,619::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:48,620::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:48,621::__init__::232::IOProcess::(_processLogs) (198743) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:48,621::__init__::232::IOProcess::(_processLogs) (198743) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:48,622::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:48,622::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:48,622::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:48,623::__init__::232::IOProcess::(_processLogs) (198744) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:48,623::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198744) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:48,624::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:48,625::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:48,625::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:48,625::__init__::232::IOProcess::(_processLogs) (198745) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:48,626::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198745) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:48,751::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:48,751::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:48,753::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:48,754::__init__::232::IOProcess::(_processLogs) (198746) Got request for method 'statvfs' >Thread-33::DEBUG::2014-10-29 11:01:48,754::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:01:48,755::__init__::232::IOProcess::(_processLogs) (198746) Queuing response >Thread-33::DEBUG::2014-10-29 11:01:48,773::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000586219 s, 831 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:01:48,775::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:48,775::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:48,776::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:48,778::__init__::232::IOProcess::(_processLogs) (198747) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:48,778::__init__::232::IOProcess::(_processLogs) (198747) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:48,779::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:48,779::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:48,779::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:48,780::__init__::232::IOProcess::(_processLogs) (198748) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:48,780::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198748) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:48,781::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:48,782::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:48,782::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:48,783::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198749) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:48,783::__init__::232::IOProcess::(_processLogs) (198749) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:48,784::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:48,784::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:48,784::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:48,785::__init__::232::IOProcess::(_processLogs) (198750) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:48,785::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198750) Queuing response >Detector thread::DEBUG::2014-10-29 11:01:48,974::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53646 >Detector thread::DEBUG::2014-10-29 11:01:48,975::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53646 >Detector thread::DEBUG::2014-10-29 11:01:48,975::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53646 >Detector thread::DEBUG::2014-10-29 11:01:48,976::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53646) >Thread-134851::DEBUG::2014-10-29 11:01:49,015::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-134851::DEBUG::2014-10-29 11:01:49,017::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-134851::DEBUG::2014-10-29 11:01:49,036::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-134851::DEBUG::2014-10-29 11:01:49,081::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '33', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '32', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:01:49,482::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53647 >Detector thread::DEBUG::2014-10-29 11:01:49,485::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53647 >Detector thread::DEBUG::2014-10-29 11:01:49,485::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53647 >Detector thread::DEBUG::2014-10-29 11:01:49,486::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53647) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:49,497::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:49,499::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134853::DEBUG::2014-10-29 11:01:49,503::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:49,506::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:49,509::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134854::DEBUG::2014-10-29 11:01:49,514::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134854::DEBUG::2014-10-29 11:01:49,516::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-134852::DEBUG::2014-10-29 11:01:49,526::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-134852::DEBUG::2014-10-29 11:01:49,527::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134852::DEBUG::2014-10-29 11:01:49,528::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.21', 'elapsedTime': '513142', 'displayType': 'vnc', 'cpuSys': '0.66', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '16378362', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '71075', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '36539.27'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.50', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:01:50,004::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53650 >Detector thread::DEBUG::2014-10-29 11:01:50,006::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53650 >Detector thread::DEBUG::2014-10-29 11:01:50,007::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53650 >Detector thread::DEBUG::2014-10-29 11:01:50,007::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53650) >Thread-134855::DEBUG::2014-10-29 11:01:50,045::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134855::DEBUG::2014-10-29 11:01:50,045::task::595::Storage.TaskManager.Task::(_updateState) Task=`c8aa9758-dc28-4870-a2e1-f6edc2214181`::moving from state init -> state preparing >Thread-134855::INFO::2014-10-29 11:01:50,046::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-134855::DEBUG::2014-10-29 11:01:50,050::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:01:50,050::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:50,051::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:50,051::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:50,051::__init__::232::IOProcess::(_processLogs) (198751) Got request for method 'glob' >Detector thread::DEBUG::2014-10-29 11:01:50,693::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53651 >Detector thread::DEBUG::2014-10-29 11:01:50,694::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53651 >Detector thread::DEBUG::2014-10-29 11:01:50,694::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53651 >Detector thread::DEBUG::2014-10-29 11:01:50,694::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53651) >Thread-134856::DEBUG::2014-10-29 11:01:50,734::task::595::Storage.TaskManager.Task::(_updateState) Task=`3118a314-865d-402a-a06d-6b03dcf8a767`::moving from state init -> state preparing >Thread-134856::INFO::2014-10-29 11:01:50,734::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134856::INFO::2014-10-29 11:01:50,735::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503944', 'lastCheck': '2.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000586219', 'lastCheck': '1.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437295', 'lastCheck': '4.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000452826', 'lastCheck': '4.8', 'valid': True}} >Thread-134856::DEBUG::2014-10-29 11:01:50,735::task::1191::Storage.TaskManager.Task::(prepare) Task=`3118a314-865d-402a-a06d-6b03dcf8a767`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503944', 'lastCheck': '2.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000586219', 'lastCheck': '1.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437295', 'lastCheck': '4.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000452826', 'lastCheck': '4.8', 'valid': True}} >Thread-134856::DEBUG::2014-10-29 11:01:50,735::task::595::Storage.TaskManager.Task::(_updateState) Task=`3118a314-865d-402a-a06d-6b03dcf8a767`::moving from state preparing -> state finished >Thread-134856::DEBUG::2014-10-29 11:01:50,736::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134856::DEBUG::2014-10-29 11:01:50,736::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134856::DEBUG::2014-10-29 11:01:50,736::task::993::Storage.TaskManager.Task::(_decref) Task=`3118a314-865d-402a-a06d-6b03dcf8a767`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:01:50,792::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198751) Queuing response >Thread-134855::DEBUG::2014-10-29 11:01:50,793::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-134855::DEBUG::2014-10-29 11:01:50,794::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-134855::INFO::2014-10-29 11:01:50,795::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-134855::DEBUG::2014-10-29 11:01:50,795::task::1191::Storage.TaskManager.Task::(prepare) Task=`c8aa9758-dc28-4870-a2e1-f6edc2214181`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-134855::DEBUG::2014-10-29 11:01:50,795::task::595::Storage.TaskManager.Task::(_updateState) Task=`c8aa9758-dc28-4870-a2e1-f6edc2214181`::moving from state preparing -> state finished >Thread-134855::DEBUG::2014-10-29 11:01:50,795::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134855::DEBUG::2014-10-29 11:01:50,796::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134855::DEBUG::2014-10-29 11:01:50,796::task::993::Storage.TaskManager.Task::(_decref) Task=`c8aa9758-dc28-4870-a2e1-f6edc2214181`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:01:50,840::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53652 >Detector thread::DEBUG::2014-10-29 11:01:50,841::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53652 >Detector thread::DEBUG::2014-10-29 11:01:50,841::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53652 >Detector thread::DEBUG::2014-10-29 11:01:50,841::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53652) >Thread-134857::DEBUG::2014-10-29 11:01:50,880::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134857::DEBUG::2014-10-29 11:01:50,880::task::595::Storage.TaskManager.Task::(_updateState) Task=`72e810bb-4f05-483f-b10c-bb8b9710887d`::moving from state init -> state preparing >Thread-134857::INFO::2014-10-29 11:01:50,881::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-134857::DEBUG::2014-10-29 11:01:50,881::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-134857::DEBUG::2014-10-29 11:01:50,881::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-134857::DEBUG::2014-10-29 11:01:50,882::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-134857::DEBUG::2014-10-29 11:01:50,882::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-134857::DEBUG::2014-10-29 11:01:50,882::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-134857::DEBUG::2014-10-29 11:01:50,883::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-134857::DEBUG::2014-10-29 11:01:50,982::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-134857::DEBUG::2014-10-29 11:01:50,983::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-134857::DEBUG::2014-10-29 11:01:51,176::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-134857::DEBUG::2014-10-29 11:01:51,177::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134857::DEBUG::2014-10-29 11:01:51,177::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134857::DEBUG::2014-10-29 11:01:51,178::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134857::DEBUG::2014-10-29 11:01:51,178::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134857::DEBUG::2014-10-29 11:01:51,178::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134857::DEBUG::2014-10-29 11:01:51,179::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134857::DEBUG::2014-10-29 11:01:51,179::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:01:51,186::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:51,189::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:51,189::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:51,189::__init__::232::IOProcess::(_processLogs) (198752) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:51,190::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198752) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:51,192::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:51,192::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:51,192::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:51,192::__init__::232::IOProcess::(_processLogs) (198753) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:51,193::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198753) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:51,195::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:51,197::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:51,198::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:51,199::__init__::232::IOProcess::(_processLogs) (198754) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:51,203::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198754) Queuing response >Thread-134857::DEBUG::2014-10-29 11:01:51,207::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:01:51,208::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:51,209::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:51,209::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:51,210::__init__::232::IOProcess::(_processLogs) (198755) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:01:51,211::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198755) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:51,212::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:51,212::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:51,212::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:51,212::__init__::232::IOProcess::(_processLogs) (198756) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:01:51,213::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198756) Queuing response >Thread-134857::DEBUG::2014-10-29 11:01:51,214::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:01:51,215::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:51,215::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:51,215::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:51,216::__init__::232::IOProcess::(_processLogs) (198757) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:01:51,216::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198757) Queuing response >Thread-134857::DEBUG::2014-10-29 11:01:51,217::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:01:51,219::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:51,219::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:51,219::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:51,219::__init__::232::IOProcess::(_processLogs) (198758) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:51,220::__init__::232::IOProcess::(_processLogs) (198758) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:51,221::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:51,221::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-134857::DEBUG::2014-10-29 11:01:51,222::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:01:51,222::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-134857::INFO::2014-10-29 11:01:51,223::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-134857::INFO::2014-10-29 11:01:51,224::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:01:51,224::__init__::232::IOProcess::(_processLogs) (198759) Got request for method 'glob' >Thread-134857::INFO::2014-10-29 11:01:51,226::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:01:51,226::__init__::232::IOProcess::(_processLogs) (198759) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:51,228::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:51,228::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:51,228::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:51,229::__init__::232::IOProcess::(_processLogs) (198760) Got request for method 'readfile' >Thread-134857::DEBUG::2014-10-29 11:01:51,230::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:01:51,229::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198760) Queuing response >Thread-134857::DEBUG::2014-10-29 11:01:51,232::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`1b5bfbea-ee66-4648-a3cf-bb542fc1bf97`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-134857::DEBUG::2014-10-29 11:01:51,232::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-134857::DEBUG::2014-10-29 11:01:51,233::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-134857::DEBUG::2014-10-29 11:01:51,233::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`1b5bfbea-ee66-4648-a3cf-bb542fc1bf97`::Granted request >Thread-134857::DEBUG::2014-10-29 11:01:51,234::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`72e810bb-4f05-483f-b10c-bb8b9710887d`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-134857::DEBUG::2014-10-29 11:01:51,234::task::993::Storage.TaskManager.Task::(_decref) Task=`72e810bb-4f05-483f-b10c-bb8b9710887d`::ref 1 aborting False >Thread-134857::INFO::2014-10-29 11:01:51,237::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-134857::DEBUG::2014-10-29 11:01:51,237::task::1191::Storage.TaskManager.Task::(prepare) Task=`72e810bb-4f05-483f-b10c-bb8b9710887d`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-134857::DEBUG::2014-10-29 11:01:51,237::task::595::Storage.TaskManager.Task::(_updateState) Task=`72e810bb-4f05-483f-b10c-bb8b9710887d`::moving from state preparing -> state finished >Thread-134857::DEBUG::2014-10-29 11:01:51,238::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-134857::DEBUG::2014-10-29 11:01:51,238::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134857::DEBUG::2014-10-29 11:01:51,238::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-134857::DEBUG::2014-10-29 11:01:51,239::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-134857::DEBUG::2014-10-29 11:01:51,239::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-134857::DEBUG::2014-10-29 11:01:51,239::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-134857::DEBUG::2014-10-29 11:01:51,240::task::993::Storage.TaskManager.Task::(_decref) Task=`72e810bb-4f05-483f-b10c-bb8b9710887d`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:01:51,260::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53653 >Detector thread::DEBUG::2014-10-29 11:01:51,260::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53653 >Detector thread::DEBUG::2014-10-29 11:01:51,260::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53653 >Detector thread::DEBUG::2014-10-29 11:01:51,261::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53653) >Thread-134862::DEBUG::2014-10-29 11:01:51,300::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134862::DEBUG::2014-10-29 11:01:51,300::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6a8232e-d713-4352-a09a-c276966226d8`::moving from state init -> state preparing >Thread-134862::INFO::2014-10-29 11:01:51,301::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134862::INFO::2014-10-29 11:01:51,301::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503944', 'lastCheck': '2.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000586219', 'lastCheck': '2.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437295', 'lastCheck': '5.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000452826', 'lastCheck': '5.3', 'valid': True}} >Thread-134862::DEBUG::2014-10-29 11:01:51,302::task::1191::Storage.TaskManager.Task::(prepare) Task=`f6a8232e-d713-4352-a09a-c276966226d8`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503944', 'lastCheck': '2.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000586219', 'lastCheck': '2.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437295', 'lastCheck': '5.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000452826', 'lastCheck': '5.3', 'valid': True}} >Thread-134862::DEBUG::2014-10-29 11:01:51,302::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6a8232e-d713-4352-a09a-c276966226d8`::moving from state preparing -> state finished >Thread-134862::DEBUG::2014-10-29 11:01:51,302::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134862::DEBUG::2014-10-29 11:01:51,302::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134862::DEBUG::2014-10-29 11:01:51,303::task::993::Storage.TaskManager.Task::(_decref) Task=`f6a8232e-d713-4352-a09a-c276966226d8`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:52,532::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:52,535::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134863::DEBUG::2014-10-29 11:01:52,539::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:52,541::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:52,543::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134864::DEBUG::2014-10-29 11:01:52,546::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134864::DEBUG::2014-10-29 11:01:52,548::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:52,968::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:52,970::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:52,973::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:55,561::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:55,563::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134865::DEBUG::2014-10-29 11:01:55,567::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1aeefdc-b8ef-4c5c-b9bd-350e6ed775d2`::moving from state init -> state preparing >Thread-134865::INFO::2014-10-29 11:01:55,567::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134865::INFO::2014-10-29 11:01:55,568::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503944', 'lastCheck': '6.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000586219', 'lastCheck': '6.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437295', 'lastCheck': '9.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000452826', 'lastCheck': '9.6', 'valid': True}} >Thread-134865::DEBUG::2014-10-29 11:01:55,568::task::1191::Storage.TaskManager.Task::(prepare) Task=`f1aeefdc-b8ef-4c5c-b9bd-350e6ed775d2`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503944', 'lastCheck': '6.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000586219', 'lastCheck': '6.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437295', 'lastCheck': '9.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000452826', 'lastCheck': '9.6', 'valid': True}} >Thread-134865::DEBUG::2014-10-29 11:01:55,568::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1aeefdc-b8ef-4c5c-b9bd-350e6ed775d2`::moving from state preparing -> state finished >Thread-134865::DEBUG::2014-10-29 11:01:55,568::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134865::DEBUG::2014-10-29 11:01:55,569::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134865::DEBUG::2014-10-29 11:01:55,569::task::993::Storage.TaskManager.Task::(_decref) Task=`f1aeefdc-b8ef-4c5c-b9bd-350e6ed775d2`::ref 0 aborting False >Thread-134865::DEBUG::2014-10-29 11:01:55,592::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:55,615::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:55,617::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134866::DEBUG::2014-10-29 11:01:55,620::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134866::DEBUG::2014-10-29 11:01:55,623::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:01:55,979::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:55,979::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:55,980::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:55,980::__init__::232::IOProcess::(_processLogs) (198761) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:55,981::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198761) Queuing response >Thread-10269::DEBUG::2014-10-29 11:01:55,983::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:01:56,000::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000531037 s, 945 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:01:56,002::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:56,002::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:56,002::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:56,002::__init__::232::IOProcess::(_processLogs) (198762) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:56,003::__init__::232::IOProcess::(_processLogs) (198762) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:56,037::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:56,039::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:56,040::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-179::DEBUG::2014-10-29 11:01:56,041::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:01:56,042::__init__::232::IOProcess::(_processLogs) (198763) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:56,057::__init__::232::IOProcess::(_processLogs) (198763) Queuing response >Thread-179::DEBUG::2014-10-29 11:01:56,059::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000507437 s, 733 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:01:56,061::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:56,061::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:56,061::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:56,062::__init__::232::IOProcess::(_processLogs) (198764) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:56,062::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198764) Queuing response >Thread-22::DEBUG::2014-10-29 11:01:57,051::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:57,980::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:57,981::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:01:57,983::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:01:58,628::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:58,629::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:58,629::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:58,629::__init__::232::IOProcess::(_processLogs) (198765) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:58,631::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198765) Queuing response >Thread-178::DEBUG::2014-10-29 11:01:58,632::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:01:58,651::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000523374 s, 971 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:01:58,653::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:58,654::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:58,654::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:58,654::__init__::232::IOProcess::(_processLogs) (198766) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:58,655::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198766) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:58,657::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:58,658::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:58,659::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:58,659::__init__::232::IOProcess::(_processLogs) (198767) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:58,660::__init__::232::IOProcess::(_processLogs) (198767) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:58,660::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:58,661::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:58,662::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:58,662::__init__::232::IOProcess::(_processLogs) (198768) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:58,662::__init__::232::IOProcess::(_processLogs) (198768) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:58,663::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:58,664::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:58,664::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:58,665::__init__::232::IOProcess::(_processLogs) (198769) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:58,665::__init__::232::IOProcess::(_processLogs) (198769) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:58,690::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:58,692::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134867::DEBUG::2014-10-29 11:01:58,696::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:01:58,698::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:01:58,700::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134868::DEBUG::2014-10-29 11:01:58,703::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134868::DEBUG::2014-10-29 11:01:58,706::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:01:58,787::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:58,788::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:58,788::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:58,788::__init__::232::IOProcess::(_processLogs) (198770) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:58,789::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198770) Queuing response >Thread-33::DEBUG::2014-10-29 11:01:58,791::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:01:58,807::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000504742 s, 965 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:01:58,809::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:58,810::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:58,810::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:58,810::__init__::232::IOProcess::(_processLogs) (198771) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:01:58,812::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198771) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:58,813::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:58,814::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:58,815::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:58,815::__init__::232::IOProcess::(_processLogs) (198772) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:58,815::__init__::232::IOProcess::(_processLogs) (198772) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:58,816::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:58,817::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:58,818::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:58,818::__init__::232::IOProcess::(_processLogs) (198773) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:58,818::__init__::232::IOProcess::(_processLogs) (198773) Queuing response >Thread-17::DEBUG::2014-10-29 11:01:58,819::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:01:58,819::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:01:58,820::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:01:58,821::__init__::232::IOProcess::(_processLogs) (198774) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:01:58,821::__init__::232::IOProcess::(_processLogs) (198774) Queuing response >Detector thread::DEBUG::2014-10-29 11:01:59,132::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53654 >Detector thread::DEBUG::2014-10-29 11:01:59,133::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53654 >Detector thread::DEBUG::2014-10-29 11:01:59,133::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53654 >Detector thread::DEBUG::2014-10-29 11:01:59,134::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53654) >Thread-134869::DEBUG::2014-10-29 11:01:59,172::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-134869::DEBUG::2014-10-29 11:01:59,174::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-134869::DEBUG::2014-10-29 11:01:59,193::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-134869::DEBUG::2014-10-29 11:01:59,240::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '17', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '17', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:01:59,689::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53655 >Detector thread::DEBUG::2014-10-29 11:01:59,690::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53655 >Detector thread::DEBUG::2014-10-29 11:01:59,690::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53655 >Detector thread::DEBUG::2014-10-29 11:01:59,691::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53655) >Thread-134870::DEBUG::2014-10-29 11:01:59,729::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-134870::DEBUG::2014-10-29 11:01:59,730::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134870::DEBUG::2014-10-29 11:01:59,731::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.96', 'elapsedTime': '513152', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '16378362', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '71075', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '36539.27'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.68', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:02:00,851::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53657 >Detector thread::DEBUG::2014-10-29 11:02:00,852::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53657 >Detector thread::DEBUG::2014-10-29 11:02:00,852::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53657 >Detector thread::DEBUG::2014-10-29 11:02:00,852::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53657) >Thread-134871::DEBUG::2014-10-29 11:02:00,892::task::595::Storage.TaskManager.Task::(_updateState) Task=`43b74414-9f1f-4186-af2b-971d7b7c1ac2`::moving from state init -> state preparing >Thread-134871::INFO::2014-10-29 11:02:00,892::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134871::INFO::2014-10-29 11:02:00,893::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523374', 'lastCheck': '2.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504742', 'lastCheck': '2.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507437', 'lastCheck': '4.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000531037', 'lastCheck': '4.9', 'valid': True}} >Thread-134871::DEBUG::2014-10-29 11:02:00,893::task::1191::Storage.TaskManager.Task::(prepare) Task=`43b74414-9f1f-4186-af2b-971d7b7c1ac2`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523374', 'lastCheck': '2.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504742', 'lastCheck': '2.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507437', 'lastCheck': '4.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000531037', 'lastCheck': '4.9', 'valid': True}} >Thread-134871::DEBUG::2014-10-29 11:02:00,894::task::595::Storage.TaskManager.Task::(_updateState) Task=`43b74414-9f1f-4186-af2b-971d7b7c1ac2`::moving from state preparing -> state finished >Thread-134871::DEBUG::2014-10-29 11:02:00,894::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134871::DEBUG::2014-10-29 11:02:00,894::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134871::DEBUG::2014-10-29 11:02:00,894::task::993::Storage.TaskManager.Task::(_decref) Task=`43b74414-9f1f-4186-af2b-971d7b7c1ac2`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:01,724::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:01,727::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134872::DEBUG::2014-10-29 11:02:01,730::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:01,733::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:01,735::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134873::DEBUG::2014-10-29 11:02:01,738::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134873::DEBUG::2014-10-29 11:02:01,740::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:02:01,880::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53659 >Detector thread::DEBUG::2014-10-29 11:02:01,880::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53659 >Detector thread::DEBUG::2014-10-29 11:02:01,881::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53659 >Detector thread::DEBUG::2014-10-29 11:02:01,881::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53659) >Thread-134874::DEBUG::2014-10-29 11:02:01,921::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134874::DEBUG::2014-10-29 11:02:01,921::task::595::Storage.TaskManager.Task::(_updateState) Task=`bead062b-785d-464e-99ad-c6ae6c91d1bd`::moving from state init -> state preparing >Thread-134874::INFO::2014-10-29 11:02:01,922::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-134874::DEBUG::2014-10-29 11:02:01,925::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:02:01,925::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:01,926::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:01,926::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:01,926::__init__::232::IOProcess::(_processLogs) (198775) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:01,928::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198775) Queuing response >Thread-134874::DEBUG::2014-10-29 11:02:01,929::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-134874::DEBUG::2014-10-29 11:02:01,929::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-134874::INFO::2014-10-29 11:02:01,929::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-134874::DEBUG::2014-10-29 11:02:01,930::task::1191::Storage.TaskManager.Task::(prepare) Task=`bead062b-785d-464e-99ad-c6ae6c91d1bd`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-134874::DEBUG::2014-10-29 11:02:01,930::task::595::Storage.TaskManager.Task::(_updateState) Task=`bead062b-785d-464e-99ad-c6ae6c91d1bd`::moving from state preparing -> state finished >Thread-134874::DEBUG::2014-10-29 11:02:01,930::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134874::DEBUG::2014-10-29 11:02:01,930::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134874::DEBUG::2014-10-29 11:02:01,931::task::993::Storage.TaskManager.Task::(_decref) Task=`bead062b-785d-464e-99ad-c6ae6c91d1bd`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:02:01,974::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53660 >Detector thread::DEBUG::2014-10-29 11:02:01,974::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53660 >Detector thread::DEBUG::2014-10-29 11:02:01,975::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53660 >Detector thread::DEBUG::2014-10-29 11:02:01,975::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53660) >Thread-134875::DEBUG::2014-10-29 11:02:02,014::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134875::DEBUG::2014-10-29 11:02:02,015::task::595::Storage.TaskManager.Task::(_updateState) Task=`b668a2ad-fc77-411a-90a6-e397fbb97738`::moving from state init -> state preparing >Thread-134875::INFO::2014-10-29 11:02:02,015::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-134875::DEBUG::2014-10-29 11:02:02,015::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-134875::DEBUG::2014-10-29 11:02:02,016::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-134875::DEBUG::2014-10-29 11:02:02,016::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-134875::DEBUG::2014-10-29 11:02:02,016::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-134875::DEBUG::2014-10-29 11:02:02,016::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-134875::DEBUG::2014-10-29 11:02:02,017::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-134875::DEBUG::2014-10-29 11:02:02,111::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-134875::DEBUG::2014-10-29 11:02:02,112::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-134875::DEBUG::2014-10-29 11:02:02,279::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-134875::DEBUG::2014-10-29 11:02:02,280::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134875::DEBUG::2014-10-29 11:02:02,281::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134875::DEBUG::2014-10-29 11:02:02,281::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134875::DEBUG::2014-10-29 11:02:02,282::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134875::DEBUG::2014-10-29 11:02:02,282::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134875::DEBUG::2014-10-29 11:02:02,282::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134875::DEBUG::2014-10-29 11:02:02,283::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:02:02,288::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:02,292::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:02,292::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:02,292::__init__::232::IOProcess::(_processLogs) (198776) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:02,293::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198776) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:02,295::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:02,295::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:02,295::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:02,296::__init__::232::IOProcess::(_processLogs) (198777) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:02,296::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198777) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:02,298::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:02,299::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:02,301::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:02,303::__init__::232::IOProcess::(_processLogs) (198778) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:02,307::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198778) Queuing response >Thread-134875::DEBUG::2014-10-29 11:02:02,310::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:02:02,311::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:02,313::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:02,313::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:02,313::__init__::232::IOProcess::(_processLogs) (198779) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:02,314::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198779) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:02,315::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:02,315::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:02,316::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:02,316::__init__::232::IOProcess::(_processLogs) (198780) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:02:02,317::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198780) Queuing response >Thread-134875::DEBUG::2014-10-29 11:02:02,318::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:02:02,319::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:02,319::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:02,320::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:02,320::__init__::232::IOProcess::(_processLogs) (198781) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:02:02,320::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198781) Queuing response >Thread-134875::DEBUG::2014-10-29 11:02:02,321::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:02:02,322::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:02,323::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:02,323::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:02,323::__init__::232::IOProcess::(_processLogs) (198782) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:02,324::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198782) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:02,325::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:02,325::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:02,326::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:02,326::__init__::232::IOProcess::(_processLogs) (198783) Got request for method 'glob' >Thread-134875::DEBUG::2014-10-29 11:02:02,326::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:02:02,327::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198783) Queuing response >Thread-134875::INFO::2014-10-29 11:02:02,328::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-134875::INFO::2014-10-29 11:02:02,329::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-134875::INFO::2014-10-29 11:02:02,329::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:02:02,330::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:02,330::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:02,330::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:02,331::__init__::232::IOProcess::(_processLogs) (198784) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:02:02,331::__init__::232::IOProcess::(_processLogs) (198784) Queuing response >Thread-134875::DEBUG::2014-10-29 11:02:02,331::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-134875::DEBUG::2014-10-29 11:02:02,333::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`34d7c91f-f08b-4715-8e95-a184da5a26f7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-134875::DEBUG::2014-10-29 11:02:02,333::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-134875::DEBUG::2014-10-29 11:02:02,334::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-134875::DEBUG::2014-10-29 11:02:02,334::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`34d7c91f-f08b-4715-8e95-a184da5a26f7`::Granted request >Thread-134875::DEBUG::2014-10-29 11:02:02,335::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b668a2ad-fc77-411a-90a6-e397fbb97738`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-134875::DEBUG::2014-10-29 11:02:02,335::task::993::Storage.TaskManager.Task::(_decref) Task=`b668a2ad-fc77-411a-90a6-e397fbb97738`::ref 1 aborting False >Thread-134875::INFO::2014-10-29 11:02:02,338::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-134875::DEBUG::2014-10-29 11:02:02,338::task::1191::Storage.TaskManager.Task::(prepare) Task=`b668a2ad-fc77-411a-90a6-e397fbb97738`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-134875::DEBUG::2014-10-29 11:02:02,338::task::595::Storage.TaskManager.Task::(_updateState) Task=`b668a2ad-fc77-411a-90a6-e397fbb97738`::moving from state preparing -> state finished >Thread-134875::DEBUG::2014-10-29 11:02:02,339::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-134875::DEBUG::2014-10-29 11:02:02,339::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134875::DEBUG::2014-10-29 11:02:02,339::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-134875::DEBUG::2014-10-29 11:02:02,340::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-134875::DEBUG::2014-10-29 11:02:02,340::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-134875::DEBUG::2014-10-29 11:02:02,340::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-134875::DEBUG::2014-10-29 11:02:02,340::task::993::Storage.TaskManager.Task::(_decref) Task=`b668a2ad-fc77-411a-90a6-e397fbb97738`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:02:02,363::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53661 >Detector thread::DEBUG::2014-10-29 11:02:02,363::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53661 >Detector thread::DEBUG::2014-10-29 11:02:02,363::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53661 >Detector thread::DEBUG::2014-10-29 11:02:02,364::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53661) >Thread-134880::DEBUG::2014-10-29 11:02:02,403::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134880::DEBUG::2014-10-29 11:02:02,404::task::595::Storage.TaskManager.Task::(_updateState) Task=`71192493-740e-4d2b-9a70-735dfd2690d5`::moving from state init -> state preparing >Thread-134880::INFO::2014-10-29 11:02:02,404::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134880::INFO::2014-10-29 11:02:02,405::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523374', 'lastCheck': '3.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504742', 'lastCheck': '3.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507437', 'lastCheck': '6.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000531037', 'lastCheck': '6.4', 'valid': True}} >Thread-134880::DEBUG::2014-10-29 11:02:02,406::task::1191::Storage.TaskManager.Task::(prepare) Task=`71192493-740e-4d2b-9a70-735dfd2690d5`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523374', 'lastCheck': '3.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504742', 'lastCheck': '3.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507437', 'lastCheck': '6.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000531037', 'lastCheck': '6.4', 'valid': True}} >Thread-134880::DEBUG::2014-10-29 11:02:02,406::task::595::Storage.TaskManager.Task::(_updateState) Task=`71192493-740e-4d2b-9a70-735dfd2690d5`::moving from state preparing -> state finished >Thread-134880::DEBUG::2014-10-29 11:02:02,406::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134880::DEBUG::2014-10-29 11:02:02,407::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134880::DEBUG::2014-10-29 11:02:02,407::task::993::Storage.TaskManager.Task::(_decref) Task=`71192493-740e-4d2b-9a70-735dfd2690d5`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-10-29 11:02:02,787::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:02,990::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:02,991::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:02,995::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:04,768::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:04,771::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134881::DEBUG::2014-10-29 11:02:04,775::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:04,778::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:04,779::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134882::DEBUG::2014-10-29 11:02:04,783::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134882::DEBUG::2014-10-29 11:02:04,785::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:02:06,006::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:06,006::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:06,008::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:06,009::__init__::232::IOProcess::(_processLogs) (198785) Got request for method 'statvfs' >Thread-10269::DEBUG::2014-10-29 11:02:06,009::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:02:06,010::__init__::232::IOProcess::(_processLogs) (198785) Queuing response >Thread-10269::DEBUG::2014-10-29 11:02:06,029::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000492383 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:02:06,031::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:06,031::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:06,031::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:06,032::__init__::232::IOProcess::(_processLogs) (198786) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:06,033::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198786) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:06,067::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:06,067::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:06,067::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:06,068::__init__::232::IOProcess::(_processLogs) (198787) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:06,069::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198787) Queuing response >Thread-179::DEBUG::2014-10-29 11:02:06,070::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:02:06,086::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000554173 s, 671 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:02:06,088::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:06,088::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:06,090::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:06,091::__init__::232::IOProcess::(_processLogs) (198788) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:06,091::__init__::232::IOProcess::(_processLogs) (198788) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:07,801::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:07,804::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134883::DEBUG::2014-10-29 11:02:07,808::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:07,811::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:07,812::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134884::DEBUG::2014-10-29 11:02:07,815::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134884::DEBUG::2014-10-29 11:02:07,818::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:08,002::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:08,003::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:08,004::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:02:08,288::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53662 >Detector thread::DEBUG::2014-10-29 11:02:08,288::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53662 >Detector thread::DEBUG::2014-10-29 11:02:08,289::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53662 >Detector thread::DEBUG::2014-10-29 11:02:08,289::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53662) >Thread-134885::DEBUG::2014-10-29 11:02:08,328::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-134885::DEBUG::2014-10-29 11:02:08,330::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-134885::DEBUG::2014-10-29 11:02:08,349::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-134885::DEBUG::2014-10-29 11:02:08,397::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '101', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '1', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-17::DEBUG::2014-10-29 11:02:08,667::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:08,667::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:08,668::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:08,668::__init__::232::IOProcess::(_processLogs) (198789) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:08,669::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198789) Queuing response >Thread-178::DEBUG::2014-10-29 11:02:08,670::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:02:08,688::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000539855 s, 941 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:02:08,690::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:08,691::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:08,693::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:08,693::__init__::232::IOProcess::(_processLogs) (198790) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:08,694::__init__::232::IOProcess::(_processLogs) (198790) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:08,694::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:08,695::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:08,695::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:08,696::__init__::232::IOProcess::(_processLogs) (198791) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:08,696::__init__::232::IOProcess::(_processLogs) (198791) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:08,697::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:08,697::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:08,697::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:08,698::__init__::232::IOProcess::(_processLogs) (198792) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:08,698::__init__::232::IOProcess::(_processLogs) (198792) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:08,699::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:08,700::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:08,700::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:08,700::__init__::232::IOProcess::(_processLogs) (198793) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:08,700::__init__::232::IOProcess::(_processLogs) (198793) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:08,822::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:08,824::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:08,825::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:08,826::__init__::232::IOProcess::(_processLogs) (198794) Got request for method 'statvfs' >Thread-33::DEBUG::2014-10-29 11:02:08,826::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:02:08,827::__init__::232::IOProcess::(_processLogs) (198794) Queuing response >Thread-33::DEBUG::2014-10-29 11:02:08,845::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000448697 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:02:08,847::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:08,847::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:08,849::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:08,850::__init__::232::IOProcess::(_processLogs) (198795) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:08,851::__init__::232::IOProcess::(_processLogs) (198795) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:08,851::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:08,851::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:08,852::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:08,852::__init__::232::IOProcess::(_processLogs) (198796) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:08,853::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198796) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:08,854::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:08,854::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:08,854::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:08,855::__init__::232::IOProcess::(_processLogs) (198797) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:08,855::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198797) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:08,857::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:08,857::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:08,857::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:08,857::__init__::232::IOProcess::(_processLogs) (198798) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:08,858::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198798) Queuing response >Detector thread::DEBUG::2014-10-29 11:02:09,894::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53663 >Detector thread::DEBUG::2014-10-29 11:02:09,895::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53663 >Detector thread::DEBUG::2014-10-29 11:02:09,895::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53663 >Detector thread::DEBUG::2014-10-29 11:02:09,896::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53663) >Thread-134886::DEBUG::2014-10-29 11:02:09,934::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-134886::DEBUG::2014-10-29 11:02:09,936::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134886::DEBUG::2014-10-29 11:02:09,936::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.96', 'elapsedTime': '513162', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '16378362', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '71075', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '36539.27'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.88', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:10,833::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:10,836::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134887::DEBUG::2014-10-29 11:02:10,840::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc2ce627-4a7b-4d01-a1d8-a6c98dfc3f0c`::moving from state init -> state preparing >Thread-134887::INFO::2014-10-29 11:02:10,840::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134887::INFO::2014-10-29 11:02:10,841::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539855', 'lastCheck': '2.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000448697', 'lastCheck': '2.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000554173', 'lastCheck': '4.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492383', 'lastCheck': '4.8', 'valid': True}} >Thread-134887::DEBUG::2014-10-29 11:02:10,841::task::1191::Storage.TaskManager.Task::(prepare) Task=`cc2ce627-4a7b-4d01-a1d8-a6c98dfc3f0c`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539855', 'lastCheck': '2.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000448697', 'lastCheck': '2.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000554173', 'lastCheck': '4.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492383', 'lastCheck': '4.8', 'valid': True}} >Thread-134887::DEBUG::2014-10-29 11:02:10,841::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc2ce627-4a7b-4d01-a1d8-a6c98dfc3f0c`::moving from state preparing -> state finished >Thread-134887::DEBUG::2014-10-29 11:02:10,841::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134887::DEBUG::2014-10-29 11:02:10,842::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134887::DEBUG::2014-10-29 11:02:10,842::task::993::Storage.TaskManager.Task::(_decref) Task=`cc2ce627-4a7b-4d01-a1d8-a6c98dfc3f0c`::ref 0 aborting False >Thread-134887::DEBUG::2014-10-29 11:02:10,878::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:10,902::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:10,904::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134888::DEBUG::2014-10-29 11:02:10,907::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134888::DEBUG::2014-10-29 11:02:10,909::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:02:10,944::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53665 >Detector thread::DEBUG::2014-10-29 11:02:10,946::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53665 >Detector thread::DEBUG::2014-10-29 11:02:10,946::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53665 >Detector thread::DEBUG::2014-10-29 11:02:10,947::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53665) >Thread-134889::DEBUG::2014-10-29 11:02:10,987::task::595::Storage.TaskManager.Task::(_updateState) Task=`7b6cd3ba-8ce3-4d09-8126-71cf691d7703`::moving from state init -> state preparing >Thread-134889::INFO::2014-10-29 11:02:10,987::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134889::INFO::2014-10-29 11:02:10,988::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539855', 'lastCheck': '2.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000448697', 'lastCheck': '2.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000554173', 'lastCheck': '4.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492383', 'lastCheck': '5.0', 'valid': True}} >Thread-134889::DEBUG::2014-10-29 11:02:10,988::task::1191::Storage.TaskManager.Task::(prepare) Task=`7b6cd3ba-8ce3-4d09-8126-71cf691d7703`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539855', 'lastCheck': '2.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000448697', 'lastCheck': '2.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000554173', 'lastCheck': '4.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492383', 'lastCheck': '5.0', 'valid': True}} >Thread-134889::DEBUG::2014-10-29 11:02:10,989::task::595::Storage.TaskManager.Task::(_updateState) Task=`7b6cd3ba-8ce3-4d09-8126-71cf691d7703`::moving from state preparing -> state finished >Thread-134889::DEBUG::2014-10-29 11:02:10,989::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134889::DEBUG::2014-10-29 11:02:10,989::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134889::DEBUG::2014-10-29 11:02:10,989::task::993::Storage.TaskManager.Task::(_decref) Task=`7b6cd3ba-8ce3-4d09-8126-71cf691d7703`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:02:12,082::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:13,011::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:13,014::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:13,018::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:02:13,019::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53667 >Detector thread::DEBUG::2014-10-29 11:02:13,020::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53667 >Detector thread::DEBUG::2014-10-29 11:02:13,020::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53667 >Detector thread::DEBUG::2014-10-29 11:02:13,021::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53667) >Thread-134890::DEBUG::2014-10-29 11:02:13,060::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134890::DEBUG::2014-10-29 11:02:13,061::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e77b551-6078-4801-bd56-b1bd80a64460`::moving from state init -> state preparing >Thread-134890::INFO::2014-10-29 11:02:13,061::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-134890::DEBUG::2014-10-29 11:02:13,069::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:02:13,070::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:13,070::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:13,070::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:13,071::__init__::232::IOProcess::(_processLogs) (198799) Got request for method 'glob' >Thread-134890::DEBUG::2014-10-29 11:02:13,072::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:02:13,072::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198799) Queuing response >Thread-134890::DEBUG::2014-10-29 11:02:13,073::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-134890::INFO::2014-10-29 11:02:13,074::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-134890::DEBUG::2014-10-29 11:02:13,074::task::1191::Storage.TaskManager.Task::(prepare) Task=`8e77b551-6078-4801-bd56-b1bd80a64460`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-134890::DEBUG::2014-10-29 11:02:13,075::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e77b551-6078-4801-bd56-b1bd80a64460`::moving from state preparing -> state finished >Thread-134890::DEBUG::2014-10-29 11:02:13,075::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134890::DEBUG::2014-10-29 11:02:13,075::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134890::DEBUG::2014-10-29 11:02:13,075::task::993::Storage.TaskManager.Task::(_decref) Task=`8e77b551-6078-4801-bd56-b1bd80a64460`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:02:13,119::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53668 >Detector thread::DEBUG::2014-10-29 11:02:13,120::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53668 >Detector thread::DEBUG::2014-10-29 11:02:13,120::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53668 >Detector thread::DEBUG::2014-10-29 11:02:13,121::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53668) >Thread-134891::DEBUG::2014-10-29 11:02:13,160::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134891::DEBUG::2014-10-29 11:02:13,161::task::595::Storage.TaskManager.Task::(_updateState) Task=`10ec82be-0e31-4442-ae67-09d6da9ea71d`::moving from state init -> state preparing >Thread-134891::INFO::2014-10-29 11:02:13,161::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-134891::DEBUG::2014-10-29 11:02:13,161::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-134891::DEBUG::2014-10-29 11:02:13,162::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-134891::DEBUG::2014-10-29 11:02:13,162::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-134891::DEBUG::2014-10-29 11:02:13,162::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-134891::DEBUG::2014-10-29 11:02:13,162::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-134891::DEBUG::2014-10-29 11:02:13,163::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-134891::DEBUG::2014-10-29 11:02:13,258::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-134891::DEBUG::2014-10-29 11:02:13,259::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-134891::DEBUG::2014-10-29 11:02:13,437::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-134891::DEBUG::2014-10-29 11:02:13,438::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134891::DEBUG::2014-10-29 11:02:13,439::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134891::DEBUG::2014-10-29 11:02:13,439::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134891::DEBUG::2014-10-29 11:02:13,439::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134891::DEBUG::2014-10-29 11:02:13,440::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134891::DEBUG::2014-10-29 11:02:13,440::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134891::DEBUG::2014-10-29 11:02:13,440::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:02:13,448::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:13,451::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:13,451::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:13,451::__init__::232::IOProcess::(_processLogs) (198800) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:13,453::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198800) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:13,455::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:13,455::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:13,456::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:13,456::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:13,456::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:13,457::__init__::232::IOProcess::(_processLogs) (198801) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:13,457::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:13,459::__init__::232::IOProcess::(_processLogs) (198802) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:13,461::__init__::232::IOProcess::(_processLogs) (198801) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:13,463::__init__::232::IOProcess::(_processLogs) (198802) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:13,465::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:13,467::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:13,468::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-134891::DEBUG::2014-10-29 11:02:13,470::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:02:13,471::__init__::232::IOProcess::(_processLogs) (198803) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:13,472::__init__::232::IOProcess::(_processLogs) (198803) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:13,475::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:13,475::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:13,475::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:13,476::__init__::232::IOProcess::(_processLogs) (198804) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:02:13,477::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198804) Queuing response >Thread-134891::DEBUG::2014-10-29 11:02:13,477::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:02:13,479::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:13,479::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:13,480::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:13,480::__init__::232::IOProcess::(_processLogs) (198805) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:02:13,481::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198805) Queuing response >Thread-134891::DEBUG::2014-10-29 11:02:13,481::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:02:13,483::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:13,484::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:13,485::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:13,485::__init__::232::IOProcess::(_processLogs) (198806) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:13,485::__init__::232::IOProcess::(_processLogs) (198806) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:13,486::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:13,486::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:13,486::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:13,487::__init__::232::IOProcess::(_processLogs) (198807) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:13,487::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198807) Queuing response >Thread-134891::DEBUG::2014-10-29 11:02:13,487::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-134891::INFO::2014-10-29 11:02:13,489::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-134891::INFO::2014-10-29 11:02:13,489::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-134891::INFO::2014-10-29 11:02:13,489::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:02:13,490::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:13,490::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:13,491::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:13,491::__init__::232::IOProcess::(_processLogs) (198808) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:02:13,492::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198808) Queuing response >Thread-134891::DEBUG::2014-10-29 11:02:13,492::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-134891::DEBUG::2014-10-29 11:02:13,494::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`791c8050-cd3e-4607-b0a7-82bfb7831ff1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-134891::DEBUG::2014-10-29 11:02:13,495::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-134891::DEBUG::2014-10-29 11:02:13,495::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-134891::DEBUG::2014-10-29 11:02:13,495::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`791c8050-cd3e-4607-b0a7-82bfb7831ff1`::Granted request >Thread-134891::DEBUG::2014-10-29 11:02:13,496::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`10ec82be-0e31-4442-ae67-09d6da9ea71d`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-134891::DEBUG::2014-10-29 11:02:13,496::task::993::Storage.TaskManager.Task::(_decref) Task=`10ec82be-0e31-4442-ae67-09d6da9ea71d`::ref 1 aborting False >Thread-134891::INFO::2014-10-29 11:02:13,499::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-134891::DEBUG::2014-10-29 11:02:13,499::task::1191::Storage.TaskManager.Task::(prepare) Task=`10ec82be-0e31-4442-ae67-09d6da9ea71d`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-134891::DEBUG::2014-10-29 11:02:13,500::task::595::Storage.TaskManager.Task::(_updateState) Task=`10ec82be-0e31-4442-ae67-09d6da9ea71d`::moving from state preparing -> state finished >Thread-134891::DEBUG::2014-10-29 11:02:13,500::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-134891::DEBUG::2014-10-29 11:02:13,500::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134891::DEBUG::2014-10-29 11:02:13,501::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-134891::DEBUG::2014-10-29 11:02:13,501::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-134891::DEBUG::2014-10-29 11:02:13,501::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-134891::DEBUG::2014-10-29 11:02:13,501::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-134891::DEBUG::2014-10-29 11:02:13,502::task::993::Storage.TaskManager.Task::(_decref) Task=`10ec82be-0e31-4442-ae67-09d6da9ea71d`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:02:13,524::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53669 >Detector thread::DEBUG::2014-10-29 11:02:13,525::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53669 >Detector thread::DEBUG::2014-10-29 11:02:13,525::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53669 >Detector thread::DEBUG::2014-10-29 11:02:13,526::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53669) >Thread-134896::DEBUG::2014-10-29 11:02:13,564::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134896::DEBUG::2014-10-29 11:02:13,564::task::595::Storage.TaskManager.Task::(_updateState) Task=`c89de24d-a3a9-4e9a-8526-94435648f7b4`::moving from state init -> state preparing >Thread-134896::INFO::2014-10-29 11:02:13,565::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134896::INFO::2014-10-29 11:02:13,566::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539855', 'lastCheck': '4.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000448697', 'lastCheck': '4.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000554173', 'lastCheck': '7.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492383', 'lastCheck': '7.5', 'valid': True}} >Thread-134896::DEBUG::2014-10-29 11:02:13,566::task::1191::Storage.TaskManager.Task::(prepare) Task=`c89de24d-a3a9-4e9a-8526-94435648f7b4`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539855', 'lastCheck': '4.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000448697', 'lastCheck': '4.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000554173', 'lastCheck': '7.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492383', 'lastCheck': '7.5', 'valid': True}} >Thread-134896::DEBUG::2014-10-29 11:02:13,566::task::595::Storage.TaskManager.Task::(_updateState) Task=`c89de24d-a3a9-4e9a-8526-94435648f7b4`::moving from state preparing -> state finished >Thread-134896::DEBUG::2014-10-29 11:02:13,566::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134896::DEBUG::2014-10-29 11:02:13,567::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134896::DEBUG::2014-10-29 11:02:13,567::task::993::Storage.TaskManager.Task::(_decref) Task=`c89de24d-a3a9-4e9a-8526-94435648f7b4`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:13,994::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:13,996::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134897::DEBUG::2014-10-29 11:02:14,000::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:14,002::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:14,004::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134898::DEBUG::2014-10-29 11:02:14,007::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134898::DEBUG::2014-10-29 11:02:14,009::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:02:16,036::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:16,036::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:16,037::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:16,037::__init__::232::IOProcess::(_processLogs) (198809) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:16,037::__init__::232::IOProcess::(_processLogs) (198809) Queuing response >Thread-10269::DEBUG::2014-10-29 11:02:16,039::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:02:16,063::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000705652 s, 711 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:02:16,067::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:16,068::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:16,069::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:16,076::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198810) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:16,078::__init__::232::IOProcess::(_processLogs) (198810) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:16,094::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:16,096::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:16,097::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:16,099::__init__::232::IOProcess::(_processLogs) (198811) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:16,104::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198811) Queuing response >Thread-179::DEBUG::2014-10-29 11:02:16,105::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:02:16,129::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.0047159 s, 78.9 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:02:16,134::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:16,135::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:16,136::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:16,137::__init__::232::IOProcess::(_processLogs) (198812) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:16,143::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198812) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:17,027::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:17,033::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134899::DEBUG::2014-10-29 11:02:17,041::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:17,045::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:17,047::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134900::DEBUG::2014-10-29 11:02:17,051::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134900::DEBUG::2014-10-29 11:02:17,053::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:18,024::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:18,026::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:18,029::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:02:18,441::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53670 >Detector thread::DEBUG::2014-10-29 11:02:18,442::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53670 >Detector thread::DEBUG::2014-10-29 11:02:18,442::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53670 >Detector thread::DEBUG::2014-10-29 11:02:18,443::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53670) >Thread-134901::DEBUG::2014-10-29 11:02:18,481::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-134901::DEBUG::2014-10-29 11:02:18,483::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-134901::DEBUG::2014-10-29 11:02:18,501::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-134901::DEBUG::2014-10-29 11:02:18,547::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '86', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '86', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-17::DEBUG::2014-10-29 11:02:18,703::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:18,703::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:18,704::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:18,704::__init__::232::IOProcess::(_processLogs) (198813) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:18,705::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198813) Queuing response >Thread-178::DEBUG::2014-10-29 11:02:18,707::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:02:18,724::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000436348 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:02:18,726::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:18,726::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:18,726::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:18,727::__init__::232::IOProcess::(_processLogs) (198814) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:18,727::__init__::232::IOProcess::(_processLogs) (198814) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:18,729::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:18,730::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:18,731::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:18,731::__init__::232::IOProcess::(_processLogs) (198815) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:18,731::__init__::232::IOProcess::(_processLogs) (198815) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:18,732::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:18,733::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:18,733::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:18,734::__init__::232::IOProcess::(_processLogs) (198816) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:18,734::__init__::232::IOProcess::(_processLogs) (198816) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:18,734::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:18,735::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:18,736::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:18,737::__init__::232::IOProcess::(_processLogs) (198817) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:18,738::__init__::232::IOProcess::(_processLogs) (198817) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:18,860::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:18,860::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:18,862::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-33::DEBUG::2014-10-29 11:02:18,863::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:02:18,863::__init__::232::IOProcess::(_processLogs) (198818) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:18,882::__init__::232::IOProcess::(_processLogs) (198818) Queuing response >Thread-33::DEBUG::2014-10-29 11:02:18,884::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000488801 s, 996 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:02:18,886::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:18,886::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:18,886::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:18,887::__init__::232::IOProcess::(_processLogs) (198819) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:18,888::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198819) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:18,890::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:18,891::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:18,891::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:18,892::__init__::232::IOProcess::(_processLogs) (198820) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:18,892::__init__::232::IOProcess::(_processLogs) (198820) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:18,892::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:18,893::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:18,894::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:18,894::__init__::232::IOProcess::(_processLogs) (198821) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:18,894::__init__::232::IOProcess::(_processLogs) (198821) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:18,895::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:18,896::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:18,896::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:18,897::__init__::232::IOProcess::(_processLogs) (198822) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:18,897::__init__::232::IOProcess::(_processLogs) (198822) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:20,067::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:20,071::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134902::DEBUG::2014-10-29 11:02:20,075::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:20,077::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Detector thread::DEBUG::2014-10-29 11:02:20,083::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53671 >Detector thread::DEBUG::2014-10-29 11:02:20,083::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53671 >Detector thread::DEBUG::2014-10-29 11:02:20,085::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53671 >JsonRpcServer::DEBUG::2014-10-29 11:02:20,088::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Detector thread::DEBUG::2014-10-29 11:02:20,089::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53671) >Thread-134903::DEBUG::2014-10-29 11:02:20,097::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134903::DEBUG::2014-10-29 11:02:20,099::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-134904::DEBUG::2014-10-29 11:02:20,123::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-134904::DEBUG::2014-10-29 11:02:20,124::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134904::DEBUG::2014-10-29 11:02:20,124::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.16', 'elapsedTime': '513172', 'displayType': 'vnc', 'cpuSys': '0.87', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '16378362', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '71075', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '36539.27'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.04', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:02:21,038::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53673 >Detector thread::DEBUG::2014-10-29 11:02:21,039::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53673 >Detector thread::DEBUG::2014-10-29 11:02:21,039::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53673 >Detector thread::DEBUG::2014-10-29 11:02:21,040::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53673) >Thread-134905::DEBUG::2014-10-29 11:02:21,080::task::595::Storage.TaskManager.Task::(_updateState) Task=`a09fc5b0-51e5-4a65-aa8f-dc55ba4acecc`::moving from state init -> state preparing >Thread-134905::INFO::2014-10-29 11:02:21,080::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134905::INFO::2014-10-29 11:02:21,081::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436348', 'lastCheck': '2.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488801', 'lastCheck': '2.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0047159', 'lastCheck': '4.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000705652', 'lastCheck': '5.0', 'valid': True}} >Thread-134905::DEBUG::2014-10-29 11:02:21,081::task::1191::Storage.TaskManager.Task::(prepare) Task=`a09fc5b0-51e5-4a65-aa8f-dc55ba4acecc`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436348', 'lastCheck': '2.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488801', 'lastCheck': '2.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0047159', 'lastCheck': '4.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000705652', 'lastCheck': '5.0', 'valid': True}} >Thread-134905::DEBUG::2014-10-29 11:02:21,082::task::595::Storage.TaskManager.Task::(_updateState) Task=`a09fc5b0-51e5-4a65-aa8f-dc55ba4acecc`::moving from state preparing -> state finished >Thread-134905::DEBUG::2014-10-29 11:02:21,082::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134905::DEBUG::2014-10-29 11:02:21,082::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134905::DEBUG::2014-10-29 11:02:21,082::task::993::Storage.TaskManager.Task::(_decref) Task=`a09fc5b0-51e5-4a65-aa8f-dc55ba4acecc`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:23,035::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:23,036::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:23,037::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:23,114::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:23,117::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134906::DEBUG::2014-10-29 11:02:23,121::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:23,123::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:23,125::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134907::DEBUG::2014-10-29 11:02:23,128::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134907::DEBUG::2014-10-29 11:02:23,131::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:02:24,164::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53675 >Detector thread::DEBUG::2014-10-29 11:02:24,164::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53675 >Detector thread::DEBUG::2014-10-29 11:02:24,165::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53675 >Detector thread::DEBUG::2014-10-29 11:02:24,165::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53675) >Thread-134908::DEBUG::2014-10-29 11:02:24,205::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134908::DEBUG::2014-10-29 11:02:24,206::task::595::Storage.TaskManager.Task::(_updateState) Task=`f39a6133-f63e-4cc2-ab4c-be68357897de`::moving from state init -> state preparing >Thread-134908::INFO::2014-10-29 11:02:24,206::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-134908::DEBUG::2014-10-29 11:02:24,209::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:02:24,210::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:24,210::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:24,210::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:24,210::__init__::232::IOProcess::(_processLogs) (198823) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:24,212::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198823) Queuing response >Thread-134908::DEBUG::2014-10-29 11:02:24,213::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-134908::DEBUG::2014-10-29 11:02:24,214::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-134908::INFO::2014-10-29 11:02:24,214::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-134908::DEBUG::2014-10-29 11:02:24,214::task::1191::Storage.TaskManager.Task::(prepare) Task=`f39a6133-f63e-4cc2-ab4c-be68357897de`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-134908::DEBUG::2014-10-29 11:02:24,214::task::595::Storage.TaskManager.Task::(_updateState) Task=`f39a6133-f63e-4cc2-ab4c-be68357897de`::moving from state preparing -> state finished >Thread-134908::DEBUG::2014-10-29 11:02:24,215::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134908::DEBUG::2014-10-29 11:02:24,215::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134908::DEBUG::2014-10-29 11:02:24,215::task::993::Storage.TaskManager.Task::(_decref) Task=`f39a6133-f63e-4cc2-ab4c-be68357897de`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:02:24,259::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53676 >Detector thread::DEBUG::2014-10-29 11:02:24,260::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53676 >Detector thread::DEBUG::2014-10-29 11:02:24,260::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53676 >Detector thread::DEBUG::2014-10-29 11:02:24,260::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53676) >Thread-134909::DEBUG::2014-10-29 11:02:24,299::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134909::DEBUG::2014-10-29 11:02:24,299::task::595::Storage.TaskManager.Task::(_updateState) Task=`2246b7d7-2d0b-4fd1-8e59-7365268b787c`::moving from state init -> state preparing >Thread-134909::INFO::2014-10-29 11:02:24,300::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-134909::DEBUG::2014-10-29 11:02:24,300::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-134909::DEBUG::2014-10-29 11:02:24,300::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-134909::DEBUG::2014-10-29 11:02:24,301::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-134909::DEBUG::2014-10-29 11:02:24,301::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-134909::DEBUG::2014-10-29 11:02:24,301::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-134909::DEBUG::2014-10-29 11:02:24,302::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-134909::DEBUG::2014-10-29 11:02:24,391::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-134909::DEBUG::2014-10-29 11:02:24,392::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-134909::DEBUG::2014-10-29 11:02:24,562::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-134909::DEBUG::2014-10-29 11:02:24,563::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134909::DEBUG::2014-10-29 11:02:24,563::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134909::DEBUG::2014-10-29 11:02:24,564::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134909::DEBUG::2014-10-29 11:02:24,564::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134909::DEBUG::2014-10-29 11:02:24,564::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134909::DEBUG::2014-10-29 11:02:24,565::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134909::DEBUG::2014-10-29 11:02:24,565::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:02:24,571::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:24,573::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:24,573::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:24,573::__init__::232::IOProcess::(_processLogs) (198824) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:24,575::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198824) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:24,580::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:24,582::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:24,584::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:24,585::__init__::232::IOProcess::(_processLogs) (198825) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:24,587::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:24,589::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:24,591::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-134909::DEBUG::2014-10-29 11:02:24,592::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:02:24,593::__init__::232::IOProcess::(_processLogs) (198826) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:24,594::__init__::232::IOProcess::(_processLogs) (198825) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:24,594::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:24,594::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:24,595::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:24,595::__init__::232::IOProcess::(_processLogs) (198827) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:24,595::__init__::232::IOProcess::(_processLogs) (198826) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:24,595::__init__::232::IOProcess::(_processLogs) (198827) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:24,597::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:24,597::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:24,598::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:24,598::__init__::232::IOProcess::(_processLogs) (198828) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:02:24,599::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198828) Queuing response >Thread-134909::DEBUG::2014-10-29 11:02:24,600::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:02:24,601::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:24,601::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:24,601::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:24,602::__init__::232::IOProcess::(_processLogs) (198829) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:02:24,602::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198829) Queuing response >Thread-134909::DEBUG::2014-10-29 11:02:24,603::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:02:24,605::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:24,606::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:24,606::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:24,607::__init__::232::IOProcess::(_processLogs) (198830) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:24,607::__init__::232::IOProcess::(_processLogs) (198830) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:24,607::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:24,608::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:24,608::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:24,608::__init__::232::IOProcess::(_processLogs) (198831) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:24,609::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198831) Queuing response >Thread-134909::DEBUG::2014-10-29 11:02:24,609::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-134909::INFO::2014-10-29 11:02:24,610::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-134909::INFO::2014-10-29 11:02:24,610::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-134909::INFO::2014-10-29 11:02:24,611::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:02:24,612::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:24,612::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:24,612::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:24,612::__init__::232::IOProcess::(_processLogs) (198832) Got request for method 'readfile' >Thread-134909::DEBUG::2014-10-29 11:02:24,613::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:02:24,613::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198832) Queuing response >Thread-134909::DEBUG::2014-10-29 11:02:24,616::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`7264b686-6fab-45ee-9030-fb1bead385e6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-134909::DEBUG::2014-10-29 11:02:24,616::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-134909::DEBUG::2014-10-29 11:02:24,617::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-134909::DEBUG::2014-10-29 11:02:24,617::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`7264b686-6fab-45ee-9030-fb1bead385e6`::Granted request >Thread-134909::DEBUG::2014-10-29 11:02:24,618::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2246b7d7-2d0b-4fd1-8e59-7365268b787c`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-134909::DEBUG::2014-10-29 11:02:24,618::task::993::Storage.TaskManager.Task::(_decref) Task=`2246b7d7-2d0b-4fd1-8e59-7365268b787c`::ref 1 aborting False >Thread-134909::INFO::2014-10-29 11:02:24,621::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-134909::DEBUG::2014-10-29 11:02:24,621::task::1191::Storage.TaskManager.Task::(prepare) Task=`2246b7d7-2d0b-4fd1-8e59-7365268b787c`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-134909::DEBUG::2014-10-29 11:02:24,621::task::595::Storage.TaskManager.Task::(_updateState) Task=`2246b7d7-2d0b-4fd1-8e59-7365268b787c`::moving from state preparing -> state finished >Thread-134909::DEBUG::2014-10-29 11:02:24,621::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-134909::DEBUG::2014-10-29 11:02:24,622::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134909::DEBUG::2014-10-29 11:02:24,622::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-134909::DEBUG::2014-10-29 11:02:24,622::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-134909::DEBUG::2014-10-29 11:02:24,623::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-134909::DEBUG::2014-10-29 11:02:24,623::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-134909::DEBUG::2014-10-29 11:02:24,623::task::993::Storage.TaskManager.Task::(_decref) Task=`2246b7d7-2d0b-4fd1-8e59-7365268b787c`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:02:24,645::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53677 >Detector thread::DEBUG::2014-10-29 11:02:24,646::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53677 >Detector thread::DEBUG::2014-10-29 11:02:24,646::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53677 >Detector thread::DEBUG::2014-10-29 11:02:24,647::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53677) >Thread-134914::DEBUG::2014-10-29 11:02:24,686::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134914::DEBUG::2014-10-29 11:02:24,686::task::595::Storage.TaskManager.Task::(_updateState) Task=`00d41c46-8931-4e8f-a085-c79c93af94d4`::moving from state init -> state preparing >Thread-134914::INFO::2014-10-29 11:02:24,687::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134914::INFO::2014-10-29 11:02:24,687::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436348', 'lastCheck': '6.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488801', 'lastCheck': '5.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0047159', 'lastCheck': '8.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000705652', 'lastCheck': '8.6', 'valid': True}} >Thread-134914::DEBUG::2014-10-29 11:02:24,688::task::1191::Storage.TaskManager.Task::(prepare) Task=`00d41c46-8931-4e8f-a085-c79c93af94d4`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436348', 'lastCheck': '6.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488801', 'lastCheck': '5.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0047159', 'lastCheck': '8.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000705652', 'lastCheck': '8.6', 'valid': True}} >Thread-134914::DEBUG::2014-10-29 11:02:24,688::task::595::Storage.TaskManager.Task::(_updateState) Task=`00d41c46-8931-4e8f-a085-c79c93af94d4`::moving from state preparing -> state finished >Thread-134914::DEBUG::2014-10-29 11:02:24,688::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134914::DEBUG::2014-10-29 11:02:24,688::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134914::DEBUG::2014-10-29 11:02:24,689::task::993::Storage.TaskManager.Task::(_decref) Task=`00d41c46-8931-4e8f-a085-c79c93af94d4`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:02:26,078::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:26,079::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:26,079::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:26,079::__init__::232::IOProcess::(_processLogs) (198833) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:26,081::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198833) Queuing response >Thread-10269::DEBUG::2014-10-29 11:02:26,082::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:02:26,099::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000551432 s, 910 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:02:26,101::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:26,101::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:26,102::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:26,102::__init__::232::IOProcess::(_processLogs) (198834) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:26,104::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198834) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:26,149::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:26,154::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:26,156::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-17::DEBUG::2014-10-29 11:02:26,156::__init__::232::IOProcess::(_processLogs) Extracting request information... >JsonRpcServer::DEBUG::2014-10-29 11:02:26,162::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:02:26,167::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198835) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:26,170::__init__::232::IOProcess::(_processLogs) (198835) Queuing response >Thread-179::DEBUG::2014-10-29 11:02:26,170::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-134915::DEBUG::2014-10-29 11:02:26,193::task::595::Storage.TaskManager.Task::(_updateState) Task=`78b68ff8-4cff-4a4f-b657-c6d04d3c2fe9`::moving from state init -> state preparing >Thread-179::DEBUG::2014-10-29 11:02:26,194::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000506186 s, 735 kB/s\n'; <rc> = 0 >Thread-134915::INFO::2014-10-29 11:02:26,196::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-17::DEBUG::2014-10-29 11:02:26,200::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-134915::INFO::2014-10-29 11:02:26,202::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436348', 'lastCheck': '7.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488801', 'lastCheck': '7.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0047159', 'lastCheck': '10.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000551432', 'lastCheck': '0.1', 'valid': True}} >Thread-134915::DEBUG::2014-10-29 11:02:26,204::task::1191::Storage.TaskManager.Task::(prepare) Task=`78b68ff8-4cff-4a4f-b657-c6d04d3c2fe9`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436348', 'lastCheck': '7.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488801', 'lastCheck': '7.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0047159', 'lastCheck': '10.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000551432', 'lastCheck': '0.1', 'valid': True}} >Thread-17::DEBUG::2014-10-29 11:02:26,207::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-134915::DEBUG::2014-10-29 11:02:26,207::task::595::Storage.TaskManager.Task::(_updateState) Task=`78b68ff8-4cff-4a4f-b657-c6d04d3c2fe9`::moving from state preparing -> state finished >Thread-17::DEBUG::2014-10-29 11:02:26,209::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-134915::DEBUG::2014-10-29 11:02:26,209::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134915::DEBUG::2014-10-29 11:02:26,212::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17::DEBUG::2014-10-29 11:02:26,212::__init__::232::IOProcess::(_processLogs) (198836) Got request for method 'statvfs' >Thread-134915::DEBUG::2014-10-29 11:02:26,214::task::993::Storage.TaskManager.Task::(_decref) Task=`78b68ff8-4cff-4a4f-b657-c6d04d3c2fe9`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:02:26,214::__init__::232::IOProcess::(_processLogs) (198836) Queuing response >Thread-134915::DEBUG::2014-10-29 11:02:26,243::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:26,269::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:26,271::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134916::DEBUG::2014-10-29 11:02:26,275::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134916::DEBUG::2014-10-29 11:02:26,277::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:02:27,118::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:28,045::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:28,047::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:28,050::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:02:28,597::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53678 >Detector thread::DEBUG::2014-10-29 11:02:28,597::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53678 >Detector thread::DEBUG::2014-10-29 11:02:28,598::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53678 >Detector thread::DEBUG::2014-10-29 11:02:28,598::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53678) >Thread-134917::DEBUG::2014-10-29 11:02:28,637::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-134917::DEBUG::2014-10-29 11:02:28,640::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-134917::DEBUG::2014-10-29 11:02:28,659::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-134917::DEBUG::2014-10-29 11:02:28,706::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '70', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '70', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-17::DEBUG::2014-10-29 11:02:28,739::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:28,739::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:28,740::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-178::DEBUG::2014-10-29 11:02:28,742::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:02:28,742::__init__::232::IOProcess::(_processLogs) (198837) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:28,759::__init__::232::IOProcess::(_processLogs) (198837) Queuing response >Thread-178::DEBUG::2014-10-29 11:02:28,760::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000533326 s, 953 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:02:28,762::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:28,762::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:28,762::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:28,763::__init__::232::IOProcess::(_processLogs) (198838) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:28,764::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198838) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:28,766::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:28,767::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:28,767::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:28,768::__init__::232::IOProcess::(_processLogs) (198839) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:28,768::__init__::232::IOProcess::(_processLogs) (198839) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:28,768::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:28,769::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:28,770::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:28,770::__init__::232::IOProcess::(_processLogs) (198840) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:28,770::__init__::232::IOProcess::(_processLogs) (198840) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:28,771::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:28,772::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:28,773::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:28,774::__init__::232::IOProcess::(_processLogs) (198841) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:28,774::__init__::232::IOProcess::(_processLogs) (198841) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:28,897::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:28,898::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:28,898::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:28,898::__init__::232::IOProcess::(_processLogs) (198842) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:28,899::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198842) Queuing response >Thread-33::DEBUG::2014-10-29 11:02:28,901::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:02:28,917::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000485816 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:02:28,919::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:28,920::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:28,920::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:28,920::__init__::232::IOProcess::(_processLogs) (198843) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:28,920::__init__::232::IOProcess::(_processLogs) (198843) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:28,922::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:28,923::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:28,924::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:28,924::__init__::232::IOProcess::(_processLogs) (198844) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:28,925::__init__::232::IOProcess::(_processLogs) (198844) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:28,925::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:28,926::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:28,927::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:28,927::__init__::232::IOProcess::(_processLogs) (198845) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:28,927::__init__::232::IOProcess::(_processLogs) (198845) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:28,928::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:28,928::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:28,929::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:28,930::__init__::232::IOProcess::(_processLogs) (198846) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:28,930::__init__::232::IOProcess::(_processLogs) (198846) Queuing response >Detector thread::DEBUG::2014-10-29 11:02:29,284::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53679 >Detector thread::DEBUG::2014-10-29 11:02:29,285::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53679 >Detector thread::DEBUG::2014-10-29 11:02:29,285::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53679 >Detector thread::DEBUG::2014-10-29 11:02:29,286::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53679) >Thread-134918::DEBUG::2014-10-29 11:02:29,324::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-134918::DEBUG::2014-10-29 11:02:29,325::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134918::DEBUG::2014-10-29 11:02:29,326::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.53', 'elapsedTime': '513181', 'displayType': 'vnc', 'cpuSys': '0.66', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '16378362', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '71075', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '36539.27'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.21', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:29,342::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:29,345::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134919::DEBUG::2014-10-29 11:02:29,348::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:29,351::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:29,353::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134920::DEBUG::2014-10-29 11:02:29,356::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134920::DEBUG::2014-10-29 11:02:29,358::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:02:31,152::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53681 >Detector thread::DEBUG::2014-10-29 11:02:31,152::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53681 >Detector thread::DEBUG::2014-10-29 11:02:31,153::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53681 >Detector thread::DEBUG::2014-10-29 11:02:31,153::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53681) >Thread-134921::DEBUG::2014-10-29 11:02:31,193::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa8984e8-a039-4a28-917b-999ef4718cbd`::moving from state init -> state preparing >Thread-134921::INFO::2014-10-29 11:02:31,193::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134921::INFO::2014-10-29 11:02:31,194::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533326', 'lastCheck': '2.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485816', 'lastCheck': '2.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506186', 'lastCheck': '5.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000551432', 'lastCheck': '5.1', 'valid': True}} >Thread-134921::DEBUG::2014-10-29 11:02:31,194::task::1191::Storage.TaskManager.Task::(prepare) Task=`fa8984e8-a039-4a28-917b-999ef4718cbd`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533326', 'lastCheck': '2.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485816', 'lastCheck': '2.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506186', 'lastCheck': '5.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000551432', 'lastCheck': '5.1', 'valid': True}} >Thread-134921::DEBUG::2014-10-29 11:02:31,195::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa8984e8-a039-4a28-917b-999ef4718cbd`::moving from state preparing -> state finished >Thread-134921::DEBUG::2014-10-29 11:02:31,195::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134921::DEBUG::2014-10-29 11:02:31,195::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134921::DEBUG::2014-10-29 11:02:31,195::task::993::Storage.TaskManager.Task::(_decref) Task=`fa8984e8-a039-4a28-917b-999ef4718cbd`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:32,376::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:32,378::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134922::DEBUG::2014-10-29 11:02:32,381::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:32,383::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:32,385::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134923::DEBUG::2014-10-29 11:02:32,389::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134923::DEBUG::2014-10-29 11:02:32,391::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:02:32,822::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:33,058::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:33,061::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:33,062::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:02:35,268::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53683 >Detector thread::DEBUG::2014-10-29 11:02:35,271::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53683 >Detector thread::DEBUG::2014-10-29 11:02:35,271::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53683 >Detector thread::DEBUG::2014-10-29 11:02:35,272::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53683) >Thread-134924::DEBUG::2014-10-29 11:02:35,309::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134924::DEBUG::2014-10-29 11:02:35,310::task::595::Storage.TaskManager.Task::(_updateState) Task=`3ead2b8c-09b0-4cfa-94e6-1e27daa15dd9`::moving from state init -> state preparing >Thread-134924::INFO::2014-10-29 11:02:35,311::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-134924::DEBUG::2014-10-29 11:02:35,315::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:02:35,316::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:35,316::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:35,316::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:35,317::__init__::232::IOProcess::(_processLogs) (198847) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:35,318::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198847) Queuing response >Thread-134924::DEBUG::2014-10-29 11:02:35,319::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-134924::DEBUG::2014-10-29 11:02:35,319::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-134924::INFO::2014-10-29 11:02:35,320::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-134924::DEBUG::2014-10-29 11:02:35,320::task::1191::Storage.TaskManager.Task::(prepare) Task=`3ead2b8c-09b0-4cfa-94e6-1e27daa15dd9`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-134924::DEBUG::2014-10-29 11:02:35,320::task::595::Storage.TaskManager.Task::(_updateState) Task=`3ead2b8c-09b0-4cfa-94e6-1e27daa15dd9`::moving from state preparing -> state finished >Thread-134924::DEBUG::2014-10-29 11:02:35,321::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134924::DEBUG::2014-10-29 11:02:35,321::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134924::DEBUG::2014-10-29 11:02:35,321::task::993::Storage.TaskManager.Task::(_decref) Task=`3ead2b8c-09b0-4cfa-94e6-1e27daa15dd9`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:02:35,366::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53684 >Detector thread::DEBUG::2014-10-29 11:02:35,366::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53684 >Detector thread::DEBUG::2014-10-29 11:02:35,367::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53684 >Detector thread::DEBUG::2014-10-29 11:02:35,367::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53684) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:35,405::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-134925::DEBUG::2014-10-29 11:02:35,407::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >JsonRpcServer::DEBUG::2014-10-29 11:02:35,411::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134925::DEBUG::2014-10-29 11:02:35,414::task::595::Storage.TaskManager.Task::(_updateState) Task=`f0dd1270-807f-48c1-adaf-8455f36faffa`::moving from state init -> state preparing >Thread-134925::INFO::2014-10-29 11:02:35,416::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-134925::DEBUG::2014-10-29 11:02:35,419::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-134925::DEBUG::2014-10-29 11:02:35,421::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-134926::DEBUG::2014-10-29 11:02:35,422::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-134925::DEBUG::2014-10-29 11:02:35,423::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-134925::DEBUG::2014-10-29 11:02:35,424::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-134925::DEBUG::2014-10-29 11:02:35,425::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-134925::DEBUG::2014-10-29 11:02:35,426::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:35,442::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:35,449::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134927::DEBUG::2014-10-29 11:02:35,454::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134927::DEBUG::2014-10-29 11:02:35,456::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-134925::DEBUG::2014-10-29 11:02:35,525::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-134925::DEBUG::2014-10-29 11:02:35,526::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-134925::DEBUG::2014-10-29 11:02:35,710::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-134925::DEBUG::2014-10-29 11:02:35,711::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134925::DEBUG::2014-10-29 11:02:35,711::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134925::DEBUG::2014-10-29 11:02:35,712::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134925::DEBUG::2014-10-29 11:02:35,712::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134925::DEBUG::2014-10-29 11:02:35,712::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134925::DEBUG::2014-10-29 11:02:35,713::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134925::DEBUG::2014-10-29 11:02:35,713::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:02:35,720::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:35,723::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:35,723::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:35,724::__init__::232::IOProcess::(_processLogs) (198848) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:35,725::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198848) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:35,726::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:35,727::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:35,727::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:35,727::__init__::232::IOProcess::(_processLogs) (198849) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:35,728::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198849) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:35,730::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:35,732::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:35,733::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:35,734::__init__::232::IOProcess::(_processLogs) (198850) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:35,738::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198850) Queuing response >Thread-134925::DEBUG::2014-10-29 11:02:35,742::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:02:35,742::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:35,744::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:35,744::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:35,745::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198851) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:35,746::__init__::232::IOProcess::(_processLogs) (198851) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:35,746::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:35,747::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:35,747::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:35,748::__init__::232::IOProcess::(_processLogs) (198852) Got request for method 'touch' >Thread-134925::DEBUG::2014-10-29 11:02:35,749::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:02:35,749::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198852) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:35,751::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:35,752::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:35,752::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:35,752::__init__::232::IOProcess::(_processLogs) (198853) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:02:35,753::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198853) Queuing response >Thread-134925::DEBUG::2014-10-29 11:02:35,754::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:02:35,756::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:35,756::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:35,757::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:35,758::__init__::232::IOProcess::(_processLogs) (198854) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:35,758::__init__::232::IOProcess::(_processLogs) (198854) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:35,758::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:35,759::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-134925::DEBUG::2014-10-29 11:02:35,760::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:02:35,759::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-134925::INFO::2014-10-29 11:02:35,761::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:02:35,761::__init__::232::IOProcess::(_processLogs) (198855) Got request for method 'glob' >Thread-134925::INFO::2014-10-29 11:02:35,762::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:02:35,763::__init__::232::IOProcess::(_processLogs) (198855) Queuing response >Thread-134925::INFO::2014-10-29 11:02:35,764::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:02:35,765::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:35,765::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:35,766::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:35,766::__init__::232::IOProcess::(_processLogs) (198856) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:02:35,767::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198856) Queuing response >Thread-134925::DEBUG::2014-10-29 11:02:35,767::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-134925::DEBUG::2014-10-29 11:02:35,769::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`16f63ae7-9f99-4b6f-8f31-43e0bd0b50b9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-134925::DEBUG::2014-10-29 11:02:35,769::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-134925::DEBUG::2014-10-29 11:02:35,770::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-134925::DEBUG::2014-10-29 11:02:35,770::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`16f63ae7-9f99-4b6f-8f31-43e0bd0b50b9`::Granted request >Thread-134925::DEBUG::2014-10-29 11:02:35,771::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f0dd1270-807f-48c1-adaf-8455f36faffa`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-134925::DEBUG::2014-10-29 11:02:35,771::task::993::Storage.TaskManager.Task::(_decref) Task=`f0dd1270-807f-48c1-adaf-8455f36faffa`::ref 1 aborting False >Thread-134925::INFO::2014-10-29 11:02:35,774::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-134925::DEBUG::2014-10-29 11:02:35,774::task::1191::Storage.TaskManager.Task::(prepare) Task=`f0dd1270-807f-48c1-adaf-8455f36faffa`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-134925::DEBUG::2014-10-29 11:02:35,774::task::595::Storage.TaskManager.Task::(_updateState) Task=`f0dd1270-807f-48c1-adaf-8455f36faffa`::moving from state preparing -> state finished >Thread-134925::DEBUG::2014-10-29 11:02:35,775::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-134925::DEBUG::2014-10-29 11:02:35,775::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134925::DEBUG::2014-10-29 11:02:35,775::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-134925::DEBUG::2014-10-29 11:02:35,776::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-134925::DEBUG::2014-10-29 11:02:35,776::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-134925::DEBUG::2014-10-29 11:02:35,776::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-134925::DEBUG::2014-10-29 11:02:35,777::task::993::Storage.TaskManager.Task::(_decref) Task=`f0dd1270-807f-48c1-adaf-8455f36faffa`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:02:35,796::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53685 >Detector thread::DEBUG::2014-10-29 11:02:35,797::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53685 >Detector thread::DEBUG::2014-10-29 11:02:35,797::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53685 >Detector thread::DEBUG::2014-10-29 11:02:35,798::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53685) >Thread-134932::DEBUG::2014-10-29 11:02:35,837::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134932::DEBUG::2014-10-29 11:02:35,838::task::595::Storage.TaskManager.Task::(_updateState) Task=`8c215c92-ecad-4f23-92ef-6283ba9f5331`::moving from state init -> state preparing >Thread-134932::INFO::2014-10-29 11:02:35,838::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134932::INFO::2014-10-29 11:02:35,839::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533326', 'lastCheck': '7.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485816', 'lastCheck': '6.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506186', 'lastCheck': '9.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000551432', 'lastCheck': '9.7', 'valid': True}} >Thread-134932::DEBUG::2014-10-29 11:02:35,839::task::1191::Storage.TaskManager.Task::(prepare) Task=`8c215c92-ecad-4f23-92ef-6283ba9f5331`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533326', 'lastCheck': '7.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485816', 'lastCheck': '6.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506186', 'lastCheck': '9.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000551432', 'lastCheck': '9.7', 'valid': True}} >Thread-134932::DEBUG::2014-10-29 11:02:35,839::task::595::Storage.TaskManager.Task::(_updateState) Task=`8c215c92-ecad-4f23-92ef-6283ba9f5331`::moving from state preparing -> state finished >Thread-134932::DEBUG::2014-10-29 11:02:35,839::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134932::DEBUG::2014-10-29 11:02:35,840::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134932::DEBUG::2014-10-29 11:02:35,840::task::993::Storage.TaskManager.Task::(_decref) Task=`8c215c92-ecad-4f23-92ef-6283ba9f5331`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:02:36,106::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:36,107::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:36,107::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:36,107::__init__::232::IOProcess::(_processLogs) (198857) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:36,109::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198857) Queuing response >Thread-10269::DEBUG::2014-10-29 11:02:36,110::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:02:36,128::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00154963 s, 324 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:02:36,130::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:36,130::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:36,132::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:36,133::__init__::232::IOProcess::(_processLogs) (198858) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:36,134::__init__::232::IOProcess::(_processLogs) (198858) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:36,212::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:36,212::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:36,213::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:36,213::__init__::232::IOProcess::(_processLogs) (198859) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:36,214::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198859) Queuing response >Thread-179::DEBUG::2014-10-29 11:02:36,216::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:02:36,232::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000523044 s, 711 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:02:36,234::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:36,235::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:36,235::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:36,235::__init__::232::IOProcess::(_processLogs) (198860) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:36,236::__init__::232::IOProcess::(_processLogs) (198860) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:38,065::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:38,066::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:38,068::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:38,470::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:38,473::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134933::DEBUG::2014-10-29 11:02:38,477::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:38,479::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:38,481::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134934::DEBUG::2014-10-29 11:02:38,485::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134934::DEBUG::2014-10-29 11:02:38,487::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:02:38,757::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53686 >Detector thread::DEBUG::2014-10-29 11:02:38,757::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53686 >Detector thread::DEBUG::2014-10-29 11:02:38,758::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53686 >Detector thread::DEBUG::2014-10-29 11:02:38,758::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53686) >Thread-17::DEBUG::2014-10-29 11:02:38,774::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:38,775::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:38,775::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:38,775::__init__::232::IOProcess::(_processLogs) (198861) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:38,777::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198861) Queuing response >Thread-178::DEBUG::2014-10-29 11:02:38,778::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:02:38,795::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000519787 s, 977 kB/s\n'; <rc> = 0 >Thread-134935::DEBUG::2014-10-29 11:02:38,798::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-17::DEBUG::2014-10-29 11:02:38,799::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:38,801::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:38,803::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:38,805::__init__::232::IOProcess::(_processLogs) (198862) Got request for method 'statvfs' >Thread-134935::DEBUG::2014-10-29 11:02:38,807::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-17::DEBUG::2014-10-29 11:02:38,826::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198862) Queuing response >Thread-134935::DEBUG::2014-10-29 11:02:38,832::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:02:38,832::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:38,835::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:38,836::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:38,837::__init__::232::IOProcess::(_processLogs) (198863) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:38,838::__init__::232::IOProcess::(_processLogs) (198863) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:38,839::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:38,839::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:38,840::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:38,841::__init__::232::IOProcess::(_processLogs) (198864) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:38,841::__init__::232::IOProcess::(_processLogs) (198864) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:38,842::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:38,843::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:38,843::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:38,843::__init__::232::IOProcess::(_processLogs) (198865) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:38,844::__init__::232::IOProcess::(_processLogs) (198865) Queuing response >Thread-134935::DEBUG::2014-10-29 11:02:38,894::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '51', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '51', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-17::DEBUG::2014-10-29 11:02:38,931::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:38,933::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-33::DEBUG::2014-10-29 11:02:38,934::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:02:38,934::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:38,953::__init__::232::IOProcess::(_processLogs) (198866) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:38,955::__init__::232::IOProcess::(_processLogs) (198866) Queuing response >Thread-33::DEBUG::2014-10-29 11:02:38,955::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00043105 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:02:38,958::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:38,958::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:38,960::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:38,961::__init__::232::IOProcess::(_processLogs) (198867) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:38,961::__init__::232::IOProcess::(_processLogs) (198867) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:38,962::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:38,962::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:38,963::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:38,964::__init__::232::IOProcess::(_processLogs) (198868) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:38,964::__init__::232::IOProcess::(_processLogs) (198868) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:38,965::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:38,965::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:38,965::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:38,965::__init__::232::IOProcess::(_processLogs) (198869) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:38,966::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198869) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:38,967::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:38,968::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:38,968::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:38,969::__init__::232::IOProcess::(_processLogs) (198870) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:38,970::__init__::232::IOProcess::(_processLogs) (198870) Queuing response >Detector thread::DEBUG::2014-10-29 11:02:39,477::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53687 >Detector thread::DEBUG::2014-10-29 11:02:39,478::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53687 >Detector thread::DEBUG::2014-10-29 11:02:39,478::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53687 >Detector thread::DEBUG::2014-10-29 11:02:39,478::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53687) >Thread-134936::DEBUG::2014-10-29 11:02:39,517::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-134936::DEBUG::2014-10-29 11:02:39,519::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134936::DEBUG::2014-10-29 11:02:39,520::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.53', 'elapsedTime': '513192', 'displayType': 'vnc', 'cpuSys': '0.66', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '16378362', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '71075', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '36539.27'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.39', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:02:40,265::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53689 >Detector thread::DEBUG::2014-10-29 11:02:40,265::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53689 >Detector thread::DEBUG::2014-10-29 11:02:40,266::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53689 >Detector thread::DEBUG::2014-10-29 11:02:40,266::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53689) >Thread-134937::DEBUG::2014-10-29 11:02:40,306::task::595::Storage.TaskManager.Task::(_updateState) Task=`15e953ec-fd52-4fcb-8a6c-f64058e7b560`::moving from state init -> state preparing >Thread-134937::INFO::2014-10-29 11:02:40,306::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134937::INFO::2014-10-29 11:02:40,307::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519787', 'lastCheck': '1.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043105', 'lastCheck': '1.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523044', 'lastCheck': '4.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00154963', 'lastCheck': '4.2', 'valid': True}} >Thread-134937::DEBUG::2014-10-29 11:02:40,307::task::1191::Storage.TaskManager.Task::(prepare) Task=`15e953ec-fd52-4fcb-8a6c-f64058e7b560`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519787', 'lastCheck': '1.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043105', 'lastCheck': '1.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523044', 'lastCheck': '4.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00154963', 'lastCheck': '4.2', 'valid': True}} >Thread-134937::DEBUG::2014-10-29 11:02:40,308::task::595::Storage.TaskManager.Task::(_updateState) Task=`15e953ec-fd52-4fcb-8a6c-f64058e7b560`::moving from state preparing -> state finished >Thread-134937::DEBUG::2014-10-29 11:02:40,308::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134937::DEBUG::2014-10-29 11:02:40,308::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134937::DEBUG::2014-10-29 11:02:40,308::task::993::Storage.TaskManager.Task::(_decref) Task=`15e953ec-fd52-4fcb-8a6c-f64058e7b560`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:41,499::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:41,501::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134938::DEBUG::2014-10-29 11:02:41,505::task::595::Storage.TaskManager.Task::(_updateState) Task=`678ea368-302e-4317-98bd-4498e8d6c6af`::moving from state init -> state preparing >Thread-134938::INFO::2014-10-29 11:02:41,505::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134938::INFO::2014-10-29 11:02:41,506::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519787', 'lastCheck': '2.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043105', 'lastCheck': '2.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523044', 'lastCheck': '5.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00154963', 'lastCheck': '5.4', 'valid': True}} >Thread-134938::DEBUG::2014-10-29 11:02:41,506::task::1191::Storage.TaskManager.Task::(prepare) Task=`678ea368-302e-4317-98bd-4498e8d6c6af`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519787', 'lastCheck': '2.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043105', 'lastCheck': '2.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523044', 'lastCheck': '5.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00154963', 'lastCheck': '5.4', 'valid': True}} >Thread-134938::DEBUG::2014-10-29 11:02:41,506::task::595::Storage.TaskManager.Task::(_updateState) Task=`678ea368-302e-4317-98bd-4498e8d6c6af`::moving from state preparing -> state finished >Thread-134938::DEBUG::2014-10-29 11:02:41,506::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134938::DEBUG::2014-10-29 11:02:41,507::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134938::DEBUG::2014-10-29 11:02:41,507::task::993::Storage.TaskManager.Task::(_decref) Task=`678ea368-302e-4317-98bd-4498e8d6c6af`::ref 0 aborting False >Thread-134938::DEBUG::2014-10-29 11:02:41,527::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:41,549::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:41,551::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134939::DEBUG::2014-10-29 11:02:41,555::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134939::DEBUG::2014-10-29 11:02:41,557::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:02:42,128::task::595::Storage.TaskManager.Task::(_updateState) Task=`acd880cd-3dac-4f17-a577-ee53b71c8a62`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:02:42,129::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:02:42,130::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:42,130::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:42,130::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:42,131::__init__::232::IOProcess::(_processLogs) (198871) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:02:42,131::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198871) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:42,133::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:42,134::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-22::INFO::2014-10-29 11:02:42,135::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010855424', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:02:42,136::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-22::DEBUG::2014-10-29 11:02:42,136::task::1191::Storage.TaskManager.Task::(prepare) Task=`acd880cd-3dac-4f17-a577-ee53b71c8a62`::finished: {'truesize': '6010855424', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:02:42,137::task::595::Storage.TaskManager.Task::(_updateState) Task=`acd880cd-3dac-4f17-a577-ee53b71c8a62`::moving from state preparing -> state finished >Thread-17::DEBUG::2014-10-29 11:02:42,137::__init__::232::IOProcess::(_processLogs) (198872) Got request for method 'stat' >Thread-22::DEBUG::2014-10-29 11:02:42,138::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-10-29 11:02:42,139::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17::DEBUG::2014-10-29 11:02:42,139::__init__::232::IOProcess::(_processLogs) (198872) Queuing response >Thread-22::DEBUG::2014-10-29 11:02:42,140::task::993::Storage.TaskManager.Task::(_decref) Task=`acd880cd-3dac-4f17-a577-ee53b71c8a62`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:02:42,210::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:43,075::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:43,076::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:43,078::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:44,602::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:44,605::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134940::DEBUG::2014-10-29 11:02:44,608::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:44,611::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:44,613::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134941::DEBUG::2014-10-29 11:02:44,616::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134941::DEBUG::2014-10-29 11:02:44,618::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:02:46,155::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:46,158::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10269::DEBUG::2014-10-29 11:02:46,159::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:02:46,160::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:46,181::__init__::232::IOProcess::(_processLogs) (198873) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:46,183::__init__::232::IOProcess::(_processLogs) (198873) Queuing response >Thread-10269::DEBUG::2014-10-29 11:02:46,186::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000712838 s, 704 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:02:46,190::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:46,191::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:46,193::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:46,195::__init__::232::IOProcess::(_processLogs) (198874) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:46,198::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198874) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:46,241::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:46,242::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:46,247::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-179::DEBUG::2014-10-29 11:02:46,249::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:02:46,249::__init__::232::IOProcess::(_processLogs) (198875) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:46,269::__init__::232::IOProcess::(_processLogs) (198875) Queuing response >Thread-179::DEBUG::2014-10-29 11:02:46,276::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000519269 s, 716 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:02:46,280::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:46,287::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:46,303::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:46,305::__init__::232::IOProcess::(_processLogs) (198876) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:46,307::__init__::232::IOProcess::(_processLogs) (198876) Queuing response >Detector thread::DEBUG::2014-10-29 11:02:46,443::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53691 >Detector thread::DEBUG::2014-10-29 11:02:46,444::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53691 >Detector thread::DEBUG::2014-10-29 11:02:46,444::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53691 >Detector thread::DEBUG::2014-10-29 11:02:46,444::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53691) >Thread-134942::DEBUG::2014-10-29 11:02:46,488::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134942::DEBUG::2014-10-29 11:02:46,491::task::595::Storage.TaskManager.Task::(_updateState) Task=`dcac7835-dcc3-4076-aaac-3341d6fe2a89`::moving from state init -> state preparing >Thread-134942::INFO::2014-10-29 11:02:46,493::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-134942::DEBUG::2014-10-29 11:02:46,507::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:02:46,510::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:46,514::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-134942::DEBUG::2014-10-29 11:02:46,514::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:02:46,516::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-134942::DEBUG::2014-10-29 11:02:46,516::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-17::DEBUG::2014-10-29 11:02:46,518::__init__::232::IOProcess::(_processLogs) (198877) Got request for method 'glob' >Thread-134942::INFO::2014-10-29 11:02:46,519::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-17::DEBUG::2014-10-29 11:02:46,520::__init__::232::IOProcess::(_processLogs) (198877) Queuing response >Thread-134942::DEBUG::2014-10-29 11:02:46,522::task::1191::Storage.TaskManager.Task::(prepare) Task=`dcac7835-dcc3-4076-aaac-3341d6fe2a89`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-134942::DEBUG::2014-10-29 11:02:46,523::task::595::Storage.TaskManager.Task::(_updateState) Task=`dcac7835-dcc3-4076-aaac-3341d6fe2a89`::moving from state preparing -> state finished >Thread-134942::DEBUG::2014-10-29 11:02:46,524::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134942::DEBUG::2014-10-29 11:02:46,526::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134942::DEBUG::2014-10-29 11:02:46,527::task::993::Storage.TaskManager.Task::(_decref) Task=`dcac7835-dcc3-4076-aaac-3341d6fe2a89`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:02:46,578::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53692 >Detector thread::DEBUG::2014-10-29 11:02:46,579::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53692 >Detector thread::DEBUG::2014-10-29 11:02:46,579::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53692 >Detector thread::DEBUG::2014-10-29 11:02:46,580::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53692) >Thread-134943::DEBUG::2014-10-29 11:02:46,621::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134943::DEBUG::2014-10-29 11:02:46,624::task::595::Storage.TaskManager.Task::(_updateState) Task=`c76ea519-5a6d-48dd-b7f9-b21b6f6da500`::moving from state init -> state preparing >Thread-134943::INFO::2014-10-29 11:02:46,625::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-134943::DEBUG::2014-10-29 11:02:46,628::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-134943::DEBUG::2014-10-29 11:02:46,629::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-134943::DEBUG::2014-10-29 11:02:46,630::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-134943::DEBUG::2014-10-29 11:02:46,631::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-134943::DEBUG::2014-10-29 11:02:46,633::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-134943::DEBUG::2014-10-29 11:02:46,635::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-134943::DEBUG::2014-10-29 11:02:46,715::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-134943::DEBUG::2014-10-29 11:02:46,716::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-134943::DEBUG::2014-10-29 11:02:46,884::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-134943::DEBUG::2014-10-29 11:02:46,887::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134943::DEBUG::2014-10-29 11:02:46,889::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134943::DEBUG::2014-10-29 11:02:46,892::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134943::DEBUG::2014-10-29 11:02:46,894::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134943::DEBUG::2014-10-29 11:02:46,896::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134943::DEBUG::2014-10-29 11:02:46,898::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134943::DEBUG::2014-10-29 11:02:46,899::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:02:46,910::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:46,914::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:46,915::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:46,917::__init__::232::IOProcess::(_processLogs) (198878) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:46,920::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198878) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:46,924::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:46,925::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:46,926::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:46,931::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198879) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:46,934::__init__::232::IOProcess::(_processLogs) (198879) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:46,937::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:46,939::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:46,941::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:46,944::__init__::232::IOProcess::(_processLogs) (198880) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:46,950::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198880) Queuing response >Thread-134943::DEBUG::2014-10-29 11:02:46,951::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:02:46,955::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:46,956::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:46,961::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:46,962::__init__::232::IOProcess::(_processLogs) (198881) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:46,964::__init__::232::IOProcess::(_processLogs) (198881) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:46,965::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:46,967::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:46,968::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:46,970::__init__::232::IOProcess::(_processLogs) (198882) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:02:46,976::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198882) Queuing response >Thread-134943::DEBUG::2014-10-29 11:02:46,980::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:02:46,983::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:46,985::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:46,986::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:46,988::__init__::232::IOProcess::(_processLogs) (198883) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:02:46,991::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198883) Queuing response >Thread-134943::DEBUG::2014-10-29 11:02:46,991::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:02:46,997::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:46,999::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:47,000::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:47,000::__init__::232::IOProcess::(_processLogs) (198884) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:47,003::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198884) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:47,005::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:47,007::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:47,008::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:47,011::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198885) Got request for method 'glob' >Thread-134943::DEBUG::2014-10-29 11:02:47,011::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:02:47,014::__init__::232::IOProcess::(_processLogs) (198885) Queuing response >Thread-134943::INFO::2014-10-29 11:02:47,014::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-134943::INFO::2014-10-29 11:02:47,016::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-134943::INFO::2014-10-29 11:02:47,018::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:02:47,021::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:47,023::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:47,024::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:47,025::__init__::232::IOProcess::(_processLogs) (198886) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:02:47,028::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198886) Queuing response >Thread-134943::DEBUG::2014-10-29 11:02:47,029::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-134943::DEBUG::2014-10-29 11:02:47,036::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`f763fcf0-8d3f-46df-be2d-f4c3e19ab449`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-134943::DEBUG::2014-10-29 11:02:47,038::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-134943::DEBUG::2014-10-29 11:02:47,040::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-134943::DEBUG::2014-10-29 11:02:47,041::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`f763fcf0-8d3f-46df-be2d-f4c3e19ab449`::Granted request >Thread-134943::DEBUG::2014-10-29 11:02:47,045::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c76ea519-5a6d-48dd-b7f9-b21b6f6da500`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-134943::DEBUG::2014-10-29 11:02:47,046::task::993::Storage.TaskManager.Task::(_decref) Task=`c76ea519-5a6d-48dd-b7f9-b21b6f6da500`::ref 1 aborting False >Thread-134943::INFO::2014-10-29 11:02:47,048::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-134943::DEBUG::2014-10-29 11:02:47,049::task::1191::Storage.TaskManager.Task::(prepare) Task=`c76ea519-5a6d-48dd-b7f9-b21b6f6da500`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-134943::DEBUG::2014-10-29 11:02:47,049::task::595::Storage.TaskManager.Task::(_updateState) Task=`c76ea519-5a6d-48dd-b7f9-b21b6f6da500`::moving from state preparing -> state finished >Thread-134943::DEBUG::2014-10-29 11:02:47,049::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-134943::DEBUG::2014-10-29 11:02:47,050::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134943::DEBUG::2014-10-29 11:02:47,050::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-134943::DEBUG::2014-10-29 11:02:47,050::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-134943::DEBUG::2014-10-29 11:02:47,050::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-134943::DEBUG::2014-10-29 11:02:47,051::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-134943::DEBUG::2014-10-29 11:02:47,051::task::993::Storage.TaskManager.Task::(_decref) Task=`c76ea519-5a6d-48dd-b7f9-b21b6f6da500`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:02:47,073::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53693 >Detector thread::DEBUG::2014-10-29 11:02:47,074::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53693 >Detector thread::DEBUG::2014-10-29 11:02:47,074::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53693 >Detector thread::DEBUG::2014-10-29 11:02:47,075::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53693) >Thread-134948::DEBUG::2014-10-29 11:02:47,114::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134948::DEBUG::2014-10-29 11:02:47,115::task::595::Storage.TaskManager.Task::(_updateState) Task=`108d4ca5-19f6-4b9e-8695-379fc5a1c4b4`::moving from state init -> state preparing >Thread-134948::INFO::2014-10-29 11:02:47,115::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134948::INFO::2014-10-29 11:02:47,116::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519787', 'lastCheck': '8.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043105', 'lastCheck': '8.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519269', 'lastCheck': '0.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000712838', 'lastCheck': '0.9', 'valid': True}} >Thread-134948::DEBUG::2014-10-29 11:02:47,116::task::1191::Storage.TaskManager.Task::(prepare) Task=`108d4ca5-19f6-4b9e-8695-379fc5a1c4b4`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519787', 'lastCheck': '8.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043105', 'lastCheck': '8.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519269', 'lastCheck': '0.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000712838', 'lastCheck': '0.9', 'valid': True}} >Thread-134948::DEBUG::2014-10-29 11:02:47,116::task::595::Storage.TaskManager.Task::(_updateState) Task=`108d4ca5-19f6-4b9e-8695-379fc5a1c4b4`::moving from state preparing -> state finished >Thread-134948::DEBUG::2014-10-29 11:02:47,117::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134948::DEBUG::2014-10-29 11:02:47,117::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134948::DEBUG::2014-10-29 11:02:47,117::task::993::Storage.TaskManager.Task::(_decref) Task=`108d4ca5-19f6-4b9e-8695-379fc5a1c4b4`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:47,647::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:47,650::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134949::DEBUG::2014-10-29 11:02:47,655::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:47,657::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:47,660::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134950::DEBUG::2014-10-29 11:02:47,663::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134950::DEBUG::2014-10-29 11:02:47,665::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:48,084::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:48,085::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:48,088::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-178::DEBUG::2014-10-29 11:02:48,851::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 9b5dff8d-f9a0-4e5c-8800-3a988fc12016 >Thread-17::DEBUG::2014-10-29 11:02:48,857::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:48,860::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:48,860::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:48,860::__init__::232::IOProcess::(_processLogs) (198887) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:48,861::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198887) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:48,865::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:48,867::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:48,867::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:48,867::__init__::232::IOProcess::(_processLogs) (198888) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:48,869::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198888) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:48,871::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:48,873::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:48,875::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-178::DEBUG::2014-10-29 11:02:48,876::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016 >Thread-17::DEBUG::2014-10-29 11:02:48,876::__init__::232::IOProcess::(_processLogs) (198889) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:48,879::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198889) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:48,880::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:48,881::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:48,881::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:48,881::__init__::232::IOProcess::(_processLogs) (198890) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:48,882::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198890) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:48,883::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:48,883::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:48,883::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:48,883::__init__::232::IOProcess::(_processLogs) (198891) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:02:48,884::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198891) Queuing response >Thread-178::DEBUG::2014-10-29 11:02:48,885::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:02:48,887::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:48,887::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:48,888::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:48,888::__init__::232::IOProcess::(_processLogs) (198892) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:02:48,889::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198892) Queuing response >Thread-178::DEBUG::2014-10-29 11:02:48,889::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nsednev_ovirt_3_5_HE_for_disks', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=Default', 'POOL_DOMAINS=9b5dff8d-f9a0-4e5c-8800-3a988fc12016:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=00000002-0002-0002-0002-000000000321', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_ovirt_3_5_HE_for_disks', 'ROLE=Master', 'SDUUID=9b5dff8d-f9a0-4e5c-8800-3a988fc12016', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=08256ef27d308c4f5bfe4a0974fd548f7d749489'] >Thread-17::DEBUG::2014-10-29 11:02:48,891::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:48,892::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:48,892::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:48,893::__init__::232::IOProcess::(_processLogs) (198893) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:48,893::__init__::232::IOProcess::(_processLogs) (198893) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:48,893::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:48,894::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:48,894::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:48,894::__init__::232::IOProcess::(_processLogs) (198894) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:02:48,895::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198894) Queuing response >Thread-178::DEBUG::2014-10-29 11:02:48,895::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-178::INFO::2014-10-29 11:02:48,896::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9b5dff8d-f9a0-4e5c-8800-3a988fc12016_imageNS already registered >Thread-178::INFO::2014-10-29 11:02:48,897::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9b5dff8d-f9a0-4e5c-8800-3a988fc12016_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:02:48,897::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:48,898::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:48,898::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:48,898::__init__::232::IOProcess::(_processLogs) (198895) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:48,899::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198895) Queuing response >Thread-178::DEBUG::2014-10-29 11:02:48,901::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:02:48,917::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00049594 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:02:48,919::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:48,920::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:48,920::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:48,920::__init__::232::IOProcess::(_processLogs) (198896) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:48,922::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198896) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:48,923::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:48,924::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:48,924::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:48,924::__init__::232::IOProcess::(_processLogs) (198897) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:48,925::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198897) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:48,926::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:48,926::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:48,927::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:48,927::__init__::232::IOProcess::(_processLogs) (198898) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:48,928::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198898) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:48,929::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:48,929::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:48,930::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:48,931::__init__::232::IOProcess::(_processLogs) (198899) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:48,931::__init__::232::IOProcess::(_processLogs) (198899) Queuing response >Detector thread::DEBUG::2014-10-29 11:02:48,946::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53694 >Detector thread::DEBUG::2014-10-29 11:02:48,947::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53694 >Detector thread::DEBUG::2014-10-29 11:02:48,947::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53694 >Detector thread::DEBUG::2014-10-29 11:02:48,948::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53694) >Thread-17::DEBUG::2014-10-29 11:02:48,971::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:48,971::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:48,971::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:48,972::__init__::232::IOProcess::(_processLogs) (198900) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:48,973::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198900) Queuing response >Thread-33::DEBUG::2014-10-29 11:02:48,974::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-134955::DEBUG::2014-10-29 11:02:48,993::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-33::DEBUG::2014-10-29 11:02:48,996::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000463075 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:02:49,002::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-134955::DEBUG::2014-10-29 11:02:49,004::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-17::DEBUG::2014-10-29 11:02:49,004::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:49,021::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:49,021::__init__::232::IOProcess::(_processLogs) (198901) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:49,024::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198901) Queuing response >Thread-134955::DEBUG::2014-10-29 11:02:49,025::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:02:49,030::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:49,030::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:49,035::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:49,037::__init__::232::IOProcess::(_processLogs) (198902) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:49,039::__init__::232::IOProcess::(_processLogs) (198902) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:49,043::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:49,043::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:49,044::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:49,044::__init__::232::IOProcess::(_processLogs) (198903) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:49,048::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198903) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:49,049::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:49,050::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:49,051::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:49,055::__init__::232::IOProcess::(_processLogs) (198904) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:02:49,057::__init__::232::IOProcess::(_processLogs) (198904) Queuing response >Thread-134955::DEBUG::2014-10-29 11:02:49,096::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '31', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '31', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:02:49,685::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53695 >Detector thread::DEBUG::2014-10-29 11:02:49,686::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53695 >Detector thread::DEBUG::2014-10-29 11:02:49,686::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53695 >Detector thread::DEBUG::2014-10-29 11:02:49,687::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53695) >Thread-134956::DEBUG::2014-10-29 11:02:49,726::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-134956::DEBUG::2014-10-29 11:02:49,727::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134956::DEBUG::2014-10-29 11:02:49,728::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.46', 'elapsedTime': '513202', 'displayType': 'vnc', 'cpuSys': '1.06', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '5244947', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '62706', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '34028.37'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.51', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:02:50,372::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53697 >Detector thread::DEBUG::2014-10-29 11:02:50,372::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53697 >Detector thread::DEBUG::2014-10-29 11:02:50,373::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53697 >Detector thread::DEBUG::2014-10-29 11:02:50,373::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53697) >Thread-134957::DEBUG::2014-10-29 11:02:50,413::task::595::Storage.TaskManager.Task::(_updateState) Task=`35f5d059-cd25-421b-90a2-621ee3a3c9ce`::moving from state init -> state preparing >Thread-134957::INFO::2014-10-29 11:02:50,414::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134957::INFO::2014-10-29 11:02:50,414::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049594', 'lastCheck': '1.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463075', 'lastCheck': '1.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519269', 'lastCheck': '4.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000712838', 'lastCheck': '4.2', 'valid': True}} >Thread-134957::DEBUG::2014-10-29 11:02:50,415::task::1191::Storage.TaskManager.Task::(prepare) Task=`35f5d059-cd25-421b-90a2-621ee3a3c9ce`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049594', 'lastCheck': '1.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463075', 'lastCheck': '1.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519269', 'lastCheck': '4.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000712838', 'lastCheck': '4.2', 'valid': True}} >Thread-134957::DEBUG::2014-10-29 11:02:50,415::task::595::Storage.TaskManager.Task::(_updateState) Task=`35f5d059-cd25-421b-90a2-621ee3a3c9ce`::moving from state preparing -> state finished >Thread-134957::DEBUG::2014-10-29 11:02:50,415::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134957::DEBUG::2014-10-29 11:02:50,415::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134957::DEBUG::2014-10-29 11:02:50,416::task::993::Storage.TaskManager.Task::(_decref) Task=`35f5d059-cd25-421b-90a2-621ee3a3c9ce`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:50,679::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:50,681::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134958::DEBUG::2014-10-29 11:02:50,684::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:50,686::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:50,688::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134959::DEBUG::2014-10-29 11:02:50,691::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134959::DEBUG::2014-10-29 11:02:50,693::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:53,095::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:53,096::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:53,097::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:53,707::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:53,709::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134960::DEBUG::2014-10-29 11:02:53,714::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:02:53,716::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:02:53,718::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134961::DEBUG::2014-10-29 11:02:53,721::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134961::DEBUG::2014-10-29 11:02:53,724::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:02:56,203::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:56,203::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:56,203::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:56,203::__init__::232::IOProcess::(_processLogs) (198905) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:56,205::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198905) Queuing response >Thread-10269::DEBUG::2014-10-29 11:02:56,206::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:02:56,224::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000505362 s, 993 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:02:56,226::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:56,226::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:56,227::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:56,227::__init__::232::IOProcess::(_processLogs) (198906) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:56,229::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198906) Queuing response >Thread-17::DEBUG::2014-10-29 11:02:56,305::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:56,306::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:56,306::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:56,306::__init__::232::IOProcess::(_processLogs) (198907) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:56,307::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198907) Queuing response >Thread-179::DEBUG::2014-10-29 11:02:56,309::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:02:56,327::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00117435 s, 317 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:02:56,328::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:56,329::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:56,329::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:56,329::__init__::232::IOProcess::(_processLogs) (198908) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:56,331::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198908) Queuing response >Thread-22::DEBUG::2014-10-29 11:02:57,260::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:58,105::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:58,106::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:02:58,108::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:02:58,933::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:58,934::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:58,934::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:58,935::__init__::232::IOProcess::(_processLogs) (198909) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:02:59,055::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:02:59,055::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:02:59,055::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:02:59,056::__init__::232::IOProcess::(_processLogs) (198910) Got request for method 'statvfs' >Detector thread::DEBUG::2014-10-29 11:02:59,154::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53698 >Detector thread::DEBUG::2014-10-29 11:02:59,155::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53698 >Detector thread::DEBUG::2014-10-29 11:02:59,155::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53698 >Detector thread::DEBUG::2014-10-29 11:02:59,156::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53698) >Thread-134962::DEBUG::2014-10-29 11:02:59,195::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-134962::DEBUG::2014-10-29 11:02:59,197::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-134962::DEBUG::2014-10-29 11:02:59,214::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-134962::DEBUG::2014-10-29 11:02:59,259::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '15', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '15', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:02:59,880::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53699 >Detector thread::DEBUG::2014-10-29 11:02:59,880::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53699 >Detector thread::DEBUG::2014-10-29 11:02:59,881::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53699 >Detector thread::DEBUG::2014-10-29 11:02:59,881::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53699) >Thread-134963::DEBUG::2014-10-29 11:02:59,920::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-134963::DEBUG::2014-10-29 11:02:59,921::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134963::DEBUG::2014-10-29 11:02:59,922::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.95', 'elapsedTime': '513212', 'displayType': 'vnc', 'cpuSys': '0.40', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '5244947', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '62706', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '34028.37'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.66', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:03:00,486::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53701 >Detector thread::DEBUG::2014-10-29 11:03:00,487::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53701 >Detector thread::DEBUG::2014-10-29 11:03:00,487::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53701 >Detector thread::DEBUG::2014-10-29 11:03:00,487::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53701) >Thread-134964::DEBUG::2014-10-29 11:03:00,527::task::595::Storage.TaskManager.Task::(_updateState) Task=`26e9179e-e545-4325-b317-33fc1926c763`::moving from state init -> state preparing >Thread-134964::INFO::2014-10-29 11:03:00,527::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134964::INFO::2014-10-29 11:03:00,528::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049594', 'lastCheck': '11.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463075', 'lastCheck': '11.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00117435', 'lastCheck': '4.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000505362', 'lastCheck': '4.3', 'valid': True}} >Thread-134964::DEBUG::2014-10-29 11:03:00,528::task::1191::Storage.TaskManager.Task::(prepare) Task=`26e9179e-e545-4325-b317-33fc1926c763`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049594', 'lastCheck': '11.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463075', 'lastCheck': '11.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00117435', 'lastCheck': '4.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000505362', 'lastCheck': '4.3', 'valid': True}} >Thread-134964::DEBUG::2014-10-29 11:03:00,528::task::595::Storage.TaskManager.Task::(_updateState) Task=`26e9179e-e545-4325-b317-33fc1926c763`::moving from state preparing -> state finished >Thread-134964::DEBUG::2014-10-29 11:03:00,529::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134964::DEBUG::2014-10-29 11:03:00,529::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134964::DEBUG::2014-10-29 11:03:00,529::task::993::Storage.TaskManager.Task::(_decref) Task=`26e9179e-e545-4325-b317-33fc1926c763`::ref 0 aborting False >Thread-33::DEBUG::2014-10-29 11:03:02,300::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:03:02,303::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198910) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:02,325::__init__::232::IOProcess::(_processLogs) (198909) Queuing response >Thread-178::DEBUG::2014-10-29 11:03:02,326::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Detector thread::DEBUG::2014-10-29 11:03:02,668::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53703 >Detector thread::DEBUG::2014-10-29 11:03:02,669::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53703 >Detector thread::DEBUG::2014-10-29 11:03:02,670::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53703 >Detector thread::DEBUG::2014-10-29 11:03:02,670::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53703) >Thread-134965::DEBUG::2014-10-29 11:03:02,709::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134965::DEBUG::2014-10-29 11:03:02,710::task::595::Storage.TaskManager.Task::(_updateState) Task=`59c7029d-cf8f-4446-801f-4ea3c496e461`::moving from state init -> state preparing >Thread-134965::INFO::2014-10-29 11:03:02,710::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-134965::DEBUG::2014-10-29 11:03:02,714::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:03:02,715::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:02,715::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:02,716::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:02,716::__init__::232::IOProcess::(_processLogs) (198911) Got request for method 'glob' >VM Channels Listener::DEBUG::2014-10-29 11:03:02,858::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:03,116::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:03,117::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:03,118::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:03:03,792::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198911) Queuing response >Thread-178::DEBUG::2014-10-29 11:03:03,802::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000584596 s, 869 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:03,804::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-33::DEBUG::2014-10-29 11:03:03,805::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00131603 s, 370 kB/s\n'; <rc> = 0 >Thread-134965::DEBUG::2014-10-29 11:03:03,805::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:03:03,820::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-134965::DEBUG::2014-10-29 11:03:03,820::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >JsonRpcServer::DEBUG::2014-10-29 11:03:03,827::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:03:03,827::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-134965::INFO::2014-10-29 11:03:03,829::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-17::DEBUG::2014-10-29 11:03:03,837::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-134965::DEBUG::2014-10-29 11:03:03,839::task::1191::Storage.TaskManager.Task::(prepare) Task=`59c7029d-cf8f-4446-801f-4ea3c496e461`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-17::DEBUG::2014-10-29 11:03:03,843::__init__::232::IOProcess::(_processLogs) (198912) Got request for method 'statvfs' >Thread-134965::DEBUG::2014-10-29 11:03:03,844::task::595::Storage.TaskManager.Task::(_updateState) Task=`59c7029d-cf8f-4446-801f-4ea3c496e461`::moving from state preparing -> state finished >Thread-17::DEBUG::2014-10-29 11:03:03,848::__init__::232::IOProcess::(_processLogs) (198912) Queuing response >Thread-134965::DEBUG::2014-10-29 11:03:03,850::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134965::DEBUG::2014-10-29 11:03:03,855::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134965::DEBUG::2014-10-29 11:03:03,863::task::993::Storage.TaskManager.Task::(_decref) Task=`59c7029d-cf8f-4446-801f-4ea3c496e461`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:03:03,875::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:03,880::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:03,887::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:03,891::__init__::232::IOProcess::(_processLogs) (198913) Got request for method 'statvfs' >Thread-33::DEBUG::2014-10-29 11:03:03,901::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-17::DEBUG::2014-10-29 11:03:03,901::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198913) Queuing response >Thread-33::DEBUG::2014-10-29 11:03:03,905::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-33::DEBUG::2014-10-29 11:03:03,907::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-33::DEBUG::2014-10-29 11:03:03,909::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-33::DEBUG::2014-10-29 11:03:03,912::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-33::DEBUG::2014-10-29 11:03:03,916::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-134966::DEBUG::2014-10-29 11:03:03,904::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7360f2e-a326-4d40-8289-59747f14c6b9`::moving from state init -> state preparing >Thread-17::DEBUG::2014-10-29 11:03:03,935::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:03,941::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:03,942::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:03,943::__init__::232::IOProcess::(_processLogs) (198914) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:03,943::__init__::232::IOProcess::(_processLogs) (198914) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:03,944::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:03,945::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:03,945::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:03,946::__init__::232::IOProcess::(_processLogs) (198915) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:03,946::__init__::232::IOProcess::(_processLogs) (198915) Queuing response >Thread-134966::INFO::2014-10-29 11:03:03,948::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-17::DEBUG::2014-10-29 11:03:03,950::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-134966::INFO::2014-10-29 11:03:03,952::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049594', 'lastCheck': '15.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463075', 'lastCheck': '14.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00117435', 'lastCheck': '7.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000505362', 'lastCheck': '7.7', 'valid': True}} >Thread-17::DEBUG::2014-10-29 11:03:03,953::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-134966::DEBUG::2014-10-29 11:03:03,954::task::1191::Storage.TaskManager.Task::(prepare) Task=`a7360f2e-a326-4d40-8289-59747f14c6b9`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049594', 'lastCheck': '15.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463075', 'lastCheck': '14.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00117435', 'lastCheck': '7.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000505362', 'lastCheck': '7.7', 'valid': True}} >Detector thread::DEBUG::2014-10-29 11:03:03,955::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53704 >Thread-134966::DEBUG::2014-10-29 11:03:03,957::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7360f2e-a326-4d40-8289-59747f14c6b9`::moving from state preparing -> state finished >Detector thread::DEBUG::2014-10-29 11:03:03,959::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53704 >Detector thread::DEBUG::2014-10-29 11:03:03,961::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53704 >Thread-17::DEBUG::2014-10-29 11:03:03,960::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Detector thread::DEBUG::2014-10-29 11:03:03,962::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53704) >Thread-134966::DEBUG::2014-10-29 11:03:03,960::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134966::DEBUG::2014-10-29 11:03:03,969::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17::DEBUG::2014-10-29 11:03:03,968::__init__::232::IOProcess::(_processLogs) (198916) Got request for method 'access' >Thread-134966::DEBUG::2014-10-29 11:03:03,972::task::993::Storage.TaskManager.Task::(_decref) Task=`a7360f2e-a326-4d40-8289-59747f14c6b9`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:03:03,973::__init__::232::IOProcess::(_processLogs) (198916) Queuing response >Thread-134967::DEBUG::2014-10-29 11:03:03,997::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134967::DEBUG::2014-10-29 11:03:04,001::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd4cf9f0-9d58-4fda-9c81-72a6111b66a7`::moving from state init -> state preparing >Thread-134967::INFO::2014-10-29 11:03:04,001::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-33::DEBUG::2014-10-29 11:03:04,005::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-33::DEBUG::2014-10-29 11:03:04,005::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-134966::DEBUG::2014-10-29 11:03:04,033::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:04,061::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:04,063::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134968::DEBUG::2014-10-29 11:03:04,067::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134968::DEBUG::2014-10-29 11:03:04,069::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-33::DEBUG::2014-10-29 11:03:04,181::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-33::DEBUG::2014-10-29 11:03:04,182::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-33::DEBUG::2014-10-29 11:03:04,182::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-33::DEBUG::2014-10-29 11:03:04,182::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-33::DEBUG::2014-10-29 11:03:04,183::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-33::DEBUG::2014-10-29 11:03:04,183::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-33::DEBUG::2014-10-29 11:03:04,183::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-33::DEBUG::2014-10-29 11:03:04,184::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:03:04,191::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:04,192::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:04,192::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:04,192::__init__::232::IOProcess::(_processLogs) (198917) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:03:04,193::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198917) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:04,196::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:04,197::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:04,199::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:04,201::__init__::232::IOProcess::(_processLogs) (198918) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:03:04,203::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:04,205::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:04,207::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-33::DEBUG::2014-10-29 11:03:04,209::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:03:04,209::__init__::232::IOProcess::(_processLogs) (198919) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:03:04,211::__init__::232::IOProcess::(_processLogs) (198918) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:04,211::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:04,211::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:04,211::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:04,212::__init__::232::IOProcess::(_processLogs) (198920) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:03:04,212::__init__::232::IOProcess::(_processLogs) (198919) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:04,213::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198920) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:04,215::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:04,215::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:04,215::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:04,215::__init__::232::IOProcess::(_processLogs) (198921) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:03:04,219::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198921) Queuing response >Thread-33::DEBUG::2014-10-29 11:03:04,220::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:03:04,221::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:04,221::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:04,221::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:04,221::__init__::232::IOProcess::(_processLogs) (198922) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:03:04,222::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198922) Queuing response >Thread-33::DEBUG::2014-10-29 11:03:04,223::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:03:04,224::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:04,225::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:04,226::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:04,226::__init__::232::IOProcess::(_processLogs) (198923) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:04,226::__init__::232::IOProcess::(_processLogs) (198923) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:04,227::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:04,227::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:04,227::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:04,228::__init__::232::IOProcess::(_processLogs) (198924) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:03:04,228::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198924) Queuing response >Thread-33::DEBUG::2014-10-29 11:03:04,228::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-33::INFO::2014-10-29 11:03:04,230::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-33::INFO::2014-10-29 11:03:04,230::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-134967::INFO::2014-10-29 11:03:04,231::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:03:04,234::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:04,235::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:04,235::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:04,235::__init__::232::IOProcess::(_processLogs) (198925) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:04,236::__init__::232::IOProcess::(_processLogs) (198925) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:04,236::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:04,236::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:04,237::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:04,237::__init__::232::IOProcess::(_processLogs) (198926) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:03:04,238::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198926) Queuing response >Thread-134967::DEBUG::2014-10-29 11:03:04,238::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:03:04,240::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:04,242::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:04,244::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:04,246::__init__::232::IOProcess::(_processLogs) (198927) Got request for method 'access' >Thread-134967::DEBUG::2014-10-29 11:03:04,246::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`2787b0b6-ce50-4d52-a5c4-974bb4d8739e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-17::DEBUG::2014-10-29 11:03:04,247::__init__::232::IOProcess::(_processLogs) (198927) Queuing response >Thread-134967::DEBUG::2014-10-29 11:03:04,247::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-134967::DEBUG::2014-10-29 11:03:04,250::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-134967::DEBUG::2014-10-29 11:03:04,252::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`2787b0b6-ce50-4d52-a5c4-974bb4d8739e`::Granted request >Thread-17::DEBUG::2014-10-29 11:03:04,255::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:04,258::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-134967::DEBUG::2014-10-29 11:03:04,257::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`cd4cf9f0-9d58-4fda-9c81-72a6111b66a7`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-17::DEBUG::2014-10-29 11:03:04,260::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-134967::DEBUG::2014-10-29 11:03:04,260::task::993::Storage.TaskManager.Task::(_decref) Task=`cd4cf9f0-9d58-4fda-9c81-72a6111b66a7`::ref 1 aborting False >Thread-17::DEBUG::2014-10-29 11:03:04,262::__init__::232::IOProcess::(_processLogs) (198928) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:04,264::__init__::232::IOProcess::(_processLogs) (198928) Queuing response >Thread-134967::INFO::2014-10-29 11:03:04,268::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-134967::DEBUG::2014-10-29 11:03:04,268::task::1191::Storage.TaskManager.Task::(prepare) Task=`cd4cf9f0-9d58-4fda-9c81-72a6111b66a7`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-134967::DEBUG::2014-10-29 11:03:04,268::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd4cf9f0-9d58-4fda-9c81-72a6111b66a7`::moving from state preparing -> state finished >Thread-134967::DEBUG::2014-10-29 11:03:04,268::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-134967::DEBUG::2014-10-29 11:03:04,269::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134967::DEBUG::2014-10-29 11:03:04,269::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-134967::DEBUG::2014-10-29 11:03:04,269::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-134967::DEBUG::2014-10-29 11:03:04,270::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-134967::DEBUG::2014-10-29 11:03:04,270::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-134967::DEBUG::2014-10-29 11:03:04,270::task::993::Storage.TaskManager.Task::(_decref) Task=`cd4cf9f0-9d58-4fda-9c81-72a6111b66a7`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:03:04,293::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53705 >Detector thread::DEBUG::2014-10-29 11:03:04,294::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53705 >Detector thread::DEBUG::2014-10-29 11:03:04,294::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53705 >Detector thread::DEBUG::2014-10-29 11:03:04,295::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53705) >Thread-134973::DEBUG::2014-10-29 11:03:04,334::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134973::DEBUG::2014-10-29 11:03:04,334::task::595::Storage.TaskManager.Task::(_updateState) Task=`cbacc4eb-4306-4674-86ff-e8389a9f4def`::moving from state init -> state preparing >Thread-134973::INFO::2014-10-29 11:03:04,335::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134973::INFO::2014-10-29 11:03:04,335::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000584596', 'lastCheck': '0.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00131603', 'lastCheck': '0.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00117435', 'lastCheck': '8.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000505362', 'lastCheck': '8.1', 'valid': True}} >Thread-134973::DEBUG::2014-10-29 11:03:04,336::task::1191::Storage.TaskManager.Task::(prepare) Task=`cbacc4eb-4306-4674-86ff-e8389a9f4def`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000584596', 'lastCheck': '0.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00131603', 'lastCheck': '0.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00117435', 'lastCheck': '8.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000505362', 'lastCheck': '8.1', 'valid': True}} >Thread-134973::DEBUG::2014-10-29 11:03:04,336::task::595::Storage.TaskManager.Task::(_updateState) Task=`cbacc4eb-4306-4674-86ff-e8389a9f4def`::moving from state preparing -> state finished >Thread-134973::DEBUG::2014-10-29 11:03:04,336::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134973::DEBUG::2014-10-29 11:03:04,337::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134973::DEBUG::2014-10-29 11:03:04,337::task::993::Storage.TaskManager.Task::(_decref) Task=`cbacc4eb-4306-4674-86ff-e8389a9f4def`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:03:06,232::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:06,232::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:06,233::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:06,233::__init__::232::IOProcess::(_processLogs) (198929) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:06,235::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198929) Queuing response >Thread-10269::DEBUG::2014-10-29 11:03:06,237::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:03:06,254::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000422399 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:03:06,255::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:06,256::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:06,256::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:06,256::__init__::232::IOProcess::(_processLogs) (198930) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:06,258::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198930) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:06,333::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:06,333::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:06,334::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:06,334::__init__::232::IOProcess::(_processLogs) (198931) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:06,335::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198931) Queuing response >Thread-179::DEBUG::2014-10-29 11:03:06,337::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:03:06,352::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000442713 s, 840 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:03:06,354::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:06,355::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:06,355::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:06,355::__init__::232::IOProcess::(_processLogs) (198932) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:06,357::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198932) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:07,124::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:07,126::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134974::DEBUG::2014-10-29 11:03:07,130::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:07,133::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:07,134::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134975::DEBUG::2014-10-29 11:03:07,138::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134975::DEBUG::2014-10-29 11:03:07,140::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:08,125::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:08,126::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:08,129::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:03:08,307::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53706 >Detector thread::DEBUG::2014-10-29 11:03:08,307::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53706 >Detector thread::DEBUG::2014-10-29 11:03:08,308::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53706 >Detector thread::DEBUG::2014-10-29 11:03:08,308::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53706) >Thread-134976::DEBUG::2014-10-29 11:03:08,347::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-134976::DEBUG::2014-10-29 11:03:08,349::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-134976::DEBUG::2014-10-29 11:03:08,367::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-134976::DEBUG::2014-10-29 11:03:08,413::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '99', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '99', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:03:10,082::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53707 >Detector thread::DEBUG::2014-10-29 11:03:10,083::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53707 >Detector thread::DEBUG::2014-10-29 11:03:10,083::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53707 >Detector thread::DEBUG::2014-10-29 11:03:10,083::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53707) >Thread-134977::DEBUG::2014-10-29 11:03:10,122::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-134977::DEBUG::2014-10-29 11:03:10,123::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134977::DEBUG::2014-10-29 11:03:10,124::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.95', 'elapsedTime': '513222', 'displayType': 'vnc', 'cpuSys': '0.40', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '5244947', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '62706', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '34028.37'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.86', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:10,159::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:10,161::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134978::DEBUG::2014-10-29 11:03:10,165::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:10,167::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:10,168::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134979::DEBUG::2014-10-29 11:03:10,172::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134979::DEBUG::2014-10-29 11:03:10,174::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:03:10,947::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53709 >Detector thread::DEBUG::2014-10-29 11:03:10,948::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53709 >Detector thread::DEBUG::2014-10-29 11:03:10,948::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53709 >Detector thread::DEBUG::2014-10-29 11:03:10,948::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53709) >Thread-134980::DEBUG::2014-10-29 11:03:10,988::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a5fed6f-1c63-4a93-9edf-0bbae17fe68c`::moving from state init -> state preparing >Thread-134980::INFO::2014-10-29 11:03:10,988::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134980::INFO::2014-10-29 11:03:10,989::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000584596', 'lastCheck': '7.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00131603', 'lastCheck': '6.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000442713', 'lastCheck': '4.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000422399', 'lastCheck': '4.7', 'valid': True}} >Thread-134980::DEBUG::2014-10-29 11:03:10,989::task::1191::Storage.TaskManager.Task::(prepare) Task=`9a5fed6f-1c63-4a93-9edf-0bbae17fe68c`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000584596', 'lastCheck': '7.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00131603', 'lastCheck': '6.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000442713', 'lastCheck': '4.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000422399', 'lastCheck': '4.7', 'valid': True}} >Thread-134980::DEBUG::2014-10-29 11:03:10,990::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a5fed6f-1c63-4a93-9edf-0bbae17fe68c`::moving from state preparing -> state finished >Thread-134980::DEBUG::2014-10-29 11:03:10,990::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134980::DEBUG::2014-10-29 11:03:10,990::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134980::DEBUG::2014-10-29 11:03:10,990::task::993::Storage.TaskManager.Task::(_decref) Task=`9a5fed6f-1c63-4a93-9edf-0bbae17fe68c`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:03:12,285::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:13,136::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:13,137::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:13,138::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:13,187::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:13,189::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134981::DEBUG::2014-10-29 11:03:13,192::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:13,194::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:13,196::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134982::DEBUG::2014-10-29 11:03:13,199::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134982::DEBUG::2014-10-29 11:03:13,201::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:03:13,967::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:13,967::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:13,968::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:13,968::__init__::232::IOProcess::(_processLogs) (198933) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:13,970::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198933) Queuing response >Thread-178::DEBUG::2014-10-29 11:03:13,971::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:03:13,989::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000541807 s, 938 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:03:13,991::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:13,991::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:13,993::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:13,995::__init__::232::IOProcess::(_processLogs) (198934) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:13,995::__init__::232::IOProcess::(_processLogs) (198934) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:13,996::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:13,996::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:13,997::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:13,998::__init__::232::IOProcess::(_processLogs) (198935) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:13,998::__init__::232::IOProcess::(_processLogs) (198935) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:13,998::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:13,999::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:13,999::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:14,000::__init__::232::IOProcess::(_processLogs) (198936) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:14,001::__init__::232::IOProcess::(_processLogs) (198936) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:14,001::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:14,002::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:14,002::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:14,003::__init__::232::IOProcess::(_processLogs) (198937) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:14,003::__init__::232::IOProcess::(_processLogs) (198937) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:14,260::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:14,260::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:14,261::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:14,261::__init__::232::IOProcess::(_processLogs) (198938) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:14,262::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198938) Queuing response >Thread-33::DEBUG::2014-10-29 11:03:14,264::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:03:14,290::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00175151 s, 278 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:03:14,292::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:14,293::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:14,293::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:14,293::__init__::232::IOProcess::(_processLogs) (198939) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:14,293::__init__::232::IOProcess::(_processLogs) (198939) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:14,296::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:14,297::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:14,297::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:14,298::__init__::232::IOProcess::(_processLogs) (198940) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:14,298::__init__::232::IOProcess::(_processLogs) (198940) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:14,299::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:14,300::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:14,300::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:14,300::__init__::232::IOProcess::(_processLogs) (198941) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:14,301::__init__::232::IOProcess::(_processLogs) (198941) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:14,302::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:14,302::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:14,304::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:14,304::__init__::232::IOProcess::(_processLogs) (198942) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:14,304::__init__::232::IOProcess::(_processLogs) (198942) Queuing response >Detector thread::DEBUG::2014-10-29 11:03:14,923::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53711 >Detector thread::DEBUG::2014-10-29 11:03:14,924::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53711 >Detector thread::DEBUG::2014-10-29 11:03:14,924::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53711 >Detector thread::DEBUG::2014-10-29 11:03:14,924::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53711) >Thread-134983::DEBUG::2014-10-29 11:03:14,964::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134983::DEBUG::2014-10-29 11:03:14,965::task::595::Storage.TaskManager.Task::(_updateState) Task=`1468fe68-efc8-4d41-9430-986f14b6f008`::moving from state init -> state preparing >Thread-134983::INFO::2014-10-29 11:03:14,966::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-134983::DEBUG::2014-10-29 11:03:14,970::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:03:14,971::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:14,971::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:14,972::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:14,972::__init__::232::IOProcess::(_processLogs) (198943) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:03:15,793::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198943) Queuing response >Thread-134983::DEBUG::2014-10-29 11:03:15,794::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-134983::DEBUG::2014-10-29 11:03:15,795::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-134983::INFO::2014-10-29 11:03:15,795::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-134983::DEBUG::2014-10-29 11:03:15,796::task::1191::Storage.TaskManager.Task::(prepare) Task=`1468fe68-efc8-4d41-9430-986f14b6f008`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-134983::DEBUG::2014-10-29 11:03:15,796::task::595::Storage.TaskManager.Task::(_updateState) Task=`1468fe68-efc8-4d41-9430-986f14b6f008`::moving from state preparing -> state finished >Thread-134983::DEBUG::2014-10-29 11:03:15,796::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134983::DEBUG::2014-10-29 11:03:15,797::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134983::DEBUG::2014-10-29 11:03:15,797::task::993::Storage.TaskManager.Task::(_decref) Task=`1468fe68-efc8-4d41-9430-986f14b6f008`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:03:15,841::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53712 >Detector thread::DEBUG::2014-10-29 11:03:15,842::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53712 >Detector thread::DEBUG::2014-10-29 11:03:15,842::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53712 >Detector thread::DEBUG::2014-10-29 11:03:15,843::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53712) >Thread-134984::DEBUG::2014-10-29 11:03:15,881::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134984::DEBUG::2014-10-29 11:03:15,882::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc48c664-4bfb-411c-8694-2a4e915ca7fb`::moving from state init -> state preparing >Thread-134984::INFO::2014-10-29 11:03:15,882::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-134984::DEBUG::2014-10-29 11:03:15,883::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-134984::DEBUG::2014-10-29 11:03:15,883::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-134984::DEBUG::2014-10-29 11:03:15,883::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-134984::DEBUG::2014-10-29 11:03:15,883::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-134984::DEBUG::2014-10-29 11:03:15,884::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-134984::DEBUG::2014-10-29 11:03:15,884::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-134984::DEBUG::2014-10-29 11:03:15,968::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-134984::DEBUG::2014-10-29 11:03:15,969::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-134984::DEBUG::2014-10-29 11:03:16,154::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-134984::DEBUG::2014-10-29 11:03:16,157::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134984::DEBUG::2014-10-29 11:03:16,159::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134984::DEBUG::2014-10-29 11:03:16,161::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134984::DEBUG::2014-10-29 11:03:16,162::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134984::DEBUG::2014-10-29 11:03:16,164::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134984::DEBUG::2014-10-29 11:03:16,166::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134984::DEBUG::2014-10-29 11:03:16,168::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:03:16,179::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:16,182::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:16,183::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:16,185::__init__::232::IOProcess::(_processLogs) (198944) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:03:16,188::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198944) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:16,192::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:16,193::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:16,195::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:16,196::__init__::232::IOProcess::(_processLogs) (198945) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:03:16,200::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198945) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:16,204::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:16,207::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:16,211::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:16,214::__init__::232::IOProcess::(_processLogs) (198946) Got request for method 'glob' >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:16,218::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-17::DEBUG::2014-10-29 11:03:16,224::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198946) Queuing response >JsonRpcServer::DEBUG::2014-10-29 11:03:16,230::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134984::DEBUG::2014-10-29 11:03:16,235::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:03:16,236::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:16,241::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:16,244::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-134989::DEBUG::2014-10-29 11:03:16,248::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:03:16,248::__init__::232::IOProcess::(_processLogs) (198947) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:03:16,252::__init__::232::IOProcess::(_processLogs) (198947) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:16,256::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-17::DEBUG::2014-10-29 11:03:16,264::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:16,266::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >JsonRpcServer::DEBUG::2014-10-29 11:03:16,267::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:03:16,270::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:16,272::__init__::232::IOProcess::(_processLogs) (198948) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:03:16,276::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198948) Queuing response >Thread-134984::DEBUG::2014-10-29 11:03:16,277::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:03:16,284::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-134990::DEBUG::2014-10-29 11:03:16,286::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:03:16,287::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:16,290::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:16,292::__init__::232::IOProcess::(_processLogs) (198949) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:16,300::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198949) Queuing response >Thread-10269::DEBUG::2014-10-29 11:03:16,302::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:03:16,324::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-10269::DEBUG::2014-10-29 11:03:16,328::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00047438 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:03:16,328::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:16,333::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:16,335::__init__::232::IOProcess::(_processLogs) (198950) Got request for method 'readfile' >Thread-134984::DEBUG::2014-10-29 11:03:16,340::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:03:16,340::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198950) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:16,348::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:16,349::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:16,350::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-134990::DEBUG::2014-10-29 11:03:16,352::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:03:16,352::__init__::232::IOProcess::(_processLogs) (198951) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:16,362::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198951) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:16,367::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:16,368::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:16,370::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:16,373::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198952) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:16,375::__init__::232::IOProcess::(_processLogs) (198952) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:16,377::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:16,378::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:16,380::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:16,381::__init__::232::IOProcess::(_processLogs) (198953) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:16,386::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198953) Queuing response >Thread-179::DEBUG::2014-10-29 11:03:16,387::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:03:16,406::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:16,408::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-179::DEBUG::2014-10-29 11:03:16,412::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000489407 s, 760 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:03:16,415::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-134984::DEBUG::2014-10-29 11:03:16,415::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:03:16,420::__init__::232::IOProcess::(_processLogs) (198954) Got request for method 'glob' >Thread-134984::INFO::2014-10-29 11:03:16,420::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:03:16,423::__init__::232::IOProcess::(_processLogs) (198954) Queuing response >Thread-134984::INFO::2014-10-29 11:03:16,423::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-134984::INFO::2014-10-29 11:03:16,426::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:03:16,427::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:16,430::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:16,431::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:16,437::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198955) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:16,439::__init__::232::IOProcess::(_processLogs) (198955) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:16,443::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:16,444::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:16,445::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:16,446::__init__::232::IOProcess::(_processLogs) (198956) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:03:16,449::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198956) Queuing response >Thread-134984::DEBUG::2014-10-29 11:03:16,450::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-134984::DEBUG::2014-10-29 11:03:16,458::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`c2ee36c0-babc-4db9-9008-ac337014b6eb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-134984::DEBUG::2014-10-29 11:03:16,459::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-134984::DEBUG::2014-10-29 11:03:16,461::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-134984::DEBUG::2014-10-29 11:03:16,463::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`c2ee36c0-babc-4db9-9008-ac337014b6eb`::Granted request >Thread-134984::DEBUG::2014-10-29 11:03:16,466::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bc48c664-4bfb-411c-8694-2a4e915ca7fb`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-134984::DEBUG::2014-10-29 11:03:16,467::task::993::Storage.TaskManager.Task::(_decref) Task=`bc48c664-4bfb-411c-8694-2a4e915ca7fb`::ref 1 aborting False >Thread-134984::INFO::2014-10-29 11:03:16,481::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-134984::DEBUG::2014-10-29 11:03:16,482::task::1191::Storage.TaskManager.Task::(prepare) Task=`bc48c664-4bfb-411c-8694-2a4e915ca7fb`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-134984::DEBUG::2014-10-29 11:03:16,483::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc48c664-4bfb-411c-8694-2a4e915ca7fb`::moving from state preparing -> state finished >Thread-134984::DEBUG::2014-10-29 11:03:16,484::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-134984::DEBUG::2014-10-29 11:03:16,486::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134984::DEBUG::2014-10-29 11:03:16,489::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-134984::DEBUG::2014-10-29 11:03:16,491::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-134984::DEBUG::2014-10-29 11:03:16,492::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-134984::DEBUG::2014-10-29 11:03:16,493::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-134984::DEBUG::2014-10-29 11:03:16,496::task::993::Storage.TaskManager.Task::(_decref) Task=`bc48c664-4bfb-411c-8694-2a4e915ca7fb`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:03:16,522::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53713 >Detector thread::DEBUG::2014-10-29 11:03:16,523::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53713 >Detector thread::DEBUG::2014-10-29 11:03:16,523::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53713 >Detector thread::DEBUG::2014-10-29 11:03:16,524::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53713) >Thread-134991::DEBUG::2014-10-29 11:03:16,562::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134991::DEBUG::2014-10-29 11:03:16,567::task::595::Storage.TaskManager.Task::(_updateState) Task=`5417e48b-4a34-434a-a415-d2fd30ab993d`::moving from state init -> state preparing >Thread-134991::INFO::2014-10-29 11:03:16,569::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134991::INFO::2014-10-29 11:03:16,572::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000541807', 'lastCheck': '2.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00175151', 'lastCheck': '2.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489407', 'lastCheck': '0.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00047438', 'lastCheck': '0.2', 'valid': True}} >Thread-134991::DEBUG::2014-10-29 11:03:16,574::task::1191::Storage.TaskManager.Task::(prepare) Task=`5417e48b-4a34-434a-a415-d2fd30ab993d`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000541807', 'lastCheck': '2.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00175151', 'lastCheck': '2.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489407', 'lastCheck': '0.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00047438', 'lastCheck': '0.2', 'valid': True}} >Thread-134991::DEBUG::2014-10-29 11:03:16,575::task::595::Storage.TaskManager.Task::(_updateState) Task=`5417e48b-4a34-434a-a415-d2fd30ab993d`::moving from state preparing -> state finished >Thread-134991::DEBUG::2014-10-29 11:03:16,576::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134991::DEBUG::2014-10-29 11:03:16,577::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134991::DEBUG::2014-10-29 11:03:16,579::task::993::Storage.TaskManager.Task::(_decref) Task=`5417e48b-4a34-434a-a415-d2fd30ab993d`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:18,146::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:18,148::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:18,151::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:03:18,466::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53714 >Detector thread::DEBUG::2014-10-29 11:03:18,467::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53714 >Detector thread::DEBUG::2014-10-29 11:03:18,467::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53714 >Detector thread::DEBUG::2014-10-29 11:03:18,468::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53714) >Thread-134992::DEBUG::2014-10-29 11:03:18,506::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-134992::DEBUG::2014-10-29 11:03:18,508::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-134992::DEBUG::2014-10-29 11:03:18,528::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-134992::DEBUG::2014-10-29 11:03:18,576::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '83', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '83', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:03:19,282::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53715 >Detector thread::DEBUG::2014-10-29 11:03:19,284::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53715 >Detector thread::DEBUG::2014-10-29 11:03:19,285::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53715 >Detector thread::DEBUG::2014-10-29 11:03:19,285::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53715) >Thread-134993::DEBUG::2014-10-29 11:03:19,323::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-134993::DEBUG::2014-10-29 11:03:19,324::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134993::DEBUG::2014-10-29 11:03:19,325::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.39', 'elapsedTime': '513231', 'displayType': 'vnc', 'cpuSys': '1.26', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '5244947', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '62706', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '34028.37'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.03', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:19,373::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:19,376::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134994::DEBUG::2014-10-29 11:03:19,380::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab60d72c-e58e-466e-a949-3cbc04597879`::moving from state init -> state preparing >Thread-134994::INFO::2014-10-29 11:03:19,380::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134994::INFO::2014-10-29 11:03:19,381::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000541807', 'lastCheck': '5.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00175151', 'lastCheck': '5.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489407', 'lastCheck': '2.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00047438', 'lastCheck': '3.0', 'valid': True}} >Thread-134994::DEBUG::2014-10-29 11:03:19,381::task::1191::Storage.TaskManager.Task::(prepare) Task=`ab60d72c-e58e-466e-a949-3cbc04597879`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000541807', 'lastCheck': '5.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00175151', 'lastCheck': '5.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489407', 'lastCheck': '2.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00047438', 'lastCheck': '3.0', 'valid': True}} >Thread-134994::DEBUG::2014-10-29 11:03:19,382::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab60d72c-e58e-466e-a949-3cbc04597879`::moving from state preparing -> state finished >Thread-134994::DEBUG::2014-10-29 11:03:19,382::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134994::DEBUG::2014-10-29 11:03:19,382::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134994::DEBUG::2014-10-29 11:03:19,382::task::993::Storage.TaskManager.Task::(_decref) Task=`ab60d72c-e58e-466e-a949-3cbc04597879`::ref 0 aborting False >Thread-134994::DEBUG::2014-10-29 11:03:19,431::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:19,455::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:19,458::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134995::DEBUG::2014-10-29 11:03:19,461::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134995::DEBUG::2014-10-29 11:03:19,463::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:03:21,120::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53717 >Detector thread::DEBUG::2014-10-29 11:03:21,121::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53717 >Detector thread::DEBUG::2014-10-29 11:03:21,121::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53717 >Detector thread::DEBUG::2014-10-29 11:03:21,122::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53717) >Thread-134996::DEBUG::2014-10-29 11:03:21,162::task::595::Storage.TaskManager.Task::(_updateState) Task=`d542926a-9ab3-4740-871a-6a331dd0243a`::moving from state init -> state preparing >Thread-134996::INFO::2014-10-29 11:03:21,162::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-134996::INFO::2014-10-29 11:03:21,162::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000541807', 'lastCheck': '7.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00175151', 'lastCheck': '6.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489407', 'lastCheck': '4.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00047438', 'lastCheck': '4.8', 'valid': True}} >Thread-134996::DEBUG::2014-10-29 11:03:21,163::task::1191::Storage.TaskManager.Task::(prepare) Task=`d542926a-9ab3-4740-871a-6a331dd0243a`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000541807', 'lastCheck': '7.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00175151', 'lastCheck': '6.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489407', 'lastCheck': '4.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00047438', 'lastCheck': '4.8', 'valid': True}} >Thread-134996::DEBUG::2014-10-29 11:03:21,163::task::595::Storage.TaskManager.Task::(_updateState) Task=`d542926a-9ab3-4740-871a-6a331dd0243a`::moving from state preparing -> state finished >Thread-134996::DEBUG::2014-10-29 11:03:21,163::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-134996::DEBUG::2014-10-29 11:03:21,164::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134996::DEBUG::2014-10-29 11:03:21,164::task::993::Storage.TaskManager.Task::(_decref) Task=`d542926a-9ab3-4740-871a-6a331dd0243a`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:22,505::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:22,508::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134997::DEBUG::2014-10-29 11:03:22,510::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:22,512::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:22,514::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134998::DEBUG::2014-10-29 11:03:22,517::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-134998::DEBUG::2014-10-29 11:03:22,519::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:23,154::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:23,155::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:23,156::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:03:24,016::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:24,016::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:24,016::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:24,017::__init__::232::IOProcess::(_processLogs) (198957) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:24,017::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198957) Queuing response >Thread-178::DEBUG::2014-10-29 11:03:24,019::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:03:24,037::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000426122 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:03:24,039::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:24,039::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:24,040::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:24,040::__init__::232::IOProcess::(_processLogs) (198958) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:24,041::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198958) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:24,043::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:24,043::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:24,044::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:24,044::__init__::232::IOProcess::(_processLogs) (198959) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:24,044::__init__::232::IOProcess::(_processLogs) (198959) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:24,045::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:24,046::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:24,046::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:24,046::__init__::232::IOProcess::(_processLogs) (198960) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:24,047::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198960) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:24,048::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:24,048::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:24,048::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:24,049::__init__::232::IOProcess::(_processLogs) (198961) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:24,049::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198961) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:24,305::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:24,305::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:24,307::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-33::DEBUG::2014-10-29 11:03:24,308::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:03:24,308::__init__::232::IOProcess::(_processLogs) (198962) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:24,324::__init__::232::IOProcess::(_processLogs) (198962) Queuing response >Thread-33::DEBUG::2014-10-29 11:03:24,327::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000546171 s, 892 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:03:24,328::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:24,329::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:24,329::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:24,329::__init__::232::IOProcess::(_processLogs) (198963) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:24,331::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198963) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:24,333::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:24,333::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:24,334::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:24,335::__init__::232::IOProcess::(_processLogs) (198964) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:24,335::__init__::232::IOProcess::(_processLogs) (198964) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:24,335::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:24,336::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:24,337::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:24,337::__init__::232::IOProcess::(_processLogs) (198965) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:24,337::__init__::232::IOProcess::(_processLogs) (198965) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:24,338::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:24,339::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:24,339::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:24,340::__init__::232::IOProcess::(_processLogs) (198966) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:24,341::__init__::232::IOProcess::(_processLogs) (198966) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:25,536::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:25,539::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134999::DEBUG::2014-10-29 11:03:25,543::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:25,545::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:25,547::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135000::DEBUG::2014-10-29 11:03:25,551::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135000::DEBUG::2014-10-29 11:03:25,553::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:03:26,368::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:26,369::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:26,369::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:26,369::__init__::232::IOProcess::(_processLogs) (198967) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:26,370::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198967) Queuing response >Thread-10269::DEBUG::2014-10-29 11:03:26,371::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:03:26,401::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000480864 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:03:26,403::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:26,403::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:26,403::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:26,404::__init__::232::IOProcess::(_processLogs) (198968) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:26,405::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198968) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:26,441::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:26,442::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:26,442::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:26,442::__init__::232::IOProcess::(_processLogs) (198969) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:26,444::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198969) Queuing response >Thread-179::DEBUG::2014-10-29 11:03:26,445::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:03:26,463::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000573541 s, 649 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:03:26,465::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:26,466::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:26,467::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:26,467::__init__::232::IOProcess::(_processLogs) (198970) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:26,467::__init__::232::IOProcess::(_processLogs) (198970) Queuing response >Detector thread::DEBUG::2014-10-29 11:03:27,105::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53719 >Detector thread::DEBUG::2014-10-29 11:03:27,106::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53719 >Detector thread::DEBUG::2014-10-29 11:03:27,106::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53719 >Detector thread::DEBUG::2014-10-29 11:03:27,106::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53719) >Thread-135001::DEBUG::2014-10-29 11:03:27,146::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135001::DEBUG::2014-10-29 11:03:27,147::task::595::Storage.TaskManager.Task::(_updateState) Task=`4e4b86c2-88ab-4400-a19c-b4c92cf8a785`::moving from state init -> state preparing >Thread-135001::INFO::2014-10-29 11:03:27,148::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135001::DEBUG::2014-10-29 11:03:27,151::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:03:27,152::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:27,152::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:27,152::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:27,153::__init__::232::IOProcess::(_processLogs) (198971) Got request for method 'glob' >Thread-22::DEBUG::2014-10-29 11:03:27,308::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-17::DEBUG::2014-10-29 11:03:27,791::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198971) Queuing response >Thread-135001::DEBUG::2014-10-29 11:03:27,791::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135001::DEBUG::2014-10-29 11:03:27,793::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135001::INFO::2014-10-29 11:03:27,793::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135001::DEBUG::2014-10-29 11:03:27,793::task::1191::Storage.TaskManager.Task::(prepare) Task=`4e4b86c2-88ab-4400-a19c-b4c92cf8a785`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135001::DEBUG::2014-10-29 11:03:27,794::task::595::Storage.TaskManager.Task::(_updateState) Task=`4e4b86c2-88ab-4400-a19c-b4c92cf8a785`::moving from state preparing -> state finished >Thread-135001::DEBUG::2014-10-29 11:03:27,794::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135001::DEBUG::2014-10-29 11:03:27,794::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135001::DEBUG::2014-10-29 11:03:27,794::task::993::Storage.TaskManager.Task::(_decref) Task=`4e4b86c2-88ab-4400-a19c-b4c92cf8a785`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:03:27,838::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53720 >Detector thread::DEBUG::2014-10-29 11:03:27,839::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53720 >Detector thread::DEBUG::2014-10-29 11:03:27,839::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53720 >Detector thread::DEBUG::2014-10-29 11:03:27,840::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53720) >Thread-135002::DEBUG::2014-10-29 11:03:27,878::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135002::DEBUG::2014-10-29 11:03:27,879::task::595::Storage.TaskManager.Task::(_updateState) Task=`77fab4f7-901e-4215-aec9-01723de73c65`::moving from state init -> state preparing >Thread-135002::INFO::2014-10-29 11:03:27,879::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135002::DEBUG::2014-10-29 11:03:27,879::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135002::DEBUG::2014-10-29 11:03:27,880::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135002::DEBUG::2014-10-29 11:03:27,880::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135002::DEBUG::2014-10-29 11:03:27,880::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135002::DEBUG::2014-10-29 11:03:27,881::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135002::DEBUG::2014-10-29 11:03:27,881::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135002::DEBUG::2014-10-29 11:03:27,956::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135002::DEBUG::2014-10-29 11:03:27,957::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135002::DEBUG::2014-10-29 11:03:28,128::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135002::DEBUG::2014-10-29 11:03:28,129::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135002::DEBUG::2014-10-29 11:03:28,129::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135002::DEBUG::2014-10-29 11:03:28,130::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135002::DEBUG::2014-10-29 11:03:28,130::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135002::DEBUG::2014-10-29 11:03:28,131::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135002::DEBUG::2014-10-29 11:03:28,131::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135002::DEBUG::2014-10-29 11:03:28,131::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:03:28,137::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:28,139::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:28,140::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:28,140::__init__::232::IOProcess::(_processLogs) (198972) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:03:28,141::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198972) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:28,143::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:28,143::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:28,143::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:28,144::__init__::232::IOProcess::(_processLogs) (198973) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:03:28,144::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198973) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:28,146::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:28,147::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:28,149::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:28,151::__init__::232::IOProcess::(_processLogs) (198974) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:03:28,155::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198974) Queuing response >Thread-135002::DEBUG::2014-10-29 11:03:28,158::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:03:28,159::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:28,161::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:03:28,163::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:28,165::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:28,167::__init__::232::IOProcess::(_processLogs) (198975) Got request for method 'glob' >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:28,167::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:03:28,171::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198975) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:28,173::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:03:28,176::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:28,177::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:28,177::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:28,177::__init__::232::IOProcess::(_processLogs) (198976) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:03:28,178::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198976) Queuing response >Thread-135002::DEBUG::2014-10-29 11:03:28,179::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:03:28,181::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:28,181::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:28,181::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:28,182::__init__::232::IOProcess::(_processLogs) (198977) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:03:28,183::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198977) Queuing response >Thread-135002::DEBUG::2014-10-29 11:03:28,183::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:03:28,185::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:28,185::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:28,186::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:28,186::__init__::232::IOProcess::(_processLogs) (198978) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:28,187::__init__::232::IOProcess::(_processLogs) (198978) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:28,187::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:28,187::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:28,188::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-135002::DEBUG::2014-10-29 11:03:28,188::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:03:28,188::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198979) Got request for method 'glob' >Thread-135002::INFO::2014-10-29 11:03:28,190::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:03:28,190::__init__::232::IOProcess::(_processLogs) (198979) Queuing response >Thread-135002::INFO::2014-10-29 11:03:28,191::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135002::INFO::2014-10-29 11:03:28,192::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:03:28,193::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:28,193::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:28,193::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:28,194::__init__::232::IOProcess::(_processLogs) (198980) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:03:28,194::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198980) Queuing response >Thread-135002::DEBUG::2014-10-29 11:03:28,195::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135002::DEBUG::2014-10-29 11:03:28,197::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`330f84b7-6c71-4b47-995b-f7733d3bddde`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135002::DEBUG::2014-10-29 11:03:28,197::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135002::DEBUG::2014-10-29 11:03:28,198::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135002::DEBUG::2014-10-29 11:03:28,198::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`330f84b7-6c71-4b47-995b-f7733d3bddde`::Granted request >Thread-135002::DEBUG::2014-10-29 11:03:28,199::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`77fab4f7-901e-4215-aec9-01723de73c65`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135002::DEBUG::2014-10-29 11:03:28,199::task::993::Storage.TaskManager.Task::(_decref) Task=`77fab4f7-901e-4215-aec9-01723de73c65`::ref 1 aborting False >Thread-135002::INFO::2014-10-29 11:03:28,202::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135002::DEBUG::2014-10-29 11:03:28,202::task::1191::Storage.TaskManager.Task::(prepare) Task=`77fab4f7-901e-4215-aec9-01723de73c65`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135002::DEBUG::2014-10-29 11:03:28,202::task::595::Storage.TaskManager.Task::(_updateState) Task=`77fab4f7-901e-4215-aec9-01723de73c65`::moving from state preparing -> state finished >Thread-135002::DEBUG::2014-10-29 11:03:28,203::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135002::DEBUG::2014-10-29 11:03:28,203::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135002::DEBUG::2014-10-29 11:03:28,203::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135002::DEBUG::2014-10-29 11:03:28,204::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135002::DEBUG::2014-10-29 11:03:28,204::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135002::DEBUG::2014-10-29 11:03:28,204::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135002::DEBUG::2014-10-29 11:03:28,204::task::993::Storage.TaskManager.Task::(_decref) Task=`77fab4f7-901e-4215-aec9-01723de73c65`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:03:28,228::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53721 >Detector thread::DEBUG::2014-10-29 11:03:28,229::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53721 >Detector thread::DEBUG::2014-10-29 11:03:28,229::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53721 >Detector thread::DEBUG::2014-10-29 11:03:28,230::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53721) >Thread-135007::DEBUG::2014-10-29 11:03:28,268::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135007::DEBUG::2014-10-29 11:03:28,269::task::595::Storage.TaskManager.Task::(_updateState) Task=`b2aaead5-afba-46c8-9e54-1f3c5a6b4a8b`::moving from state init -> state preparing >Thread-135007::INFO::2014-10-29 11:03:28,269::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135007::INFO::2014-10-29 11:03:28,270::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426122', 'lastCheck': '4.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000546171', 'lastCheck': '3.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000573541', 'lastCheck': '1.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000480864', 'lastCheck': '1.9', 'valid': True}} >Thread-135007::DEBUG::2014-10-29 11:03:28,270::task::1191::Storage.TaskManager.Task::(prepare) Task=`b2aaead5-afba-46c8-9e54-1f3c5a6b4a8b`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426122', 'lastCheck': '4.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000546171', 'lastCheck': '3.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000573541', 'lastCheck': '1.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000480864', 'lastCheck': '1.9', 'valid': True}} >Thread-135007::DEBUG::2014-10-29 11:03:28,270::task::595::Storage.TaskManager.Task::(_updateState) Task=`b2aaead5-afba-46c8-9e54-1f3c5a6b4a8b`::moving from state preparing -> state finished >Thread-135007::DEBUG::2014-10-29 11:03:28,270::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135007::DEBUG::2014-10-29 11:03:28,271::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135007::DEBUG::2014-10-29 11:03:28,271::task::993::Storage.TaskManager.Task::(_decref) Task=`b2aaead5-afba-46c8-9e54-1f3c5a6b4a8b`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:28,566::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:28,569::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135008::DEBUG::2014-10-29 11:03:28,572::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:28,574::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:28,576::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135009::DEBUG::2014-10-29 11:03:28,579::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135009::DEBUG::2014-10-29 11:03:28,581::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:03:28,632::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53722 >Detector thread::DEBUG::2014-10-29 11:03:28,633::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53722 >Detector thread::DEBUG::2014-10-29 11:03:28,633::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53722 >Detector thread::DEBUG::2014-10-29 11:03:28,634::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53722) >Thread-135010::DEBUG::2014-10-29 11:03:28,673::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135010::DEBUG::2014-10-29 11:03:28,675::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135010::DEBUG::2014-10-29 11:03:28,693::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135010::DEBUG::2014-10-29 11:03:28,752::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '66', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '65', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:03:29,489::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53723 >Detector thread::DEBUG::2014-10-29 11:03:29,490::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53723 >Detector thread::DEBUG::2014-10-29 11:03:29,491::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53723 >Detector thread::DEBUG::2014-10-29 11:03:29,491::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53723) >Thread-135011::DEBUG::2014-10-29 11:03:29,529::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135011::DEBUG::2014-10-29 11:03:29,531::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135011::DEBUG::2014-10-29 11:03:29,532::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.77', 'elapsedTime': '513242', 'displayType': 'vnc', 'cpuSys': '0.40', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '5244947', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '62706', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '34028.37'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.22', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:03:30,364::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53725 >Detector thread::DEBUG::2014-10-29 11:03:30,364::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53725 >Detector thread::DEBUG::2014-10-29 11:03:30,365::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53725 >Detector thread::DEBUG::2014-10-29 11:03:30,365::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53725) >Thread-135012::DEBUG::2014-10-29 11:03:30,405::task::595::Storage.TaskManager.Task::(_updateState) Task=`86a490c4-7cdb-4c21-b316-e78f27ff6f8c`::moving from state init -> state preparing >Thread-135012::INFO::2014-10-29 11:03:30,405::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135012::INFO::2014-10-29 11:03:30,406::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426122', 'lastCheck': '6.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000546171', 'lastCheck': '6.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000573541', 'lastCheck': '3.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000480864', 'lastCheck': '4.0', 'valid': True}} >Thread-135012::DEBUG::2014-10-29 11:03:30,406::task::1191::Storage.TaskManager.Task::(prepare) Task=`86a490c4-7cdb-4c21-b316-e78f27ff6f8c`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426122', 'lastCheck': '6.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000546171', 'lastCheck': '6.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000573541', 'lastCheck': '3.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000480864', 'lastCheck': '4.0', 'valid': True}} >Thread-135012::DEBUG::2014-10-29 11:03:30,407::task::595::Storage.TaskManager.Task::(_updateState) Task=`86a490c4-7cdb-4c21-b316-e78f27ff6f8c`::moving from state preparing -> state finished >Thread-135012::DEBUG::2014-10-29 11:03:30,407::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135012::DEBUG::2014-10-29 11:03:30,407::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135012::DEBUG::2014-10-29 11:03:30,407::task::993::Storage.TaskManager.Task::(_decref) Task=`86a490c4-7cdb-4c21-b316-e78f27ff6f8c`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:31,595::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:31,597::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135013::DEBUG::2014-10-29 11:03:31,600::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:31,602::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:31,604::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135014::DEBUG::2014-10-29 11:03:31,607::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135014::DEBUG::2014-10-29 11:03:31,609::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:03:32,902::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:33,185::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:33,192::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:33,197::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:03:34,051::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:34,052::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:34,052::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:34,052::__init__::232::IOProcess::(_processLogs) (198981) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:34,053::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198981) Queuing response >Thread-178::DEBUG::2014-10-29 11:03:34,055::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:03:34,074::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000527039 s, 964 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:03:34,076::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:34,076::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:34,078::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:34,079::__init__::232::IOProcess::(_processLogs) (198982) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:34,079::__init__::232::IOProcess::(_processLogs) (198982) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:34,080::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:34,081::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:34,082::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:34,082::__init__::232::IOProcess::(_processLogs) (198983) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:34,082::__init__::232::IOProcess::(_processLogs) (198983) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:34,083::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:34,083::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:34,084::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:34,084::__init__::232::IOProcess::(_processLogs) (198984) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:34,085::__init__::232::IOProcess::(_processLogs) (198984) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:34,085::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:34,086::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:34,086::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:34,087::__init__::232::IOProcess::(_processLogs) (198985) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:34,087::__init__::232::IOProcess::(_processLogs) (198985) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:34,342::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:34,344::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-33::DEBUG::2014-10-29 11:03:34,345::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:03:34,346::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:34,364::__init__::232::IOProcess::(_processLogs) (198986) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:34,364::__init__::232::IOProcess::(_processLogs) (198986) Queuing response >Thread-33::DEBUG::2014-10-29 11:03:34,366::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000461754 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:03:34,368::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:34,368::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:34,368::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:34,368::__init__::232::IOProcess::(_processLogs) (198987) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:34,370::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198987) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:34,372::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:34,373::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:34,374::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:34,374::__init__::232::IOProcess::(_processLogs) (198988) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:34,374::__init__::232::IOProcess::(_processLogs) (198988) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:34,375::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:34,375::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:34,376::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:34,376::__init__::232::IOProcess::(_processLogs) (198989) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:34,377::__init__::232::IOProcess::(_processLogs) (198989) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:34,377::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:34,378::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:34,378::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:34,380::__init__::232::IOProcess::(_processLogs) (198990) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:34,380::__init__::232::IOProcess::(_processLogs) (198990) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:34,622::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:34,625::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135015::DEBUG::2014-10-29 11:03:34,629::task::595::Storage.TaskManager.Task::(_updateState) Task=`07745463-07f5-4050-b8ac-2bd003711fbd`::moving from state init -> state preparing >Thread-135015::INFO::2014-10-29 11:03:34,630::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135015::INFO::2014-10-29 11:03:34,630::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527039', 'lastCheck': '0.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461754', 'lastCheck': '0.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000573541', 'lastCheck': '8.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000480864', 'lastCheck': '8.2', 'valid': True}} >Thread-135015::DEBUG::2014-10-29 11:03:34,631::task::1191::Storage.TaskManager.Task::(prepare) Task=`07745463-07f5-4050-b8ac-2bd003711fbd`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527039', 'lastCheck': '0.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461754', 'lastCheck': '0.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000573541', 'lastCheck': '8.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000480864', 'lastCheck': '8.2', 'valid': True}} >Thread-135015::DEBUG::2014-10-29 11:03:34,631::task::595::Storage.TaskManager.Task::(_updateState) Task=`07745463-07f5-4050-b8ac-2bd003711fbd`::moving from state preparing -> state finished >Thread-135015::DEBUG::2014-10-29 11:03:34,631::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135015::DEBUG::2014-10-29 11:03:34,631::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135015::DEBUG::2014-10-29 11:03:34,632::task::993::Storage.TaskManager.Task::(_decref) Task=`07745463-07f5-4050-b8ac-2bd003711fbd`::ref 0 aborting False >Thread-135015::DEBUG::2014-10-29 11:03:34,653::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:34,675::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:34,677::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135016::DEBUG::2014-10-29 11:03:34,681::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135016::DEBUG::2014-10-29 11:03:34,683::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:03:36,408::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:36,408::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:36,409::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:36,409::__init__::232::IOProcess::(_processLogs) (198991) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:36,410::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198991) Queuing response >Thread-10269::DEBUG::2014-10-29 11:03:36,412::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:03:36,429::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000529589 s, 948 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:03:36,430::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:36,431::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:36,431::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:36,432::__init__::232::IOProcess::(_processLogs) (198992) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:36,433::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198992) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:36,469::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:36,469::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:36,470::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:36,470::__init__::232::IOProcess::(_processLogs) (198993) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:36,471::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198993) Queuing response >Thread-179::DEBUG::2014-10-29 11:03:36,473::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:03:36,490::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000501321 s, 742 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:03:36,492::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:36,492::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:36,494::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:36,495::__init__::232::IOProcess::(_processLogs) (198994) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:36,496::__init__::232::IOProcess::(_processLogs) (198994) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:37,726::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:37,728::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135017::DEBUG::2014-10-29 11:03:37,732::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:37,735::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:37,736::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135018::DEBUG::2014-10-29 11:03:37,740::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135018::DEBUG::2014-10-29 11:03:37,742::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:38,207::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:38,208::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:38,209::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:03:38,803::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53726 >Detector thread::DEBUG::2014-10-29 11:03:38,803::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53726 >Detector thread::DEBUG::2014-10-29 11:03:38,804::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53726 >Detector thread::DEBUG::2014-10-29 11:03:38,804::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53726) >Thread-135019::DEBUG::2014-10-29 11:03:38,843::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135019::DEBUG::2014-10-29 11:03:38,847::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Detector thread::DEBUG::2014-10-29 11:03:38,864::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53728 >Thread-135019::DEBUG::2014-10-29 11:03:38,866::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Detector thread::DEBUG::2014-10-29 11:03:38,868::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53728 >Detector thread::DEBUG::2014-10-29 11:03:38,870::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53728 >Detector thread::DEBUG::2014-10-29 11:03:38,872::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53728) >Thread-135020::DEBUG::2014-10-29 11:03:38,894::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135020::DEBUG::2014-10-29 11:03:38,895::task::595::Storage.TaskManager.Task::(_updateState) Task=`c3b92d3e-0012-4857-a815-c271fa008a9b`::moving from state init -> state preparing >Thread-135020::INFO::2014-10-29 11:03:38,896::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135020::DEBUG::2014-10-29 11:03:38,899::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:03:38,900::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:38,900::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:38,901::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:38,901::__init__::232::IOProcess::(_processLogs) (198995) Got request for method 'glob' >Thread-135019::DEBUG::2014-10-29 11:03:38,946::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '46', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '46', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:03:39,690::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53729 >Detector thread::DEBUG::2014-10-29 11:03:39,691::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53729 >Detector thread::DEBUG::2014-10-29 11:03:39,691::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53729 >Detector thread::DEBUG::2014-10-29 11:03:39,692::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53729) >Thread-135021::DEBUG::2014-10-29 11:03:39,731::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135021::DEBUG::2014-10-29 11:03:39,733::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135021::DEBUG::2014-10-29 11:03:39,733::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.77', 'elapsedTime': '513252', 'displayType': 'vnc', 'cpuSys': '0.40', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '5244947', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '62706', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '34028.37'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.42', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-17::DEBUG::2014-10-29 11:03:39,788::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198995) Queuing response >Thread-135020::DEBUG::2014-10-29 11:03:39,790::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135020::DEBUG::2014-10-29 11:03:39,790::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135020::INFO::2014-10-29 11:03:39,791::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135020::DEBUG::2014-10-29 11:03:39,791::task::1191::Storage.TaskManager.Task::(prepare) Task=`c3b92d3e-0012-4857-a815-c271fa008a9b`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135020::DEBUG::2014-10-29 11:03:39,791::task::595::Storage.TaskManager.Task::(_updateState) Task=`c3b92d3e-0012-4857-a815-c271fa008a9b`::moving from state preparing -> state finished >Thread-135020::DEBUG::2014-10-29 11:03:39,792::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135020::DEBUG::2014-10-29 11:03:39,792::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135020::DEBUG::2014-10-29 11:03:39,792::task::993::Storage.TaskManager.Task::(_decref) Task=`c3b92d3e-0012-4857-a815-c271fa008a9b`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:03:39,837::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53730 >Detector thread::DEBUG::2014-10-29 11:03:39,837::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53730 >Detector thread::DEBUG::2014-10-29 11:03:39,838::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53730 >Detector thread::DEBUG::2014-10-29 11:03:39,838::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53730) >Thread-135022::DEBUG::2014-10-29 11:03:39,878::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135022::DEBUG::2014-10-29 11:03:39,879::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe864585-0074-4683-9047-8a955ef8da28`::moving from state init -> state preparing >Thread-135022::INFO::2014-10-29 11:03:39,879::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135022::DEBUG::2014-10-29 11:03:39,880::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135022::DEBUG::2014-10-29 11:03:39,880::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135022::DEBUG::2014-10-29 11:03:39,880::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135022::DEBUG::2014-10-29 11:03:39,880::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135022::DEBUG::2014-10-29 11:03:39,881::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135022::DEBUG::2014-10-29 11:03:39,881::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135022::DEBUG::2014-10-29 11:03:39,964::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135022::DEBUG::2014-10-29 11:03:39,965::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135022::DEBUG::2014-10-29 11:03:40,141::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135022::DEBUG::2014-10-29 11:03:40,143::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135022::DEBUG::2014-10-29 11:03:40,144::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135022::DEBUG::2014-10-29 11:03:40,144::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135022::DEBUG::2014-10-29 11:03:40,145::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135022::DEBUG::2014-10-29 11:03:40,145::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135022::DEBUG::2014-10-29 11:03:40,145::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135022::DEBUG::2014-10-29 11:03:40,146::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:03:40,153::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:40,155::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:40,155::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:40,156::__init__::232::IOProcess::(_processLogs) (198996) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:03:40,157::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(198996) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:40,161::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:40,161::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:40,162::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:40,164::__init__::232::IOProcess::(_processLogs) (198997) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:03:40,166::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:40,167::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:40,167::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:40,167::__init__::232::IOProcess::(_processLogs) (198998) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:03:40,168::__init__::232::IOProcess::(_processLogs) (198997) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:40,170::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:40,173::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-135022::DEBUG::2014-10-29 11:03:40,174::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:03:40,175::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:40,176::__init__::232::IOProcess::(_processLogs) (198999) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:03:40,176::__init__::232::IOProcess::(_processLogs) (198998) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:40,176::__init__::232::IOProcess::(_processLogs) (198999) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:40,178::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:40,178::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:40,179::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:40,179::__init__::232::IOProcess::(_processLogs) (199000) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:03:40,180::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199000) Queuing response >Thread-135022::DEBUG::2014-10-29 11:03:40,181::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:03:40,182::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:40,183::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:40,183::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:40,183::__init__::232::IOProcess::(_processLogs) (199001) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:03:40,184::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199001) Queuing response >Thread-135022::DEBUG::2014-10-29 11:03:40,184::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:03:40,186::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:40,187::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:40,187::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:40,188::__init__::232::IOProcess::(_processLogs) (199002) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:40,188::__init__::232::IOProcess::(_processLogs) (199002) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:40,189::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:40,189::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:40,190::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-135022::DEBUG::2014-10-29 11:03:40,190::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:03:40,191::__init__::232::IOProcess::(_processLogs) (199003) Got request for method 'glob' >Thread-135022::INFO::2014-10-29 11:03:40,192::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:03:40,193::__init__::232::IOProcess::(_processLogs) (199003) Queuing response >Thread-135022::INFO::2014-10-29 11:03:40,193::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135022::INFO::2014-10-29 11:03:40,194::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:03:40,195::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:40,195::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:40,196::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:40,196::__init__::232::IOProcess::(_processLogs) (199004) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:03:40,197::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199004) Queuing response >Thread-135022::DEBUG::2014-10-29 11:03:40,197::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135022::DEBUG::2014-10-29 11:03:40,199::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`b890a2a5-c2f9-441a-9e2b-4035899034c3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135022::DEBUG::2014-10-29 11:03:40,200::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135022::DEBUG::2014-10-29 11:03:40,200::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135022::DEBUG::2014-10-29 11:03:40,200::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`b890a2a5-c2f9-441a-9e2b-4035899034c3`::Granted request >Thread-135022::DEBUG::2014-10-29 11:03:40,201::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fe864585-0074-4683-9047-8a955ef8da28`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135022::DEBUG::2014-10-29 11:03:40,201::task::993::Storage.TaskManager.Task::(_decref) Task=`fe864585-0074-4683-9047-8a955ef8da28`::ref 1 aborting False >Thread-135022::INFO::2014-10-29 11:03:40,204::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135022::DEBUG::2014-10-29 11:03:40,204::task::1191::Storage.TaskManager.Task::(prepare) Task=`fe864585-0074-4683-9047-8a955ef8da28`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135022::DEBUG::2014-10-29 11:03:40,205::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe864585-0074-4683-9047-8a955ef8da28`::moving from state preparing -> state finished >Thread-135022::DEBUG::2014-10-29 11:03:40,205::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135022::DEBUG::2014-10-29 11:03:40,205::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135022::DEBUG::2014-10-29 11:03:40,206::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135022::DEBUG::2014-10-29 11:03:40,206::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135022::DEBUG::2014-10-29 11:03:40,206::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135022::DEBUG::2014-10-29 11:03:40,207::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135022::DEBUG::2014-10-29 11:03:40,207::task::993::Storage.TaskManager.Task::(_decref) Task=`fe864585-0074-4683-9047-8a955ef8da28`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:03:40,240::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53732 >Detector thread::DEBUG::2014-10-29 11:03:40,240::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53732 >Detector thread::DEBUG::2014-10-29 11:03:40,241::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53732 >Detector thread::DEBUG::2014-10-29 11:03:40,241::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53732) >Thread-135027::DEBUG::2014-10-29 11:03:40,280::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135027::DEBUG::2014-10-29 11:03:40,280::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6b32244-83a0-4241-8ba1-ed01810ff1b1`::moving from state init -> state preparing >Thread-135027::INFO::2014-10-29 11:03:40,281::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135027::INFO::2014-10-29 11:03:40,282::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527039', 'lastCheck': '6.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461754', 'lastCheck': '5.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000501321', 'lastCheck': '3.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000529589', 'lastCheck': '3.8', 'valid': True}} >Thread-135027::DEBUG::2014-10-29 11:03:40,282::task::1191::Storage.TaskManager.Task::(prepare) Task=`a6b32244-83a0-4241-8ba1-ed01810ff1b1`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527039', 'lastCheck': '6.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461754', 'lastCheck': '5.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000501321', 'lastCheck': '3.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000529589', 'lastCheck': '3.8', 'valid': True}} >Thread-135027::DEBUG::2014-10-29 11:03:40,282::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6b32244-83a0-4241-8ba1-ed01810ff1b1`::moving from state preparing -> state finished >Thread-135027::DEBUG::2014-10-29 11:03:40,282::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135027::DEBUG::2014-10-29 11:03:40,283::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135027::DEBUG::2014-10-29 11:03:40,283::task::993::Storage.TaskManager.Task::(_decref) Task=`a6b32244-83a0-4241-8ba1-ed01810ff1b1`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:03:40,459::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53733 >Detector thread::DEBUG::2014-10-29 11:03:40,468::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53733 >Detector thread::DEBUG::2014-10-29 11:03:40,468::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53733 >Detector thread::DEBUG::2014-10-29 11:03:40,469::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53733) >Thread-135028::DEBUG::2014-10-29 11:03:40,508::task::595::Storage.TaskManager.Task::(_updateState) Task=`1993d0f5-f8dc-4518-9dc5-d374635bfde0`::moving from state init -> state preparing >Thread-135028::INFO::2014-10-29 11:03:40,509::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135028::INFO::2014-10-29 11:03:40,509::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527039', 'lastCheck': '6.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461754', 'lastCheck': '6.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000501321', 'lastCheck': '4.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000529589', 'lastCheck': '4.1', 'valid': True}} >Thread-135028::DEBUG::2014-10-29 11:03:40,510::task::1191::Storage.TaskManager.Task::(prepare) Task=`1993d0f5-f8dc-4518-9dc5-d374635bfde0`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527039', 'lastCheck': '6.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461754', 'lastCheck': '6.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000501321', 'lastCheck': '4.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000529589', 'lastCheck': '4.1', 'valid': True}} >Thread-135028::DEBUG::2014-10-29 11:03:40,510::task::595::Storage.TaskManager.Task::(_updateState) Task=`1993d0f5-f8dc-4518-9dc5-d374635bfde0`::moving from state preparing -> state finished >Thread-135028::DEBUG::2014-10-29 11:03:40,510::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135028::DEBUG::2014-10-29 11:03:40,510::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135028::DEBUG::2014-10-29 11:03:40,511::task::993::Storage.TaskManager.Task::(_decref) Task=`1993d0f5-f8dc-4518-9dc5-d374635bfde0`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:40,759::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:40,762::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135029::DEBUG::2014-10-29 11:03:40,765::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:40,768::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:40,770::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135030::DEBUG::2014-10-29 11:03:40,775::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135030::DEBUG::2014-10-29 11:03:40,777::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:03:42,312::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e57827a-33c4-421c-82d0-99d03d7907b5`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:03:42,313::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:03:42,314::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:42,314::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:42,314::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:42,315::__init__::232::IOProcess::(_processLogs) (199005) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:03:42,316::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199005) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:42,318::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:42,318::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:42,319::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:42,319::__init__::232::IOProcess::(_processLogs) (199006) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:03:42,320::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199006) Queuing response >Thread-22::INFO::2014-10-29 11:03:42,321::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010855424', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:03:42,322::task::1191::Storage.TaskManager.Task::(prepare) Task=`8e57827a-33c4-421c-82d0-99d03d7907b5`::finished: {'truesize': '6010855424', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:03:42,322::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e57827a-33c4-421c-82d0-99d03d7907b5`::moving from state preparing -> state finished >Thread-22::DEBUG::2014-10-29 11:03:42,322::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-10-29 11:03:42,322::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2014-10-29 11:03:42,323::task::993::Storage.TaskManager.Task::(_decref) Task=`8e57827a-33c4-421c-82d0-99d03d7907b5`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:03:42,401::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:43,216::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:43,217::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:43,221::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:43,790::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:43,792::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135031::DEBUG::2014-10-29 11:03:43,795::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:43,797::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:43,799::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135032::DEBUG::2014-10-29 11:03:43,802::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135032::DEBUG::2014-10-29 11:03:43,804::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:03:44,089::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:44,090::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:44,090::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:44,090::__init__::232::IOProcess::(_processLogs) (199007) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:44,381::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:44,383::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:44,384::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:44,384::__init__::232::IOProcess::(_processLogs) (199008) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:44,797::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199007) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:44,798::__init__::232::IOProcess::(_processLogs) (199008) Queuing response >Thread-178::DEBUG::2014-10-29 11:03:44,803::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:03:44,823::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:03:44,825::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000517332 s, 982 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:03:44,845::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:44,845::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-33::DEBUG::2014-10-29 11:03:44,848::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00131216 s, 371 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:03:44,851::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:44,853::__init__::232::IOProcess::(_processLogs) (199009) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:44,853::__init__::232::IOProcess::(_processLogs) (199009) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:44,854::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:44,854::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:44,855::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:44,855::__init__::232::IOProcess::(_processLogs) (199010) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:44,858::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199010) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:44,858::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:44,859::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:44,859::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:44,859::__init__::232::IOProcess::(_processLogs) (199011) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:44,859::__init__::232::IOProcess::(_processLogs) (199011) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:44,860::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:44,861::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:44,862::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:44,862::__init__::232::IOProcess::(_processLogs) (199012) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:44,862::__init__::232::IOProcess::(_processLogs) (199012) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:44,862::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:44,864::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:44,864::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:44,864::__init__::232::IOProcess::(_processLogs) (199013) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:44,864::__init__::232::IOProcess::(_processLogs) (199013) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:44,865::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:44,866::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:44,866::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:44,867::__init__::232::IOProcess::(_processLogs) (199014) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:44,867::__init__::232::IOProcess::(_processLogs) (199014) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:44,867::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:44,868::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:44,868::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:44,869::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:44,869::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:44,869::__init__::232::IOProcess::(_processLogs) (199015) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:44,870::__init__::232::IOProcess::(_processLogs) (199015) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:44,870::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:44,870::__init__::232::IOProcess::(_processLogs) (199016) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:44,870::__init__::232::IOProcess::(_processLogs) (199016) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:46,438::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:46,440::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:46,441::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:46,442::__init__::232::IOProcess::(_processLogs) (199017) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:46,447::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199017) Queuing response >Thread-10269::DEBUG::2014-10-29 11:03:46,449::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:03:46,469::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000649447 s, 773 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:03:46,473::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:46,475::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:46,476::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:46,477::__init__::232::IOProcess::(_processLogs) (199018) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:46,482::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199018) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:46,500::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:46,501::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:46,508::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-179::DEBUG::2014-10-29 11:03:46,510::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:03:46,510::__init__::232::IOProcess::(_processLogs) (199019) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:46,529::__init__::232::IOProcess::(_processLogs) (199019) Queuing response >Thread-179::DEBUG::2014-10-29 11:03:46,532::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000944209 s, 394 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:03:46,537::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:46,538::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:46,540::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:46,541::__init__::232::IOProcess::(_processLogs) (199020) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:46,547::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199020) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:46,819::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:46,825::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135033::DEBUG::2014-10-29 11:03:46,834::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:46,839::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:46,844::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135034::DEBUG::2014-10-29 11:03:46,851::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135034::DEBUG::2014-10-29 11:03:46,866::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:48,228::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:48,229::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:48,231::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:03:49,005::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53734 >Detector thread::DEBUG::2014-10-29 11:03:49,005::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53734 >Detector thread::DEBUG::2014-10-29 11:03:49,005::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53734 >Detector thread::DEBUG::2014-10-29 11:03:49,006::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53734) >Thread-135035::DEBUG::2014-10-29 11:03:49,045::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135035::DEBUG::2014-10-29 11:03:49,047::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135035::DEBUG::2014-10-29 11:03:49,077::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135035::DEBUG::2014-10-29 11:03:49,121::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '28', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '28', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:03:49,879::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53735 >Detector thread::DEBUG::2014-10-29 11:03:49,880::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53735 >Detector thread::DEBUG::2014-10-29 11:03:49,881::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53735 >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:49,882::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Detector thread::DEBUG::2014-10-29 11:03:49,884::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53735) >JsonRpcServer::DEBUG::2014-10-29 11:03:49,892::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135037::DEBUG::2014-10-29 11:03:49,896::task::595::Storage.TaskManager.Task::(_updateState) Task=`3ef8a8ec-3002-4450-8e7a-526baf8d0c60`::moving from state init -> state preparing >Thread-135037::INFO::2014-10-29 11:03:49,897::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135037::INFO::2014-10-29 11:03:49,897::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517332', 'lastCheck': '5.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00131216', 'lastCheck': '5.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000944209', 'lastCheck': '3.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000649447', 'lastCheck': '3.4', 'valid': True}} >Thread-135037::DEBUG::2014-10-29 11:03:49,898::task::1191::Storage.TaskManager.Task::(prepare) Task=`3ef8a8ec-3002-4450-8e7a-526baf8d0c60`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517332', 'lastCheck': '5.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00131216', 'lastCheck': '5.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000944209', 'lastCheck': '3.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000649447', 'lastCheck': '3.4', 'valid': True}} >Thread-135037::DEBUG::2014-10-29 11:03:49,898::task::595::Storage.TaskManager.Task::(_updateState) Task=`3ef8a8ec-3002-4450-8e7a-526baf8d0c60`::moving from state preparing -> state finished >Thread-135037::DEBUG::2014-10-29 11:03:49,898::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135037::DEBUG::2014-10-29 11:03:49,898::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135037::DEBUG::2014-10-29 11:03:49,899::task::993::Storage.TaskManager.Task::(_decref) Task=`3ef8a8ec-3002-4450-8e7a-526baf8d0c60`::ref 0 aborting False >Thread-135036::DEBUG::2014-10-29 11:03:49,921::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135036::DEBUG::2014-10-29 11:03:49,925::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135036::DEBUG::2014-10-29 11:03:49,928::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.98', 'elapsedTime': '513262', 'displayType': 'vnc', 'cpuSys': '0.66', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '60534143', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '63825', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '30213.44'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.52', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-135037::DEBUG::2014-10-29 11:03:49,941::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:49,968::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:49,970::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135038::DEBUG::2014-10-29 11:03:49,974::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135038::DEBUG::2014-10-29 11:03:49,976::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:03:50,596::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53737 >Detector thread::DEBUG::2014-10-29 11:03:50,596::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53737 >Detector thread::DEBUG::2014-10-29 11:03:50,597::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53737 >Detector thread::DEBUG::2014-10-29 11:03:50,597::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53737) >Thread-135039::DEBUG::2014-10-29 11:03:50,638::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ef9af29-6555-44a1-baa6-4708a450255c`::moving from state init -> state preparing >Thread-135039::INFO::2014-10-29 11:03:50,639::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135039::INFO::2014-10-29 11:03:50,639::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517332', 'lastCheck': '5.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00131216', 'lastCheck': '5.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000944209', 'lastCheck': '4.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000649447', 'lastCheck': '4.2', 'valid': True}} >Thread-135039::DEBUG::2014-10-29 11:03:50,639::task::1191::Storage.TaskManager.Task::(prepare) Task=`9ef9af29-6555-44a1-baa6-4708a450255c`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517332', 'lastCheck': '5.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00131216', 'lastCheck': '5.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000944209', 'lastCheck': '4.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000649447', 'lastCheck': '4.2', 'valid': True}} >Thread-135039::DEBUG::2014-10-29 11:03:50,640::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ef9af29-6555-44a1-baa6-4708a450255c`::moving from state preparing -> state finished >Thread-135039::DEBUG::2014-10-29 11:03:50,640::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135039::DEBUG::2014-10-29 11:03:50,640::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135039::DEBUG::2014-10-29 11:03:50,640::task::993::Storage.TaskManager.Task::(_decref) Task=`9ef9af29-6555-44a1-baa6-4708a450255c`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:53,047::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:53,049::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135040::DEBUG::2014-10-29 11:03:53,052::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:53,054::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:53,056::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135041::DEBUG::2014-10-29 11:03:53,059::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135041::DEBUG::2014-10-29 11:03:53,061::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:53,234::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:53,235::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:53,238::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:03:53,653::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53739 >Detector thread::DEBUG::2014-10-29 11:03:53,653::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53739 >Detector thread::DEBUG::2014-10-29 11:03:53,654::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53739 >Detector thread::DEBUG::2014-10-29 11:03:53,654::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53739) >Thread-135042::DEBUG::2014-10-29 11:03:53,694::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135042::DEBUG::2014-10-29 11:03:53,695::task::595::Storage.TaskManager.Task::(_updateState) Task=`566b4cf3-cc0d-4e7b-89a7-60398e870194`::moving from state init -> state preparing >Thread-135042::INFO::2014-10-29 11:03:53,695::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135042::DEBUG::2014-10-29 11:03:53,698::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:03:53,699::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:53,700::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:53,700::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:53,700::__init__::232::IOProcess::(_processLogs) (199021) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:03:53,702::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199021) Queuing response >Thread-135042::DEBUG::2014-10-29 11:03:53,703::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135042::DEBUG::2014-10-29 11:03:53,703::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135042::INFO::2014-10-29 11:03:53,703::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135042::DEBUG::2014-10-29 11:03:53,704::task::1191::Storage.TaskManager.Task::(prepare) Task=`566b4cf3-cc0d-4e7b-89a7-60398e870194`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135042::DEBUG::2014-10-29 11:03:53,704::task::595::Storage.TaskManager.Task::(_updateState) Task=`566b4cf3-cc0d-4e7b-89a7-60398e870194`::moving from state preparing -> state finished >Thread-135042::DEBUG::2014-10-29 11:03:53,704::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135042::DEBUG::2014-10-29 11:03:53,704::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135042::DEBUG::2014-10-29 11:03:53,705::task::993::Storage.TaskManager.Task::(_decref) Task=`566b4cf3-cc0d-4e7b-89a7-60398e870194`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:03:53,748::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53740 >Detector thread::DEBUG::2014-10-29 11:03:53,749::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53740 >Detector thread::DEBUG::2014-10-29 11:03:53,749::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53740 >Detector thread::DEBUG::2014-10-29 11:03:53,750::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53740) >Thread-135043::DEBUG::2014-10-29 11:03:53,788::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135043::DEBUG::2014-10-29 11:03:53,789::task::595::Storage.TaskManager.Task::(_updateState) Task=`81880881-17d0-4c5a-ab61-49dfee1a28ba`::moving from state init -> state preparing >Thread-135043::INFO::2014-10-29 11:03:53,789::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135043::DEBUG::2014-10-29 11:03:53,790::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135043::DEBUG::2014-10-29 11:03:53,790::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135043::DEBUG::2014-10-29 11:03:53,790::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135043::DEBUG::2014-10-29 11:03:53,790::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135043::DEBUG::2014-10-29 11:03:53,791::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135043::DEBUG::2014-10-29 11:03:53,791::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135043::DEBUG::2014-10-29 11:03:53,870::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135043::DEBUG::2014-10-29 11:03:53,871::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135043::DEBUG::2014-10-29 11:03:54,039::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135043::DEBUG::2014-10-29 11:03:54,040::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135043::DEBUG::2014-10-29 11:03:54,041::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135043::DEBUG::2014-10-29 11:03:54,041::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135043::DEBUG::2014-10-29 11:03:54,042::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135043::DEBUG::2014-10-29 11:03:54,042::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135043::DEBUG::2014-10-29 11:03:54,042::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135043::DEBUG::2014-10-29 11:03:54,043::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:03:54,050::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:54,051::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:54,051::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:54,051::__init__::232::IOProcess::(_processLogs) (199022) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:03:54,053::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:54,053::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:54,053::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:54,054::__init__::232::IOProcess::(_processLogs) (199023) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:03:54,054::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:54,054::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:54,055::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:54,055::__init__::232::IOProcess::(_processLogs) (199024) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:03:54,055::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:54,055::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:54,056::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:54,056::__init__::232::IOProcess::(_processLogs) (199025) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:03:54,874::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:54,874::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:54,875::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:54,875::__init__::232::IOProcess::(_processLogs) (199026) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:55,308::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199026) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:55,308::__init__::232::IOProcess::(_processLogs) (199025) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:55,310::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199023) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:55,312::__init__::232::IOProcess::(_processLogs) (199024) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:55,313::__init__::232::IOProcess::(_processLogs) (199022) Queuing response >Thread-178::DEBUG::2014-10-29 11:03:55,313::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:03:55,338::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000465837 s, 1.1 MB/s\n'; <rc> = 0 >Thread-135043::DEBUG::2014-10-29 11:03:55,347::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:03:55,350::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:55,350::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:55,350::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:55,350::__init__::232::IOProcess::(_processLogs) (199027) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:55,351::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:55,351::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:55,351::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:55,351::__init__::232::IOProcess::(_processLogs) (199028) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:03:55,353::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199027) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:55,355::__init__::232::IOProcess::(_processLogs) (199028) Queuing response >Thread-135043::DEBUG::2014-10-29 11:03:55,356::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:03:55,357::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:55,358::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:55,358::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:55,359::__init__::232::IOProcess::(_processLogs) (199029) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:55,360::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199029) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:55,361::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:55,361::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:55,361::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:55,361::__init__::232::IOProcess::(_processLogs) (199030) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:03:55,362::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:55,362::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:55,362::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:55,363::__init__::232::IOProcess::(_processLogs) (199031) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:55,365::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199031) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:55,366::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199030) Queuing response >Thread-135043::DEBUG::2014-10-29 11:03:55,367::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:03:55,369::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:55,370::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:55,371::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:55,372::__init__::232::IOProcess::(_processLogs) (199032) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:55,373::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199032) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:55,374::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:55,374::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:55,376::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:55,376::__init__::232::IOProcess::(_processLogs) (199033) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:55,376::__init__::232::IOProcess::(_processLogs) (199033) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:55,377::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:55,377::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-135043::DEBUG::2014-10-29 11:03:55,378::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:03:55,378::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-135043::INFO::2014-10-29 11:03:55,379::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135043::INFO::2014-10-29 11:03:55,380::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:03:55,381::__init__::232::IOProcess::(_processLogs) (199034) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:03:55,382::__init__::232::IOProcess::(_processLogs) (199034) Queuing response >Thread-135043::INFO::2014-10-29 11:03:55,382::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:03:55,384::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:55,385::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:55,385::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:55,385::__init__::232::IOProcess::(_processLogs) (199035) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:55,387::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199035) Queuing response >Thread-33::DEBUG::2014-10-29 11:03:55,388::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:03:55,404::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:55,406::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:55,407::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-33::DEBUG::2014-10-29 11:03:55,407::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000569516 s, 855 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:03:55,409::__init__::232::IOProcess::(_processLogs) (199036) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:03:55,411::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199036) Queuing response >Thread-135043::DEBUG::2014-10-29 11:03:55,411::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:03:55,413::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:55,415::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:55,416::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:55,421::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199037) Got request for method 'statvfs' >Thread-135043::DEBUG::2014-10-29 11:03:55,423::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`add902db-665c-4db9-8443-a929b836e93f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135043::DEBUG::2014-10-29 11:03:55,424::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-17::DEBUG::2014-10-29 11:03:55,424::__init__::232::IOProcess::(_processLogs) (199037) Queuing response >Thread-135043::DEBUG::2014-10-29 11:03:55,426::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135043::DEBUG::2014-10-29 11:03:55,427::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`add902db-665c-4db9-8443-a929b836e93f`::Granted request >Thread-17::DEBUG::2014-10-29 11:03:55,428::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-135043::DEBUG::2014-10-29 11:03:55,430::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`81880881-17d0-4c5a-ab61-49dfee1a28ba`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135043::DEBUG::2014-10-29 11:03:55,431::task::993::Storage.TaskManager.Task::(_decref) Task=`81880881-17d0-4c5a-ab61-49dfee1a28ba`::ref 1 aborting False >Thread-17::DEBUG::2014-10-29 11:03:55,431::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:55,433::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:55,439::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199038) Got request for method 'access' >Thread-135043::INFO::2014-10-29 11:03:55,441::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135043::DEBUG::2014-10-29 11:03:55,442::task::1191::Storage.TaskManager.Task::(prepare) Task=`81880881-17d0-4c5a-ab61-49dfee1a28ba`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-17::DEBUG::2014-10-29 11:03:55,442::__init__::232::IOProcess::(_processLogs) (199038) Queuing response >Thread-135043::DEBUG::2014-10-29 11:03:55,443::task::595::Storage.TaskManager.Task::(_updateState) Task=`81880881-17d0-4c5a-ab61-49dfee1a28ba`::moving from state preparing -> state finished >Thread-135043::DEBUG::2014-10-29 11:03:55,444::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135043::DEBUG::2014-10-29 11:03:55,445::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135043::DEBUG::2014-10-29 11:03:55,446::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-17::DEBUG::2014-10-29 11:03:55,447::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-135043::DEBUG::2014-10-29 11:03:55,448::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135043::DEBUG::2014-10-29 11:03:55,449::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-17::DEBUG::2014-10-29 11:03:55,449::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-135043::DEBUG::2014-10-29 11:03:55,450::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-17::DEBUG::2014-10-29 11:03:55,451::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-135043::DEBUG::2014-10-29 11:03:55,452::task::993::Storage.TaskManager.Task::(_decref) Task=`81880881-17d0-4c5a-ab61-49dfee1a28ba`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:03:55,453::__init__::232::IOProcess::(_processLogs) (199039) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:55,458::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199039) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:55,459::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:55,459::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:55,460::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:55,460::__init__::232::IOProcess::(_processLogs) (199040) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:03:55,460::__init__::232::IOProcess::(_processLogs) (199040) Queuing response >Detector thread::DEBUG::2014-10-29 11:03:55,478::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53741 >Detector thread::DEBUG::2014-10-29 11:03:55,479::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53741 >Detector thread::DEBUG::2014-10-29 11:03:55,479::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53741 >Detector thread::DEBUG::2014-10-29 11:03:55,480::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53741) >Thread-135048::DEBUG::2014-10-29 11:03:55,518::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135048::DEBUG::2014-10-29 11:03:55,519::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f81640a-8ed4-4ca0-b7ac-be07383ba53d`::moving from state init -> state preparing >Thread-135048::INFO::2014-10-29 11:03:55,519::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135048::INFO::2014-10-29 11:03:55,520::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000465837', 'lastCheck': '0.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569516', 'lastCheck': '0.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000944209', 'lastCheck': '9.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000649447', 'lastCheck': '9.0', 'valid': True}} >Thread-135048::DEBUG::2014-10-29 11:03:55,520::task::1191::Storage.TaskManager.Task::(prepare) Task=`4f81640a-8ed4-4ca0-b7ac-be07383ba53d`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000465837', 'lastCheck': '0.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569516', 'lastCheck': '0.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000944209', 'lastCheck': '9.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000649447', 'lastCheck': '9.0', 'valid': True}} >Thread-135048::DEBUG::2014-10-29 11:03:55,520::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f81640a-8ed4-4ca0-b7ac-be07383ba53d`::moving from state preparing -> state finished >Thread-135048::DEBUG::2014-10-29 11:03:55,521::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135048::DEBUG::2014-10-29 11:03:55,521::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135048::DEBUG::2014-10-29 11:03:55,521::task::993::Storage.TaskManager.Task::(_decref) Task=`4f81640a-8ed4-4ca0-b7ac-be07383ba53d`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:56,315::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:56,318::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135049::DEBUG::2014-10-29 11:03:56,321::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:56,323::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:56,325::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135050::DEBUG::2014-10-29 11:03:56,328::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135050::DEBUG::2014-10-29 11:03:56,331::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:03:56,485::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:56,486::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:56,486::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:56,486::__init__::232::IOProcess::(_processLogs) (199041) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:56,489::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199041) Queuing response >Thread-10269::DEBUG::2014-10-29 11:03:56,490::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:03:56,509::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00109471 s, 459 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:03:56,511::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:56,511::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:56,512::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:56,512::__init__::232::IOProcess::(_processLogs) (199042) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:56,514::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199042) Queuing response >Thread-17::DEBUG::2014-10-29 11:03:56,550::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:56,551::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:56,552::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-179::DEBUG::2014-10-29 11:03:56,553::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:03:56,554::__init__::232::IOProcess::(_processLogs) (199043) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:56,569::__init__::232::IOProcess::(_processLogs) (199043) Queuing response >Thread-179::DEBUG::2014-10-29 11:03:56,574::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00164127 s, 227 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:03:56,575::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:03:56,576::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:03:56,576::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:03:56,576::__init__::232::IOProcess::(_processLogs) (199044) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:03:56,578::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199044) Queuing response >Thread-22::DEBUG::2014-10-29 11:03:57,424::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:58,245::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:58,246::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:03:58,248::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:03:59,181::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53742 >Detector thread::DEBUG::2014-10-29 11:03:59,182::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53742 >Detector thread::DEBUG::2014-10-29 11:03:59,182::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53742 >Detector thread::DEBUG::2014-10-29 11:03:59,183::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53742) >Thread-135051::DEBUG::2014-10-29 11:03:59,221::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135051::DEBUG::2014-10-29 11:03:59,223::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135051::DEBUG::2014-10-29 11:03:59,241::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135051::DEBUG::2014-10-29 11:03:59,288::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '12', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '12', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:59,346::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:59,348::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135052::DEBUG::2014-10-29 11:03:59,352::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:03:59,355::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:03:59,357::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135053::DEBUG::2014-10-29 11:03:59,360::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135053::DEBUG::2014-10-29 11:03:59,362::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:04:00,091::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53743 >Detector thread::DEBUG::2014-10-29 11:04:00,092::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53743 >Detector thread::DEBUG::2014-10-29 11:04:00,092::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53743 >Detector thread::DEBUG::2014-10-29 11:04:00,093::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53743) >Thread-135054::DEBUG::2014-10-29 11:04:00,131::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135054::DEBUG::2014-10-29 11:04:00,133::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135054::DEBUG::2014-10-29 11:04:00,133::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.62', 'elapsedTime': '513272', 'displayType': 'vnc', 'cpuSys': '0.60', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '60534143', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '63825', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '30213.44'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.71', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:04:00,411::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53745 >Detector thread::DEBUG::2014-10-29 11:04:00,412::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53745 >Detector thread::DEBUG::2014-10-29 11:04:00,412::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53745 >Detector thread::DEBUG::2014-10-29 11:04:00,412::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53745) >Thread-135055::DEBUG::2014-10-29 11:04:00,453::task::595::Storage.TaskManager.Task::(_updateState) Task=`cebc0e7e-80eb-444d-9350-f3ed4d587334`::moving from state init -> state preparing >Thread-135055::INFO::2014-10-29 11:04:00,454::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135055::INFO::2014-10-29 11:04:00,454::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000465837', 'lastCheck': '5.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569516', 'lastCheck': '5.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00164127', 'lastCheck': '3.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109471', 'lastCheck': '3.9', 'valid': True}} >Thread-135055::DEBUG::2014-10-29 11:04:00,455::task::1191::Storage.TaskManager.Task::(prepare) Task=`cebc0e7e-80eb-444d-9350-f3ed4d587334`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000465837', 'lastCheck': '5.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569516', 'lastCheck': '5.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00164127', 'lastCheck': '3.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109471', 'lastCheck': '3.9', 'valid': True}} >Thread-135055::DEBUG::2014-10-29 11:04:00,455::task::595::Storage.TaskManager.Task::(_updateState) Task=`cebc0e7e-80eb-444d-9350-f3ed4d587334`::moving from state preparing -> state finished >Thread-135055::DEBUG::2014-10-29 11:04:00,455::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135055::DEBUG::2014-10-29 11:04:00,455::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135055::DEBUG::2014-10-29 11:04:00,456::task::993::Storage.TaskManager.Task::(_decref) Task=`cebc0e7e-80eb-444d-9350-f3ed4d587334`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:02,376::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:02,379::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135056::DEBUG::2014-10-29 11:04:02,382::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:02,384::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:02,386::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135057::DEBUG::2014-10-29 11:04:02,389::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135057::DEBUG::2014-10-29 11:04:02,391::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:04:02,937::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:03,252::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:03,253::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:03,254::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:04:05,377::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:05,379::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:05,381::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-178::DEBUG::2014-10-29 11:04:05,381::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:04:05,382::__init__::232::IOProcess::(_processLogs) (199045) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:05,400::__init__::232::IOProcess::(_processLogs) (199045) Queuing response >Thread-178::DEBUG::2014-10-29 11:04:05,402::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000618416 s, 821 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:04:05,403::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:05,404::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:05,404::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:05,404::__init__::232::IOProcess::(_processLogs) (199046) Got request for method 'statvfs' >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:05,407::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-17::DEBUG::2014-10-29 11:04:05,410::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199046) Queuing response >JsonRpcServer::DEBUG::2014-10-29 11:04:05,415::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:04:05,416::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:05,419::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:05,421::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:05,424::__init__::232::IOProcess::(_processLogs) (199047) Got request for method 'access' >Thread-135058::DEBUG::2014-10-29 11:04:05,429::task::595::Storage.TaskManager.Task::(_updateState) Task=`61cb0a8c-a2fb-4a52-8092-3a1867246ce3`::moving from state init -> state preparing >Thread-17::DEBUG::2014-10-29 11:04:05,430::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199047) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:05,433::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-135058::INFO::2014-10-29 11:04:05,434::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-17::DEBUG::2014-10-29 11:04:05,434::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:05,436::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-135058::INFO::2014-10-29 11:04:05,438::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000465837', 'lastCheck': '10.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569516', 'lastCheck': '10.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00164127', 'lastCheck': '8.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109471', 'lastCheck': '8.9', 'valid': True}} >Thread-17::DEBUG::2014-10-29 11:04:05,438::__init__::232::IOProcess::(_processLogs) (199048) Got request for method 'access' >Thread-135058::DEBUG::2014-10-29 11:04:05,439::task::1191::Storage.TaskManager.Task::(prepare) Task=`61cb0a8c-a2fb-4a52-8092-3a1867246ce3`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000465837', 'lastCheck': '10.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569516', 'lastCheck': '10.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00164127', 'lastCheck': '8.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00109471', 'lastCheck': '8.9', 'valid': True}} >Thread-17::DEBUG::2014-10-29 11:04:05,440::__init__::232::IOProcess::(_processLogs) (199048) Queuing response >Thread-135058::DEBUG::2014-10-29 11:04:05,440::task::595::Storage.TaskManager.Task::(_updateState) Task=`61cb0a8c-a2fb-4a52-8092-3a1867246ce3`::moving from state preparing -> state finished >Thread-135058::DEBUG::2014-10-29 11:04:05,442::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17::DEBUG::2014-10-29 11:04:05,443::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-135058::DEBUG::2014-10-29 11:04:05,443::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17::DEBUG::2014-10-29 11:04:05,444::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-135058::DEBUG::2014-10-29 11:04:05,445::task::993::Storage.TaskManager.Task::(_decref) Task=`61cb0a8c-a2fb-4a52-8092-3a1867246ce3`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:04:05,445::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:05,447::__init__::232::IOProcess::(_processLogs) (199049) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:05,450::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199049) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:05,462::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:05,462::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:05,463::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:05,463::__init__::232::IOProcess::(_processLogs) (199050) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:05,464::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199050) Queuing response >Thread-33::DEBUG::2014-10-29 11:04:05,468::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:04:05,488::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00170585 s, 285 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:04:05,491::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:05,494::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:05,496::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:05,496::__init__::232::IOProcess::(_processLogs) (199051) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:05,497::__init__::232::IOProcess::(_processLogs) (199051) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:05,497::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:05,498::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:05,499::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:05,499::__init__::232::IOProcess::(_processLogs) (199052) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:05,499::__init__::232::IOProcess::(_processLogs) (199052) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:05,500::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:05,501::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:05,501::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:05,501::__init__::232::IOProcess::(_processLogs) (199053) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:05,502::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199053) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:05,503::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:05,504::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:05,509::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:05,512::__init__::232::IOProcess::(_processLogs) (199054) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:05,514::__init__::232::IOProcess::(_processLogs) (199054) Queuing response >Thread-135058::DEBUG::2014-10-29 11:04:05,519::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:05,542::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:05,545::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135059::DEBUG::2014-10-29 11:04:05,549::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135059::DEBUG::2014-10-29 11:04:05,551::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:04:06,517::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:06,517::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:06,518::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:06,518::__init__::232::IOProcess::(_processLogs) (199055) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:06,581::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:06,581::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:06,581::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:06,581::__init__::232::IOProcess::(_processLogs) (199056) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:06,793::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199055) Queuing response >Thread-10269::DEBUG::2014-10-29 11:04:06,797::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:04:06,816::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199056) Queuing response >Thread-179::DEBUG::2014-10-29 11:04:06,819::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:04:06,820::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000456893 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:04:06,842::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-179::DEBUG::2014-10-29 11:04:06,843::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000600193 s, 620 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:04:06,847::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:06,849::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:06,850::__init__::232::IOProcess::(_processLogs) (199057) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:06,850::__init__::232::IOProcess::(_processLogs) (199057) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:06,850::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:06,851::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:06,852::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:06,853::__init__::232::IOProcess::(_processLogs) (199058) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:06,854::__init__::232::IOProcess::(_processLogs) (199058) Queuing response >Detector thread::DEBUG::2014-10-29 11:04:07,159::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53747 >Detector thread::DEBUG::2014-10-29 11:04:07,161::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53747 >Detector thread::DEBUG::2014-10-29 11:04:07,161::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53747 >Detector thread::DEBUG::2014-10-29 11:04:07,162::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53747) >Thread-135060::DEBUG::2014-10-29 11:04:07,201::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135060::DEBUG::2014-10-29 11:04:07,202::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d3bd9cd-4244-458e-8bd8-751a68d76ad3`::moving from state init -> state preparing >Thread-135060::INFO::2014-10-29 11:04:07,202::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135060::DEBUG::2014-10-29 11:04:07,205::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:04:07,206::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:07,206::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:07,206::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:07,207::__init__::232::IOProcess::(_processLogs) (199059) Got request for method 'glob' >Thread-135060::DEBUG::2014-10-29 11:04:07,208::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:04:07,208::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199059) Queuing response >Thread-135060::DEBUG::2014-10-29 11:04:07,209::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135060::INFO::2014-10-29 11:04:07,210::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135060::DEBUG::2014-10-29 11:04:07,210::task::1191::Storage.TaskManager.Task::(prepare) Task=`3d3bd9cd-4244-458e-8bd8-751a68d76ad3`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135060::DEBUG::2014-10-29 11:04:07,210::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d3bd9cd-4244-458e-8bd8-751a68d76ad3`::moving from state preparing -> state finished >Thread-135060::DEBUG::2014-10-29 11:04:07,211::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135060::DEBUG::2014-10-29 11:04:07,211::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135060::DEBUG::2014-10-29 11:04:07,211::task::993::Storage.TaskManager.Task::(_decref) Task=`3d3bd9cd-4244-458e-8bd8-751a68d76ad3`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:04:07,254::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53748 >Detector thread::DEBUG::2014-10-29 11:04:07,255::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53748 >Detector thread::DEBUG::2014-10-29 11:04:07,255::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53748 >Detector thread::DEBUG::2014-10-29 11:04:07,256::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53748) >Thread-135061::DEBUG::2014-10-29 11:04:07,295::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135061::DEBUG::2014-10-29 11:04:07,295::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e337556-a011-44eb-a086-b29791a026b0`::moving from state init -> state preparing >Thread-135061::INFO::2014-10-29 11:04:07,296::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135061::DEBUG::2014-10-29 11:04:07,296::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135061::DEBUG::2014-10-29 11:04:07,296::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135061::DEBUG::2014-10-29 11:04:07,297::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135061::DEBUG::2014-10-29 11:04:07,297::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135061::DEBUG::2014-10-29 11:04:07,297::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135061::DEBUG::2014-10-29 11:04:07,298::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135061::DEBUG::2014-10-29 11:04:07,378::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135061::DEBUG::2014-10-29 11:04:07,379::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135061::DEBUG::2014-10-29 11:04:07,570::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135061::DEBUG::2014-10-29 11:04:07,571::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135061::DEBUG::2014-10-29 11:04:07,572::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135061::DEBUG::2014-10-29 11:04:07,572::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135061::DEBUG::2014-10-29 11:04:07,573::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135061::DEBUG::2014-10-29 11:04:07,573::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135061::DEBUG::2014-10-29 11:04:07,573::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135061::DEBUG::2014-10-29 11:04:07,574::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:04:07,581::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:07,583::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:07,584::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:07,584::__init__::232::IOProcess::(_processLogs) (199060) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:04:07,585::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199060) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:07,587::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:07,588::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:07,588::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:07,588::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:07,589::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:07,589::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:07,589::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:07,589::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:07,590::__init__::232::IOProcess::(_processLogs) (199062) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:04:07,590::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:07,590::__init__::232::IOProcess::(_processLogs) (199063) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:04:07,590::__init__::232::IOProcess::(_processLogs) (199061) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:04:07,591::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199062) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:07,592::__init__::232::IOProcess::(_processLogs) (199063) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:07,593::__init__::232::IOProcess::(_processLogs) (199061) Queuing response >Thread-135061::DEBUG::2014-10-29 11:04:07,599::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:04:07,600::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:07,600::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:07,600::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:07,601::__init__::232::IOProcess::(_processLogs) (199064) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:04:07,611::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199064) Queuing response >Thread-135061::DEBUG::2014-10-29 11:04:07,612::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:04:07,613::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:07,613::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:07,614::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:07,614::__init__::232::IOProcess::(_processLogs) (199065) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:04:07,614::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199065) Queuing response >Thread-135061::DEBUG::2014-10-29 11:04:07,615::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:04:07,616::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:07,616::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:07,617::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:07,618::__init__::232::IOProcess::(_processLogs) (199066) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:07,618::__init__::232::IOProcess::(_processLogs) (199066) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:07,619::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:07,619::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-135061::DEBUG::2014-10-29 11:04:07,620::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:04:07,620::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-135061::INFO::2014-10-29 11:04:07,621::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:04:07,622::__init__::232::IOProcess::(_processLogs) (199067) Got request for method 'glob' >Thread-135061::INFO::2014-10-29 11:04:07,622::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:04:07,623::__init__::232::IOProcess::(_processLogs) (199067) Queuing response >Thread-135061::INFO::2014-10-29 11:04:07,624::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:04:07,625::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:07,625::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:07,626::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:07,626::__init__::232::IOProcess::(_processLogs) (199068) Got request for method 'readfile' >Thread-135061::DEBUG::2014-10-29 11:04:07,627::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:04:07,627::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199068) Queuing response >Thread-135061::DEBUG::2014-10-29 11:04:07,630::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`f34631b6-c4d6-4f42-a8cc-568000ef329e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135061::DEBUG::2014-10-29 11:04:07,630::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135061::DEBUG::2014-10-29 11:04:07,631::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135061::DEBUG::2014-10-29 11:04:07,631::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`f34631b6-c4d6-4f42-a8cc-568000ef329e`::Granted request >Thread-135061::DEBUG::2014-10-29 11:04:07,631::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9e337556-a011-44eb-a086-b29791a026b0`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135061::DEBUG::2014-10-29 11:04:07,632::task::993::Storage.TaskManager.Task::(_decref) Task=`9e337556-a011-44eb-a086-b29791a026b0`::ref 1 aborting False >Thread-135061::INFO::2014-10-29 11:04:07,634::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135061::DEBUG::2014-10-29 11:04:07,635::task::1191::Storage.TaskManager.Task::(prepare) Task=`9e337556-a011-44eb-a086-b29791a026b0`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135061::DEBUG::2014-10-29 11:04:07,635::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e337556-a011-44eb-a086-b29791a026b0`::moving from state preparing -> state finished >Thread-135061::DEBUG::2014-10-29 11:04:07,635::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135061::DEBUG::2014-10-29 11:04:07,636::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135061::DEBUG::2014-10-29 11:04:07,636::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135061::DEBUG::2014-10-29 11:04:07,636::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135061::DEBUG::2014-10-29 11:04:07,637::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135061::DEBUG::2014-10-29 11:04:07,637::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135061::DEBUG::2014-10-29 11:04:07,637::task::993::Storage.TaskManager.Task::(_decref) Task=`9e337556-a011-44eb-a086-b29791a026b0`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:04:07,657::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53749 >Detector thread::DEBUG::2014-10-29 11:04:07,658::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53749 >Detector thread::DEBUG::2014-10-29 11:04:07,658::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53749 >Detector thread::DEBUG::2014-10-29 11:04:07,659::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53749) >Thread-135066::DEBUG::2014-10-29 11:04:07,697::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135066::DEBUG::2014-10-29 11:04:07,697::task::595::Storage.TaskManager.Task::(_updateState) Task=`5484683c-66cb-4e05-b06b-d6748c9c65c3`::moving from state init -> state preparing >Thread-135066::INFO::2014-10-29 11:04:07,698::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135066::INFO::2014-10-29 11:04:07,698::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618416', 'lastCheck': '2.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00170585', 'lastCheck': '2.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000600193', 'lastCheck': '0.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000456893', 'lastCheck': '0.8', 'valid': True}} >Thread-135066::DEBUG::2014-10-29 11:04:07,699::task::1191::Storage.TaskManager.Task::(prepare) Task=`5484683c-66cb-4e05-b06b-d6748c9c65c3`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618416', 'lastCheck': '2.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00170585', 'lastCheck': '2.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000600193', 'lastCheck': '0.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000456893', 'lastCheck': '0.8', 'valid': True}} >Thread-135066::DEBUG::2014-10-29 11:04:07,699::task::595::Storage.TaskManager.Task::(_updateState) Task=`5484683c-66cb-4e05-b06b-d6748c9c65c3`::moving from state preparing -> state finished >Thread-135066::DEBUG::2014-10-29 11:04:07,699::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135066::DEBUG::2014-10-29 11:04:07,699::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135066::DEBUG::2014-10-29 11:04:07,700::task::993::Storage.TaskManager.Task::(_decref) Task=`5484683c-66cb-4e05-b06b-d6748c9c65c3`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:08,263::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:08,264::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:08,267::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:04:08,345::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53750 >Detector thread::DEBUG::2014-10-29 11:04:08,345::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53750 >Detector thread::DEBUG::2014-10-29 11:04:08,346::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53750 >Detector thread::DEBUG::2014-10-29 11:04:08,346::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53750) >Thread-135067::DEBUG::2014-10-29 11:04:08,385::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135067::DEBUG::2014-10-29 11:04:08,387::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135067::DEBUG::2014-10-29 11:04:08,409::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135067::DEBUG::2014-10-29 11:04:08,461::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '95', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '95', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:08,621::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:08,624::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135068::DEBUG::2014-10-29 11:04:08,627::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:08,630::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:08,632::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135069::DEBUG::2014-10-29 11:04:08,635::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135069::DEBUG::2014-10-29 11:04:08,638::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:04:09,291::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53751 >Detector thread::DEBUG::2014-10-29 11:04:09,292::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53751 >Detector thread::DEBUG::2014-10-29 11:04:09,292::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53751 >Detector thread::DEBUG::2014-10-29 11:04:09,293::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53751) >Thread-135070::DEBUG::2014-10-29 11:04:09,331::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135070::DEBUG::2014-10-29 11:04:09,333::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135070::DEBUG::2014-10-29 11:04:09,333::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.62', 'elapsedTime': '513281', 'displayType': 'vnc', 'cpuSys': '0.60', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '60534143', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '63825', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '30213.44'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.91', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:04:10,527::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53753 >Detector thread::DEBUG::2014-10-29 11:04:10,528::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53753 >Detector thread::DEBUG::2014-10-29 11:04:10,528::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53753 >Detector thread::DEBUG::2014-10-29 11:04:10,529::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53753) >Thread-135071::DEBUG::2014-10-29 11:04:10,568::task::595::Storage.TaskManager.Task::(_updateState) Task=`2af94a72-df44-4f9f-8650-364c31f1a58f`::moving from state init -> state preparing >Thread-135071::INFO::2014-10-29 11:04:10,569::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135071::INFO::2014-10-29 11:04:10,569::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618416', 'lastCheck': '5.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00170585', 'lastCheck': '5.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000600193', 'lastCheck': '3.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000456893', 'lastCheck': '3.7', 'valid': True}} >Thread-135071::DEBUG::2014-10-29 11:04:10,570::task::1191::Storage.TaskManager.Task::(prepare) Task=`2af94a72-df44-4f9f-8650-364c31f1a58f`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618416', 'lastCheck': '5.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00170585', 'lastCheck': '5.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000600193', 'lastCheck': '3.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000456893', 'lastCheck': '3.7', 'valid': True}} >Thread-135071::DEBUG::2014-10-29 11:04:10,570::task::595::Storage.TaskManager.Task::(_updateState) Task=`2af94a72-df44-4f9f-8650-364c31f1a58f`::moving from state preparing -> state finished >Thread-135071::DEBUG::2014-10-29 11:04:10,570::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135071::DEBUG::2014-10-29 11:04:10,571::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135071::DEBUG::2014-10-29 11:04:10,571::task::993::Storage.TaskManager.Task::(_decref) Task=`2af94a72-df44-4f9f-8650-364c31f1a58f`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:11,655::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:11,657::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135072::DEBUG::2014-10-29 11:04:11,661::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:11,663::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:11,665::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135073::DEBUG::2014-10-29 11:04:11,668::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135073::DEBUG::2014-10-29 11:04:11,670::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:04:12,447::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:13,273::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:13,275::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:13,277::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:14,684::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:14,686::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135074::DEBUG::2014-10-29 11:04:14,690::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:14,692::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:14,694::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135075::DEBUG::2014-10-29 11:04:14,696::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135075::DEBUG::2014-10-29 11:04:14,699::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:04:15,454::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:15,455::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:15,457::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-178::DEBUG::2014-10-29 11:04:15,459::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:04:15,459::__init__::232::IOProcess::(_processLogs) (199069) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:15,478::__init__::232::IOProcess::(_processLogs) (199069) Queuing response >Thread-178::DEBUG::2014-10-29 11:04:15,481::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000543488 s, 935 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:04:15,482::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:15,483::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:15,483::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:15,483::__init__::232::IOProcess::(_processLogs) (199070) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:15,485::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199070) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:15,487::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:15,488::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:15,488::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:15,488::__init__::232::IOProcess::(_processLogs) (199071) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:15,489::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199071) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:15,490::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:15,490::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:15,491::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:15,492::__init__::232::IOProcess::(_processLogs) (199072) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:15,492::__init__::232::IOProcess::(_processLogs) (199072) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:15,493::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:15,493::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:15,494::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:15,495::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199073) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:15,495::__init__::232::IOProcess::(_processLogs) (199073) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:15,512::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:15,512::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:15,513::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:15,513::__init__::232::IOProcess::(_processLogs) (199074) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:15,515::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199074) Queuing response >Thread-33::DEBUG::2014-10-29 11:04:15,516::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:04:15,534::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000456435 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:04:15,536::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:15,537::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:15,537::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:15,537::__init__::232::IOProcess::(_processLogs) (199075) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:15,538::__init__::232::IOProcess::(_processLogs) (199075) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:15,540::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:15,540::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:15,541::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:15,542::__init__::232::IOProcess::(_processLogs) (199076) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:15,542::__init__::232::IOProcess::(_processLogs) (199076) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:15,543::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:15,543::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:15,543::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:15,543::__init__::232::IOProcess::(_processLogs) (199077) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:15,544::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199077) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:15,546::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:15,546::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:15,546::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:15,546::__init__::232::IOProcess::(_processLogs) (199078) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:15,547::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199078) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:16,852::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:16,854::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:16,855::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:16,857::__init__::232::IOProcess::(_processLogs) (199079) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:16,860::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:16,861::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:16,863::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:16,864::__init__::232::IOProcess::(_processLogs) (199080) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:17,293::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199079) Queuing response >Thread-10269::DEBUG::2014-10-29 11:04:17,296::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:04:17,319::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000696213 s, 721 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:04:17,318::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199080) Queuing response >Thread-179::DEBUG::2014-10-29 11:04:17,321::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:04:17,339::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-179::DEBUG::2014-10-29 11:04:17,341::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000482482 s, 771 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:04:17,347::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:17,348::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:17,349::__init__::232::IOProcess::(_processLogs) (199081) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:17,349::__init__::232::IOProcess::(_processLogs) (199081) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:17,349::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:17,350::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:17,351::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:17,352::__init__::232::IOProcess::(_processLogs) (199082) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:17,353::__init__::232::IOProcess::(_processLogs) (199082) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:17,712::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:17,715::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135076::DEBUG::2014-10-29 11:04:17,718::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:17,721::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:17,723::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135077::DEBUG::2014-10-29 11:04:17,727::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135077::DEBUG::2014-10-29 11:04:17,729::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:18,283::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:18,285::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:18,287::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:04:18,510::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53754 >Detector thread::DEBUG::2014-10-29 11:04:18,511::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53754 >Detector thread::DEBUG::2014-10-29 11:04:18,511::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53754 >Detector thread::DEBUG::2014-10-29 11:04:18,511::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53754) >Thread-135078::DEBUG::2014-10-29 11:04:18,550::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135078::DEBUG::2014-10-29 11:04:18,552::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135078::DEBUG::2014-10-29 11:04:18,570::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135078::DEBUG::2014-10-29 11:04:18,617::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '79', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '79', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:04:19,485::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53755 >Detector thread::DEBUG::2014-10-29 11:04:19,486::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53755 >Detector thread::DEBUG::2014-10-29 11:04:19,486::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53755 >Detector thread::DEBUG::2014-10-29 11:04:19,486::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53755) >Thread-135079::DEBUG::2014-10-29 11:04:19,526::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135079::DEBUG::2014-10-29 11:04:19,528::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135079::DEBUG::2014-10-29 11:04:19,529::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.28', 'elapsedTime': '513292', 'displayType': 'vnc', 'cpuSys': '0.67', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '60534143', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '63825', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '30213.44'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.08', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:04:19,650::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53758 >Detector thread::DEBUG::2014-10-29 11:04:19,651::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53758 >Detector thread::DEBUG::2014-10-29 11:04:19,651::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53758 >Detector thread::DEBUG::2014-10-29 11:04:19,652::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53758) >Thread-135080::DEBUG::2014-10-29 11:04:19,692::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135080::DEBUG::2014-10-29 11:04:19,693::task::595::Storage.TaskManager.Task::(_updateState) Task=`86e968aa-72a9-4298-b31c-2527219b0d18`::moving from state init -> state preparing >Thread-135080::INFO::2014-10-29 11:04:19,693::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135080::DEBUG::2014-10-29 11:04:19,697::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:04:19,698::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:19,698::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:19,698::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:19,699::__init__::232::IOProcess::(_processLogs) (199083) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:04:19,700::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199083) Queuing response >Thread-135080::DEBUG::2014-10-29 11:04:19,700::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135080::DEBUG::2014-10-29 11:04:19,701::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135080::INFO::2014-10-29 11:04:19,701::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135080::DEBUG::2014-10-29 11:04:19,702::task::1191::Storage.TaskManager.Task::(prepare) Task=`86e968aa-72a9-4298-b31c-2527219b0d18`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135080::DEBUG::2014-10-29 11:04:19,702::task::595::Storage.TaskManager.Task::(_updateState) Task=`86e968aa-72a9-4298-b31c-2527219b0d18`::moving from state preparing -> state finished >Thread-135080::DEBUG::2014-10-29 11:04:19,702::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135080::DEBUG::2014-10-29 11:04:19,702::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135080::DEBUG::2014-10-29 11:04:19,703::task::993::Storage.TaskManager.Task::(_decref) Task=`86e968aa-72a9-4298-b31c-2527219b0d18`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:04:19,747::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53759 >Detector thread::DEBUG::2014-10-29 11:04:19,747::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53759 >Detector thread::DEBUG::2014-10-29 11:04:19,748::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53759 >Detector thread::DEBUG::2014-10-29 11:04:19,748::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53759) >Thread-135081::DEBUG::2014-10-29 11:04:19,787::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135081::DEBUG::2014-10-29 11:04:19,787::task::595::Storage.TaskManager.Task::(_updateState) Task=`a090cf29-7371-4c08-b380-661c91b545d6`::moving from state init -> state preparing >Thread-135081::INFO::2014-10-29 11:04:19,788::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135081::DEBUG::2014-10-29 11:04:19,788::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135081::DEBUG::2014-10-29 11:04:19,788::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135081::DEBUG::2014-10-29 11:04:19,789::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135081::DEBUG::2014-10-29 11:04:19,789::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135081::DEBUG::2014-10-29 11:04:19,789::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135081::DEBUG::2014-10-29 11:04:19,790::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135081::DEBUG::2014-10-29 11:04:19,865::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135081::DEBUG::2014-10-29 11:04:19,866::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135081::DEBUG::2014-10-29 11:04:20,047::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135081::DEBUG::2014-10-29 11:04:20,048::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135081::DEBUG::2014-10-29 11:04:20,048::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135081::DEBUG::2014-10-29 11:04:20,049::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135081::DEBUG::2014-10-29 11:04:20,049::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135081::DEBUG::2014-10-29 11:04:20,050::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135081::DEBUG::2014-10-29 11:04:20,050::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135081::DEBUG::2014-10-29 11:04:20,050::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:04:20,056::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:20,059::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:20,060::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:20,060::__init__::232::IOProcess::(_processLogs) (199084) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:04:20,061::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199084) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:20,062::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:20,063::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:20,063::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:20,063::__init__::232::IOProcess::(_processLogs) (199085) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:04:20,064::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199085) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:20,066::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:20,067::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:20,069::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:20,071::__init__::232::IOProcess::(_processLogs) (199086) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:04:20,075::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199086) Queuing response >Thread-135081::DEBUG::2014-10-29 11:04:20,078::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:04:20,080::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:20,081::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:20,081::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:20,082::__init__::232::IOProcess::(_processLogs) (199087) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:04:20,083::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199087) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:20,083::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:20,084::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:20,084::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:20,084::__init__::232::IOProcess::(_processLogs) (199088) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:04:20,086::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199088) Queuing response >Thread-135081::DEBUG::2014-10-29 11:04:20,087::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:04:20,088::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:20,088::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:20,089::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:20,089::__init__::232::IOProcess::(_processLogs) (199089) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:04:20,090::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199089) Queuing response >Thread-135081::DEBUG::2014-10-29 11:04:20,090::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:04:20,092::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:20,092::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:20,093::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:20,094::__init__::232::IOProcess::(_processLogs) (199090) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:20,094::__init__::232::IOProcess::(_processLogs) (199090) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:20,095::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:20,095::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:20,095::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:20,095::__init__::232::IOProcess::(_processLogs) (199091) Got request for method 'glob' >Thread-135081::DEBUG::2014-10-29 11:04:20,096::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:04:20,096::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199091) Queuing response >Thread-135081::INFO::2014-10-29 11:04:20,097::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135081::INFO::2014-10-29 11:04:20,098::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135081::INFO::2014-10-29 11:04:20,098::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:04:20,099::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:20,099::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:20,100::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:20,100::__init__::232::IOProcess::(_processLogs) (199092) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:04:20,101::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199092) Queuing response >Thread-135081::DEBUG::2014-10-29 11:04:20,101::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135081::DEBUG::2014-10-29 11:04:20,104::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`8a87bb10-6021-4388-96da-059e97145b4b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135081::DEBUG::2014-10-29 11:04:20,104::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135081::DEBUG::2014-10-29 11:04:20,104::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135081::DEBUG::2014-10-29 11:04:20,104::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`8a87bb10-6021-4388-96da-059e97145b4b`::Granted request >Thread-135081::DEBUG::2014-10-29 11:04:20,105::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a090cf29-7371-4c08-b380-661c91b545d6`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135081::DEBUG::2014-10-29 11:04:20,105::task::993::Storage.TaskManager.Task::(_decref) Task=`a090cf29-7371-4c08-b380-661c91b545d6`::ref 1 aborting False >Thread-135081::INFO::2014-10-29 11:04:20,108::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135081::DEBUG::2014-10-29 11:04:20,108::task::1191::Storage.TaskManager.Task::(prepare) Task=`a090cf29-7371-4c08-b380-661c91b545d6`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135081::DEBUG::2014-10-29 11:04:20,109::task::595::Storage.TaskManager.Task::(_updateState) Task=`a090cf29-7371-4c08-b380-661c91b545d6`::moving from state preparing -> state finished >Thread-135081::DEBUG::2014-10-29 11:04:20,109::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135081::DEBUG::2014-10-29 11:04:20,109::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135081::DEBUG::2014-10-29 11:04:20,110::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135081::DEBUG::2014-10-29 11:04:20,110::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135081::DEBUG::2014-10-29 11:04:20,110::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135081::DEBUG::2014-10-29 11:04:20,110::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135081::DEBUG::2014-10-29 11:04:20,111::task::993::Storage.TaskManager.Task::(_decref) Task=`a090cf29-7371-4c08-b380-661c91b545d6`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:04:20,133::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53760 >Detector thread::DEBUG::2014-10-29 11:04:20,133::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53760 >Detector thread::DEBUG::2014-10-29 11:04:20,134::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53760 >Detector thread::DEBUG::2014-10-29 11:04:20,134::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53760) >Thread-135086::DEBUG::2014-10-29 11:04:20,173::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135086::DEBUG::2014-10-29 11:04:20,173::task::595::Storage.TaskManager.Task::(_updateState) Task=`4cc2b362-7c0b-42e4-9ce3-59e73f6106af`::moving from state init -> state preparing >Thread-135086::INFO::2014-10-29 11:04:20,174::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135086::INFO::2014-10-29 11:04:20,174::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543488', 'lastCheck': '4.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456435', 'lastCheck': '4.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482482', 'lastCheck': '2.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000696213', 'lastCheck': '2.8', 'valid': True}} >Thread-135086::DEBUG::2014-10-29 11:04:20,175::task::1191::Storage.TaskManager.Task::(prepare) Task=`4cc2b362-7c0b-42e4-9ce3-59e73f6106af`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543488', 'lastCheck': '4.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456435', 'lastCheck': '4.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482482', 'lastCheck': '2.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000696213', 'lastCheck': '2.8', 'valid': True}} >Thread-135086::DEBUG::2014-10-29 11:04:20,175::task::595::Storage.TaskManager.Task::(_updateState) Task=`4cc2b362-7c0b-42e4-9ce3-59e73f6106af`::moving from state preparing -> state finished >Thread-135086::DEBUG::2014-10-29 11:04:20,175::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135086::DEBUG::2014-10-29 11:04:20,175::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135086::DEBUG::2014-10-29 11:04:20,176::task::993::Storage.TaskManager.Task::(_decref) Task=`4cc2b362-7c0b-42e4-9ce3-59e73f6106af`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:20,744::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:20,746::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135087::DEBUG::2014-10-29 11:04:20,750::task::595::Storage.TaskManager.Task::(_updateState) Task=`06ec48d9-96e6-4deb-8409-19ae66b536e9`::moving from state init -> state preparing >Thread-135087::INFO::2014-10-29 11:04:20,750::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135087::INFO::2014-10-29 11:04:20,751::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543488', 'lastCheck': '5.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456435', 'lastCheck': '5.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482482', 'lastCheck': '3.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000696213', 'lastCheck': '3.4', 'valid': True}} >Thread-135087::DEBUG::2014-10-29 11:04:20,751::task::1191::Storage.TaskManager.Task::(prepare) Task=`06ec48d9-96e6-4deb-8409-19ae66b536e9`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543488', 'lastCheck': '5.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456435', 'lastCheck': '5.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482482', 'lastCheck': '3.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000696213', 'lastCheck': '3.4', 'valid': True}} >Thread-135087::DEBUG::2014-10-29 11:04:20,751::task::595::Storage.TaskManager.Task::(_updateState) Task=`06ec48d9-96e6-4deb-8409-19ae66b536e9`::moving from state preparing -> state finished >Thread-135087::DEBUG::2014-10-29 11:04:20,751::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135087::DEBUG::2014-10-29 11:04:20,752::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135087::DEBUG::2014-10-29 11:04:20,752::task::993::Storage.TaskManager.Task::(_decref) Task=`06ec48d9-96e6-4deb-8409-19ae66b536e9`::ref 0 aborting False >Thread-135087::DEBUG::2014-10-29 11:04:20,777::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:20,798::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:20,800::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135088::DEBUG::2014-10-29 11:04:20,804::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135088::DEBUG::2014-10-29 11:04:20,806::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:04:20,857::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53761 >Detector thread::DEBUG::2014-10-29 11:04:20,858::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53761 >Detector thread::DEBUG::2014-10-29 11:04:20,858::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53761 >Detector thread::DEBUG::2014-10-29 11:04:20,858::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53761) >Thread-135089::DEBUG::2014-10-29 11:04:20,898::task::595::Storage.TaskManager.Task::(_updateState) Task=`18ca6e10-a566-4160-aabc-29e9981127ab`::moving from state init -> state preparing >Thread-135089::INFO::2014-10-29 11:04:20,899::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135089::INFO::2014-10-29 11:04:20,899::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543488', 'lastCheck': '5.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456435', 'lastCheck': '5.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482482', 'lastCheck': '3.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000696213', 'lastCheck': '3.6', 'valid': True}} >Thread-135089::DEBUG::2014-10-29 11:04:20,899::task::1191::Storage.TaskManager.Task::(prepare) Task=`18ca6e10-a566-4160-aabc-29e9981127ab`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543488', 'lastCheck': '5.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456435', 'lastCheck': '5.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482482', 'lastCheck': '3.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000696213', 'lastCheck': '3.6', 'valid': True}} >Thread-135089::DEBUG::2014-10-29 11:04:20,900::task::595::Storage.TaskManager.Task::(_updateState) Task=`18ca6e10-a566-4160-aabc-29e9981127ab`::moving from state preparing -> state finished >Thread-135089::DEBUG::2014-10-29 11:04:20,900::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135089::DEBUG::2014-10-29 11:04:20,900::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135089::DEBUG::2014-10-29 11:04:20,900::task::993::Storage.TaskManager.Task::(_decref) Task=`18ca6e10-a566-4160-aabc-29e9981127ab`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:23,294::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:23,295::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:23,297::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:23,871::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:23,873::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135090::DEBUG::2014-10-29 11:04:23,876::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:23,878::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:23,880::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135091::DEBUG::2014-10-29 11:04:23,883::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135091::DEBUG::2014-10-29 11:04:23,885::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:04:25,498::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:25,498::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:25,499::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:25,499::__init__::232::IOProcess::(_processLogs) (199093) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:25,500::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199093) Queuing response >Thread-178::DEBUG::2014-10-29 11:04:25,502::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:04:25,519::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00058873 s, 863 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:04:25,521::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:25,521::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:25,522::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:25,522::__init__::232::IOProcess::(_processLogs) (199094) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:25,522::__init__::232::IOProcess::(_processLogs) (199094) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:25,524::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:25,525::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:25,526::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:25,526::__init__::232::IOProcess::(_processLogs) (199095) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:25,527::__init__::232::IOProcess::(_processLogs) (199095) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:25,527::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:25,528::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:25,529::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:25,529::__init__::232::IOProcess::(_processLogs) (199096) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:25,529::__init__::232::IOProcess::(_processLogs) (199096) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:25,530::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:25,531::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:25,531::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:25,531::__init__::232::IOProcess::(_processLogs) (199097) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:25,532::__init__::232::IOProcess::(_processLogs) (199097) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:25,549::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:25,549::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:25,549::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:25,550::__init__::232::IOProcess::(_processLogs) (199098) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:25,551::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199098) Queuing response >Thread-33::DEBUG::2014-10-29 11:04:25,552::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:04:25,570::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000527201 s, 924 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:04:25,571::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:25,572::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:25,572::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:25,572::__init__::232::IOProcess::(_processLogs) (199099) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:25,573::__init__::232::IOProcess::(_processLogs) (199099) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:25,575::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:25,576::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:25,576::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:25,576::__init__::232::IOProcess::(_processLogs) (199100) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:25,577::__init__::232::IOProcess::(_processLogs) (199100) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:25,577::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:25,578::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:25,579::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:25,579::__init__::232::IOProcess::(_processLogs) (199101) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:25,579::__init__::232::IOProcess::(_processLogs) (199101) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:25,580::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:25,580::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:25,581::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:25,582::__init__::232::IOProcess::(_processLogs) (199102) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:25,582::__init__::232::IOProcess::(_processLogs) (199102) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:26,903::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:26,905::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135092::DEBUG::2014-10-29 11:04:26,909::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:26,911::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:26,913::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135093::DEBUG::2014-10-29 11:04:26,916::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135093::DEBUG::2014-10-29 11:04:26,918::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:04:27,349::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:27,350::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:27,350::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:27,350::__init__::232::IOProcess::(_processLogs) (199103) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:27,352::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199103) Queuing response >Thread-10269::DEBUG::2014-10-29 11:04:27,353::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:04:27,374::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-10269::DEBUG::2014-10-29 11:04:27,374::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000497711 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:04:27,379::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:27,380::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:27,380::__init__::232::IOProcess::(_processLogs) (199104) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:27,380::__init__::232::IOProcess::(_processLogs) (199104) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:27,381::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-179::DEBUG::2014-10-29 11:04:27,382::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:04:27,383::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:27,399::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:27,400::__init__::232::IOProcess::(_processLogs) (199105) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:27,402::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199105) Queuing response >Thread-179::DEBUG::2014-10-29 11:04:27,405::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00170452 s, 218 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:04:27,408::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:27,408::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:27,408::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:27,409::__init__::232::IOProcess::(_processLogs) (199106) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:27,410::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199106) Queuing response >Thread-22::DEBUG::2014-10-29 11:04:27,471::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:28,305::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:28,306::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:28,308::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:04:28,661::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53762 >Detector thread::DEBUG::2014-10-29 11:04:28,662::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53762 >Detector thread::DEBUG::2014-10-29 11:04:28,662::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53762 >Detector thread::DEBUG::2014-10-29 11:04:28,663::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53762) >Thread-135094::DEBUG::2014-10-29 11:04:28,702::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135094::DEBUG::2014-10-29 11:04:28,704::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135094::DEBUG::2014-10-29 11:04:28,721::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135094::DEBUG::2014-10-29 11:04:28,767::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '64', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '64', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:04:29,682::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53763 >Detector thread::DEBUG::2014-10-29 11:04:29,683::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53763 >Detector thread::DEBUG::2014-10-29 11:04:29,683::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53763 >Detector thread::DEBUG::2014-10-29 11:04:29,684::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53763) >Thread-135095::DEBUG::2014-10-29 11:04:29,722::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135095::DEBUG::2014-10-29 11:04:29,723::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135095::DEBUG::2014-10-29 11:04:29,724::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.94', 'elapsedTime': '513302', 'displayType': 'vnc', 'cpuSys': '0.87', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '60534143', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '63825', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '30213.44'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.25', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:29,933::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:29,936::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135096::DEBUG::2014-10-29 11:04:29,939::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:29,942::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:29,943::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135097::DEBUG::2014-10-29 11:04:29,946::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135097::DEBUG::2014-10-29 11:04:29,949::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:04:30,773::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53766 >Detector thread::DEBUG::2014-10-29 11:04:30,775::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53766 >Detector thread::DEBUG::2014-10-29 11:04:30,776::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53766 >Detector thread::DEBUG::2014-10-29 11:04:30,776::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53766) >Thread-135098::DEBUG::2014-10-29 11:04:30,814::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135098::DEBUG::2014-10-29 11:04:30,815::task::595::Storage.TaskManager.Task::(_updateState) Task=`423357d8-f90c-4d0c-b38a-62d690ed717a`::moving from state init -> state preparing >Thread-135098::INFO::2014-10-29 11:04:30,816::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135098::DEBUG::2014-10-29 11:04:30,821::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:04:30,822::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:30,822::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:30,823::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:30,823::__init__::232::IOProcess::(_processLogs) (199107) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:04:30,824::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199107) Queuing response >Thread-135098::DEBUG::2014-10-29 11:04:30,824::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135098::DEBUG::2014-10-29 11:04:30,825::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135098::INFO::2014-10-29 11:04:30,826::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135098::DEBUG::2014-10-29 11:04:30,826::task::1191::Storage.TaskManager.Task::(prepare) Task=`423357d8-f90c-4d0c-b38a-62d690ed717a`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135098::DEBUG::2014-10-29 11:04:30,826::task::595::Storage.TaskManager.Task::(_updateState) Task=`423357d8-f90c-4d0c-b38a-62d690ed717a`::moving from state preparing -> state finished >Thread-135098::DEBUG::2014-10-29 11:04:30,826::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135098::DEBUG::2014-10-29 11:04:30,827::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135098::DEBUG::2014-10-29 11:04:30,827::task::993::Storage.TaskManager.Task::(_decref) Task=`423357d8-f90c-4d0c-b38a-62d690ed717a`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:04:30,873::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53767 >Detector thread::DEBUG::2014-10-29 11:04:30,874::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53767 >Detector thread::DEBUG::2014-10-29 11:04:30,874::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53767 >Detector thread::DEBUG::2014-10-29 11:04:30,875::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53767) >Thread-135099::DEBUG::2014-10-29 11:04:30,913::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135099::DEBUG::2014-10-29 11:04:30,914::task::595::Storage.TaskManager.Task::(_updateState) Task=`566e6294-5335-453c-91a1-55740b267ef6`::moving from state init -> state preparing >Thread-135099::INFO::2014-10-29 11:04:30,914::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135099::DEBUG::2014-10-29 11:04:30,914::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135099::DEBUG::2014-10-29 11:04:30,915::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135099::DEBUG::2014-10-29 11:04:30,915::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135099::DEBUG::2014-10-29 11:04:30,915::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135099::DEBUG::2014-10-29 11:04:30,915::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135099::DEBUG::2014-10-29 11:04:30,916::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Detector thread::DEBUG::2014-10-29 11:04:30,961::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53768 >Detector thread::DEBUG::2014-10-29 11:04:30,962::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53768 >Detector thread::DEBUG::2014-10-29 11:04:30,962::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53768 >Detector thread::DEBUG::2014-10-29 11:04:30,963::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53768) >Thread-135099::DEBUG::2014-10-29 11:04:30,997::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135099::DEBUG::2014-10-29 11:04:30,998::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135100::DEBUG::2014-10-29 11:04:31,017::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a6cb2f9-7ad1-4252-b72b-74df97dc6872`::moving from state init -> state preparing >Thread-135100::INFO::2014-10-29 11:04:31,018::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135100::INFO::2014-10-29 11:04:31,018::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00058873', 'lastCheck': '5.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527201', 'lastCheck': '5.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00170452', 'lastCheck': '3.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000497711', 'lastCheck': '3.6', 'valid': True}} >Thread-135100::DEBUG::2014-10-29 11:04:31,019::task::1191::Storage.TaskManager.Task::(prepare) Task=`3a6cb2f9-7ad1-4252-b72b-74df97dc6872`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00058873', 'lastCheck': '5.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527201', 'lastCheck': '5.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00170452', 'lastCheck': '3.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000497711', 'lastCheck': '3.6', 'valid': True}} >Thread-135100::DEBUG::2014-10-29 11:04:31,019::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a6cb2f9-7ad1-4252-b72b-74df97dc6872`::moving from state preparing -> state finished >Thread-135100::DEBUG::2014-10-29 11:04:31,019::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135100::DEBUG::2014-10-29 11:04:31,020::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135100::DEBUG::2014-10-29 11:04:31,020::task::993::Storage.TaskManager.Task::(_decref) Task=`3a6cb2f9-7ad1-4252-b72b-74df97dc6872`::ref 0 aborting False >Thread-135099::DEBUG::2014-10-29 11:04:31,190::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135099::DEBUG::2014-10-29 11:04:31,191::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135099::DEBUG::2014-10-29 11:04:31,191::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135099::DEBUG::2014-10-29 11:04:31,192::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135099::DEBUG::2014-10-29 11:04:31,192::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135099::DEBUG::2014-10-29 11:04:31,192::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135099::DEBUG::2014-10-29 11:04:31,193::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135099::DEBUG::2014-10-29 11:04:31,193::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:04:31,200::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:31,203::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:31,203::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:31,204::__init__::232::IOProcess::(_processLogs) (199108) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:04:31,205::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199108) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:31,207::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:31,207::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:31,207::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:31,207::__init__::232::IOProcess::(_processLogs) (199109) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:04:31,208::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:31,208::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:31,208::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:31,208::__init__::232::IOProcess::(_processLogs) (199110) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:04:31,209::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:31,209::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:31,209::__init__::232::IOProcess::(_processLogs) (199109) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:31,210::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:31,211::__init__::232::IOProcess::(_processLogs) (199111) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:04:31,211::__init__::232::IOProcess::(_processLogs) (199110) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:31,212::__init__::232::IOProcess::(_processLogs) (199111) Queuing response >Thread-135099::DEBUG::2014-10-29 11:04:31,218::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:04:31,219::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:31,220::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:31,220::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:31,220::__init__::232::IOProcess::(_processLogs) (199112) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:04:31,221::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199112) Queuing response >Thread-135099::DEBUG::2014-10-29 11:04:31,222::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:04:31,223::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:31,223::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:31,223::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:31,224::__init__::232::IOProcess::(_processLogs) (199113) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:04:31,224::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199113) Queuing response >Thread-135099::DEBUG::2014-10-29 11:04:31,225::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:04:31,227::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:31,228::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:31,228::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:31,229::__init__::232::IOProcess::(_processLogs) (199114) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:31,229::__init__::232::IOProcess::(_processLogs) (199114) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:31,229::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:31,230::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:31,230::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:31,230::__init__::232::IOProcess::(_processLogs) (199115) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:04:31,231::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199115) Queuing response >Thread-135099::DEBUG::2014-10-29 11:04:31,231::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-135099::INFO::2014-10-29 11:04:31,232::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135099::INFO::2014-10-29 11:04:31,232::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135099::INFO::2014-10-29 11:04:31,233::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:04:31,233::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:31,234::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:31,234::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:31,234::__init__::232::IOProcess::(_processLogs) (199116) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:04:31,235::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199116) Queuing response >Thread-135099::DEBUG::2014-10-29 11:04:31,235::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135099::DEBUG::2014-10-29 11:04:31,237::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`763312c1-01de-4ec6-98bb-d34e5633ae10`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135099::DEBUG::2014-10-29 11:04:31,238::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135099::DEBUG::2014-10-29 11:04:31,238::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135099::DEBUG::2014-10-29 11:04:31,238::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`763312c1-01de-4ec6-98bb-d34e5633ae10`::Granted request >Thread-135099::DEBUG::2014-10-29 11:04:31,239::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`566e6294-5335-453c-91a1-55740b267ef6`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135099::DEBUG::2014-10-29 11:04:31,239::task::993::Storage.TaskManager.Task::(_decref) Task=`566e6294-5335-453c-91a1-55740b267ef6`::ref 1 aborting False >Thread-135099::INFO::2014-10-29 11:04:31,242::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135099::DEBUG::2014-10-29 11:04:31,242::task::1191::Storage.TaskManager.Task::(prepare) Task=`566e6294-5335-453c-91a1-55740b267ef6`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135099::DEBUG::2014-10-29 11:04:31,242::task::595::Storage.TaskManager.Task::(_updateState) Task=`566e6294-5335-453c-91a1-55740b267ef6`::moving from state preparing -> state finished >Thread-135099::DEBUG::2014-10-29 11:04:31,243::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135099::DEBUG::2014-10-29 11:04:31,243::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135099::DEBUG::2014-10-29 11:04:31,243::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135099::DEBUG::2014-10-29 11:04:31,244::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135099::DEBUG::2014-10-29 11:04:31,244::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135099::DEBUG::2014-10-29 11:04:31,244::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135099::DEBUG::2014-10-29 11:04:31,245::task::993::Storage.TaskManager.Task::(_decref) Task=`566e6294-5335-453c-91a1-55740b267ef6`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:04:31,264::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53769 >Detector thread::DEBUG::2014-10-29 11:04:31,265::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53769 >Detector thread::DEBUG::2014-10-29 11:04:31,265::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53769 >Detector thread::DEBUG::2014-10-29 11:04:31,266::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53769) >Thread-135105::DEBUG::2014-10-29 11:04:31,304::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135105::DEBUG::2014-10-29 11:04:31,304::task::595::Storage.TaskManager.Task::(_updateState) Task=`61310673-16b5-4b7e-8f6e-7217e3140034`::moving from state init -> state preparing >Thread-135105::INFO::2014-10-29 11:04:31,305::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135105::INFO::2014-10-29 11:04:31,305::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00058873', 'lastCheck': '5.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527201', 'lastCheck': '5.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00170452', 'lastCheck': '3.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000497711', 'lastCheck': '3.9', 'valid': True}} >Thread-135105::DEBUG::2014-10-29 11:04:31,306::task::1191::Storage.TaskManager.Task::(prepare) Task=`61310673-16b5-4b7e-8f6e-7217e3140034`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00058873', 'lastCheck': '5.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527201', 'lastCheck': '5.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00170452', 'lastCheck': '3.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000497711', 'lastCheck': '3.9', 'valid': True}} >Thread-135105::DEBUG::2014-10-29 11:04:31,306::task::595::Storage.TaskManager.Task::(_updateState) Task=`61310673-16b5-4b7e-8f6e-7217e3140034`::moving from state preparing -> state finished >Thread-135105::DEBUG::2014-10-29 11:04:31,306::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135105::DEBUG::2014-10-29 11:04:31,306::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135105::DEBUG::2014-10-29 11:04:31,307::task::993::Storage.TaskManager.Task::(_decref) Task=`61310673-16b5-4b7e-8f6e-7217e3140034`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:32,961::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:32,964::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135106::DEBUG::2014-10-29 11:04:32,967::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:32,969::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:32,971::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >VM Channels Listener::DEBUG::2014-10-29 11:04:32,974::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >Thread-135107::DEBUG::2014-10-29 11:04:32,979::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135107::DEBUG::2014-10-29 11:04:32,981::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:33,315::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:33,316::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:33,319::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:04:35,545::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:35,545::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:35,547::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:35,549::__init__::232::IOProcess::(_processLogs) (199117) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:04:35,549::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:04:35,550::__init__::232::IOProcess::(_processLogs) (199117) Queuing response >Thread-178::DEBUG::2014-10-29 11:04:35,567::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000992512 s, 512 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:04:35,568::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:35,569::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:35,569::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:35,569::__init__::232::IOProcess::(_processLogs) (199118) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:35,571::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199118) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:35,573::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:35,573::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:35,574::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:35,574::__init__::232::IOProcess::(_processLogs) (199119) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:35,575::__init__::232::IOProcess::(_processLogs) (199119) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:35,575::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:35,575::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:35,576::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:35,577::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199120) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:35,577::__init__::232::IOProcess::(_processLogs) (199120) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:35,578::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:35,578::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:35,578::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:35,579::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199121) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:35,580::__init__::232::IOProcess::(_processLogs) (199121) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:35,583::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:35,583::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:35,584::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:35,586::__init__::232::IOProcess::(_processLogs) (199122) Got request for method 'statvfs' >Thread-33::DEBUG::2014-10-29 11:04:35,586::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:04:35,587::__init__::232::IOProcess::(_processLogs) (199122) Queuing response >Thread-33::DEBUG::2014-10-29 11:04:35,604::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00081388 s, 598 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:04:35,606::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:35,606::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:35,606::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:35,607::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199123) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:35,607::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199123) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:35,609::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:35,610::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:35,611::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:35,611::__init__::232::IOProcess::(_processLogs) (199124) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:35,612::__init__::232::IOProcess::(_processLogs) (199124) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:35,612::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:35,613::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:35,613::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:35,613::__init__::232::IOProcess::(_processLogs) (199125) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:35,614::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199125) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:35,615::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:35,615::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:35,616::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:35,616::__init__::232::IOProcess::(_processLogs) (199126) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:35,617::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199126) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:35,995::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:35,997::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135108::DEBUG::2014-10-29 11:04:36,002::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd1303ca-d587-4cd4-89c3-a1a558764629`::moving from state init -> state preparing >Thread-135108::INFO::2014-10-29 11:04:36,003::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135108::INFO::2014-10-29 11:04:36,003::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000992512', 'lastCheck': '0.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00081388', 'lastCheck': '0.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00170452', 'lastCheck': '8.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000497711', 'lastCheck': '8.6', 'valid': True}} >Thread-135108::DEBUG::2014-10-29 11:04:36,004::task::1191::Storage.TaskManager.Task::(prepare) Task=`fd1303ca-d587-4cd4-89c3-a1a558764629`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000992512', 'lastCheck': '0.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00081388', 'lastCheck': '0.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00170452', 'lastCheck': '8.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000497711', 'lastCheck': '8.6', 'valid': True}} >Thread-135108::DEBUG::2014-10-29 11:04:36,004::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd1303ca-d587-4cd4-89c3-a1a558764629`::moving from state preparing -> state finished >Thread-135108::DEBUG::2014-10-29 11:04:36,004::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135108::DEBUG::2014-10-29 11:04:36,004::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135108::DEBUG::2014-10-29 11:04:36,005::task::993::Storage.TaskManager.Task::(_decref) Task=`fd1303ca-d587-4cd4-89c3-a1a558764629`::ref 0 aborting False >Thread-135108::DEBUG::2014-10-29 11:04:36,053::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:36,075::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:36,078::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135109::DEBUG::2014-10-29 11:04:36,081::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135109::DEBUG::2014-10-29 11:04:36,083::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:04:37,407::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:37,408::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:37,408::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:37,408::__init__::232::IOProcess::(_processLogs) (199127) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:37,408::__init__::232::IOProcess::(_processLogs) (199127) Queuing response >Thread-10269::DEBUG::2014-10-29 11:04:37,410::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:04:37,428::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:37,430::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10269::DEBUG::2014-10-29 11:04:37,430::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000583637 s, 860 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:04:37,432::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:37,435::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199128) Got request for method 'statvfs' >Thread-179::DEBUG::2014-10-29 11:04:37,436::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:04:37,437::__init__::232::IOProcess::(_processLogs) (199128) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:37,455::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-179::DEBUG::2014-10-29 11:04:37,455::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000461556 s, 806 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:04:37,457::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:37,459::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:37,459::__init__::232::IOProcess::(_processLogs) (199129) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:37,461::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199129) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:37,463::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:37,463::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:37,465::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:37,466::__init__::232::IOProcess::(_processLogs) (199130) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:37,467::__init__::232::IOProcess::(_processLogs) (199130) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:38,326::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:38,328::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:38,329::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:04:38,819::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53770 >Detector thread::DEBUG::2014-10-29 11:04:38,820::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53770 >Detector thread::DEBUG::2014-10-29 11:04:38,820::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53770 >Detector thread::DEBUG::2014-10-29 11:04:38,820::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53770) >Thread-135110::DEBUG::2014-10-29 11:04:38,859::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135110::DEBUG::2014-10-29 11:04:38,861::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135110::DEBUG::2014-10-29 11:04:38,882::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135110::DEBUG::2014-10-29 11:04:38,929::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '48', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '48', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:39,146::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:39,149::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135111::DEBUG::2014-10-29 11:04:39,152::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:39,154::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:39,156::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135112::DEBUG::2014-10-29 11:04:39,159::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135112::DEBUG::2014-10-29 11:04:39,162::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:04:39,882::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53771 >Detector thread::DEBUG::2014-10-29 11:04:39,883::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53771 >Detector thread::DEBUG::2014-10-29 11:04:39,883::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53771 >Detector thread::DEBUG::2014-10-29 11:04:39,883::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53771) >Thread-135113::DEBUG::2014-10-29 11:04:39,922::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135113::DEBUG::2014-10-29 11:04:39,923::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135113::DEBUG::2014-10-29 11:04:39,924::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.94', 'elapsedTime': '513312', 'displayType': 'vnc', 'cpuSys': '0.87', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '60534143', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '63825', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '30213.44'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.45', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:04:41,094::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53773 >Detector thread::DEBUG::2014-10-29 11:04:41,095::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53773 >Detector thread::DEBUG::2014-10-29 11:04:41,095::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53773 >Detector thread::DEBUG::2014-10-29 11:04:41,096::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53773) >Thread-135114::DEBUG::2014-10-29 11:04:41,136::task::595::Storage.TaskManager.Task::(_updateState) Task=`9830e92b-8229-4167-a21c-8e01ad232dc5`::moving from state init -> state preparing >Thread-135114::INFO::2014-10-29 11:04:41,137::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135114::INFO::2014-10-29 11:04:41,137::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000992512', 'lastCheck': '5.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00081388', 'lastCheck': '5.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461556', 'lastCheck': '3.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000583637', 'lastCheck': '3.7', 'valid': True}} >Thread-135114::DEBUG::2014-10-29 11:04:41,138::task::1191::Storage.TaskManager.Task::(prepare) Task=`9830e92b-8229-4167-a21c-8e01ad232dc5`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000992512', 'lastCheck': '5.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00081388', 'lastCheck': '5.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461556', 'lastCheck': '3.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000583637', 'lastCheck': '3.7', 'valid': True}} >Thread-135114::DEBUG::2014-10-29 11:04:41,138::task::595::Storage.TaskManager.Task::(_updateState) Task=`9830e92b-8229-4167-a21c-8e01ad232dc5`::moving from state preparing -> state finished >Thread-135114::DEBUG::2014-10-29 11:04:41,138::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135114::DEBUG::2014-10-29 11:04:41,138::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135114::DEBUG::2014-10-29 11:04:41,139::task::993::Storage.TaskManager.Task::(_decref) Task=`9830e92b-8229-4167-a21c-8e01ad232dc5`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:42,178::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:42,184::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135115::DEBUG::2014-10-29 11:04:42,188::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:42,191::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:42,193::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135116::DEBUG::2014-10-29 11:04:42,196::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135116::DEBUG::2014-10-29 11:04:42,198::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:04:42,474::task::595::Storage.TaskManager.Task::(_updateState) Task=`61eb6bad-34a7-4316-a60b-c469ec8a559f`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:04:42,475::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:04:42,476::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:42,477::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:42,477::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:42,477::__init__::232::IOProcess::(_processLogs) (199131) Got request for method 'stat' >Detector thread::DEBUG::2014-10-29 11:04:42,647::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53775 >Detector thread::DEBUG::2014-10-29 11:04:42,648::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53775 >Detector thread::DEBUG::2014-10-29 11:04:42,648::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53775 >Detector thread::DEBUG::2014-10-29 11:04:42,648::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53775) >Thread-135117::DEBUG::2014-10-29 11:04:42,688::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135117::DEBUG::2014-10-29 11:04:42,689::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9b8654a-0744-4cc2-81de-8dd94e1b2aad`::moving from state init -> state preparing >Thread-135117::INFO::2014-10-29 11:04:42,689::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135117::DEBUG::2014-10-29 11:04:42,693::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:04:42,694::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:42,694::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:42,694::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:42,694::__init__::232::IOProcess::(_processLogs) (199132) Got request for method 'glob' >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:43,336::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:43,337::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:43,340::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:45,213::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:45,215::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135118::DEBUG::2014-10-29 11:04:45,218::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:45,220::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:45,222::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135119::DEBUG::2014-10-29 11:04:45,225::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135119::DEBUG::2014-10-29 11:04:45,227::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-135117::DEBUG::2014-10-29 11:04:45,296::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135117::DEBUG::2014-10-29 11:04:45,298::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135117::INFO::2014-10-29 11:04:45,300::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-17::DEBUG::2014-10-29 11:04:45,300::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199132) Queuing response >Thread-22::DEBUG::2014-10-29 11:04:45,302::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135117::DEBUG::2014-10-29 11:04:45,302::task::1191::Storage.TaskManager.Task::(prepare) Task=`d9b8654a-0744-4cc2-81de-8dd94e1b2aad`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-17::DEBUG::2014-10-29 11:04:45,303::__init__::232::IOProcess::(_processLogs) (199131) Queuing response >Thread-22::DEBUG::2014-10-29 11:04:45,304::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135117::DEBUG::2014-10-29 11:04:45,304::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9b8654a-0744-4cc2-81de-8dd94e1b2aad`::moving from state preparing -> state finished >Thread-135117::DEBUG::2014-10-29 11:04:45,306::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135117::DEBUG::2014-10-29 11:04:45,306::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135117::DEBUG::2014-10-29 11:04:45,306::task::993::Storage.TaskManager.Task::(_decref) Task=`d9b8654a-0744-4cc2-81de-8dd94e1b2aad`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:04:45,306::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-22::DEBUG::2014-10-29 11:04:45,309::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-22::DEBUG::2014-10-29 11:04:45,309::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-22::DEBUG::2014-10-29 11:04:45,309::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-22::DEBUG::2014-10-29 11:04:45,392::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Detector thread::DEBUG::2014-10-29 11:04:45,393::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53776 >Thread-22::DEBUG::2014-10-29 11:04:45,394::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Detector thread::DEBUG::2014-10-29 11:04:45,420::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53776 >Detector thread::DEBUG::2014-10-29 11:04:45,423::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53776 >Detector thread::DEBUG::2014-10-29 11:04:45,426::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53776) >Thread-135120::DEBUG::2014-10-29 11:04:45,435::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135120::DEBUG::2014-10-29 11:04:45,436::task::595::Storage.TaskManager.Task::(_updateState) Task=`c02d5315-1193-4ac0-b55d-cd32c2d260e2`::moving from state init -> state preparing >Thread-135120::INFO::2014-10-29 11:04:45,436::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-17::DEBUG::2014-10-29 11:04:45,583::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:45,584::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:45,584::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:45,584::__init__::232::IOProcess::(_processLogs) (199133) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:45,585::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199133) Queuing response >Thread-178::DEBUG::2014-10-29 11:04:45,587::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-22::DEBUG::2014-10-29 11:04:45,606::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-10-29 11:04:45,607::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-10-29 11:04:45,607::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-10-29 11:04:45,608::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-10-29 11:04:45,608::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-10-29 11:04:45,609::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-10-29 11:04:45,609::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-10-29 11:04:45,610::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-178::DEBUG::2014-10-29 11:04:45,617::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000469164 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:04:45,621::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:45,624::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:45,625::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:45,625::__init__::232::IOProcess::(_processLogs) (199134) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:04:45,626::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199134) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:45,627::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:45,628::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:45,628::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:45,628::__init__::232::IOProcess::(_processLogs) (199135) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:04:45,629::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199135) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:45,631::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:45,632::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:45,634::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:45,636::__init__::232::IOProcess::(_processLogs) (199136) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:04:45,640::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199136) Queuing response >Thread-22::DEBUG::2014-10-29 11:04:45,644::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:04:45,645::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:45,646::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:45,646::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:45,647::__init__::232::IOProcess::(_processLogs) (199137) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:45,648::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199137) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:45,650::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:45,651::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:45,651::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:45,652::__init__::232::IOProcess::(_processLogs) (199138) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:04:45,653::__init__::232::IOProcess::(_processLogs) (199138) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:45,653::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:45,654::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:45,654::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:45,654::__init__::232::IOProcess::(_processLogs) (199139) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:04:45,655::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199139) Queuing response >Thread-22::DEBUG::2014-10-29 11:04:45,656::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:04:45,657::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:45,658::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:45,658::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:45,659::__init__::232::IOProcess::(_processLogs) (199140) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:45,659::__init__::232::IOProcess::(_processLogs) (199140) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:45,661::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:45,661::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:45,661::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:45,662::__init__::232::IOProcess::(_processLogs) (199141) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:04:45,663::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199141) Queuing response >Thread-22::DEBUG::2014-10-29 11:04:45,663::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:04:45,664::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:45,667::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:45,668::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:45,668::__init__::232::IOProcess::(_processLogs) (199142) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:45,668::__init__::232::IOProcess::(_processLogs) (199142) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:45,670::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:45,670::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:45,671::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:45,672::__init__::232::IOProcess::(_processLogs) (199143) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:45,672::__init__::232::IOProcess::(_processLogs) (199143) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:45,673::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:45,673::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:45,674::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:45,674::__init__::232::IOProcess::(_processLogs) (199144) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:45,675::__init__::232::IOProcess::(_processLogs) (199144) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:45,675::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:45,675::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:45,677::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-22::DEBUG::2014-10-29 11:04:45,677::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:04:45,679::__init__::232::IOProcess::(_processLogs) (199145) Got request for method 'glob' >Thread-22::INFO::2014-10-29 11:04:45,679::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-22::INFO::2014-10-29 11:04:45,681::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:04:45,681::__init__::232::IOProcess::(_processLogs) (199145) Queuing response >Thread-135120::INFO::2014-10-29 11:04:45,683::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:04:45,686::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:45,687::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:45,687::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:45,687::__init__::232::IOProcess::(_processLogs) (199146) Got request for method 'stat' >Thread-22::INFO::2014-10-29 11:04:45,689::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010855424', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:04:45,690::task::1191::Storage.TaskManager.Task::(prepare) Task=`61eb6bad-34a7-4316-a60b-c469ec8a559f`::finished: {'truesize': '6010855424', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:04:45,690::task::595::Storage.TaskManager.Task::(_updateState) Task=`61eb6bad-34a7-4316-a60b-c469ec8a559f`::moving from state preparing -> state finished >Thread-22::DEBUG::2014-10-29 11:04:45,690::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17::DEBUG::2014-10-29 11:04:45,689::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199146) Queuing response >Thread-22::DEBUG::2014-10-29 11:04:45,691::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2014-10-29 11:04:45,692::task::993::Storage.TaskManager.Task::(_decref) Task=`61eb6bad-34a7-4316-a60b-c469ec8a559f`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:04:45,693::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:45,694::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:45,694::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:45,694::__init__::232::IOProcess::(_processLogs) (199147) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:45,696::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199147) Queuing response >Thread-33::DEBUG::2014-10-29 11:04:45,698::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:04:45,716::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:45,718::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-33::DEBUG::2014-10-29 11:04:45,719::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000536089 s, 908 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:04:45,720::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:45,722::__init__::232::IOProcess::(_processLogs) (199148) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:04:45,723::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199148) Queuing response >Thread-135120::DEBUG::2014-10-29 11:04:45,724::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:04:45,729::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-135120::DEBUG::2014-10-29 11:04:45,735::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`ea93be34-fddb-4d40-854b-52851e869d05`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135120::DEBUG::2014-10-29 11:04:45,737::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-17::DEBUG::2014-10-29 11:04:45,738::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-135120::DEBUG::2014-10-29 11:04:45,741::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-17::DEBUG::2014-10-29 11:04:45,741::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-135120::DEBUG::2014-10-29 11:04:45,742::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`ea93be34-fddb-4d40-854b-52851e869d05`::Granted request >Thread-135120::DEBUG::2014-10-29 11:04:45,744::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c02d5315-1193-4ac0-b55d-cd32c2d260e2`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135120::DEBUG::2014-10-29 11:04:45,744::task::993::Storage.TaskManager.Task::(_decref) Task=`c02d5315-1193-4ac0-b55d-cd32c2d260e2`::ref 1 aborting False >Thread-17::DEBUG::2014-10-29 11:04:45,743::__init__::232::IOProcess::(_processLogs) (199149) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:45,747::__init__::232::IOProcess::(_processLogs) (199149) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:45,750::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:45,752::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:45,753::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:45,755::__init__::232::IOProcess::(_processLogs) (199150) Got request for method 'access' >Thread-135120::INFO::2014-10-29 11:04:45,757::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-17::DEBUG::2014-10-29 11:04:45,757::__init__::232::IOProcess::(_processLogs) (199150) Queuing response >Thread-135120::DEBUG::2014-10-29 11:04:45,759::task::1191::Storage.TaskManager.Task::(prepare) Task=`c02d5315-1193-4ac0-b55d-cd32c2d260e2`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135120::DEBUG::2014-10-29 11:04:45,760::task::595::Storage.TaskManager.Task::(_updateState) Task=`c02d5315-1193-4ac0-b55d-cd32c2d260e2`::moving from state preparing -> state finished >Thread-135120::DEBUG::2014-10-29 11:04:45,761::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135120::DEBUG::2014-10-29 11:04:45,763::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17::DEBUG::2014-10-29 11:04:45,764::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:45,765::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:45,766::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:45,768::__init__::232::IOProcess::(_processLogs) (199151) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:45,768::__init__::232::IOProcess::(_processLogs) (199151) Queuing response >Thread-135120::DEBUG::2014-10-29 11:04:45,766::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-17::DEBUG::2014-10-29 11:04:45,769::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-135120::DEBUG::2014-10-29 11:04:45,770::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-17::DEBUG::2014-10-29 11:04:45,771::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-135120::DEBUG::2014-10-29 11:04:45,771::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-17::DEBUG::2014-10-29 11:04:45,773::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-135120::DEBUG::2014-10-29 11:04:45,773::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-17::DEBUG::2014-10-29 11:04:45,775::__init__::232::IOProcess::(_processLogs) (199152) Got request for method 'access' >Thread-135120::DEBUG::2014-10-29 11:04:45,777::task::993::Storage.TaskManager.Task::(_decref) Task=`c02d5315-1193-4ac0-b55d-cd32c2d260e2`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:04:45,777::__init__::232::IOProcess::(_processLogs) (199152) Queuing response >Thread-22::DEBUG::2014-10-29 11:04:45,800::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Detector thread::DEBUG::2014-10-29 11:04:45,805::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53777 >Detector thread::DEBUG::2014-10-29 11:04:45,805::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53777 >Detector thread::DEBUG::2014-10-29 11:04:45,805::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53777 >Detector thread::DEBUG::2014-10-29 11:04:45,806::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53777) >Thread-135125::DEBUG::2014-10-29 11:04:45,845::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135125::DEBUG::2014-10-29 11:04:45,845::task::595::Storage.TaskManager.Task::(_updateState) Task=`1b09e173-57d8-4820-9719-310c8cb2cf3f`::moving from state init -> state preparing >Thread-135125::INFO::2014-10-29 11:04:45,846::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135125::INFO::2014-10-29 11:04:45,847::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000469164', 'lastCheck': '0.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000536089', 'lastCheck': '0.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461556', 'lastCheck': '8.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000583637', 'lastCheck': '8.4', 'valid': True}} >Thread-135125::DEBUG::2014-10-29 11:04:45,847::task::1191::Storage.TaskManager.Task::(prepare) Task=`1b09e173-57d8-4820-9719-310c8cb2cf3f`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000469164', 'lastCheck': '0.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000536089', 'lastCheck': '0.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461556', 'lastCheck': '8.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000583637', 'lastCheck': '8.4', 'valid': True}} >Thread-135125::DEBUG::2014-10-29 11:04:45,847::task::595::Storage.TaskManager.Task::(_updateState) Task=`1b09e173-57d8-4820-9719-310c8cb2cf3f`::moving from state preparing -> state finished >Thread-135125::DEBUG::2014-10-29 11:04:45,847::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135125::DEBUG::2014-10-29 11:04:45,848::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135125::DEBUG::2014-10-29 11:04:45,848::task::993::Storage.TaskManager.Task::(_decref) Task=`1b09e173-57d8-4820-9719-310c8cb2cf3f`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:04:47,464::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:47,465::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:47,465::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:47,465::__init__::232::IOProcess::(_processLogs) (199153) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:47,468::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:47,468::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:47,468::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:47,469::__init__::232::IOProcess::(_processLogs) (199154) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:47,796::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199154) Queuing response >Thread-179::DEBUG::2014-10-29 11:04:47,798::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:04:47,799::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199153) Queuing response >Thread-179::DEBUG::2014-10-29 11:04:47,818::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000470169 s, 791 kB/s\n'; <rc> = 0 >Thread-10269::DEBUG::2014-10-29 11:04:47,823::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:04:47,824::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:47,841::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:47,843::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-10269::DEBUG::2014-10-29 11:04:47,844::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000467078 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:04:47,845::__init__::232::IOProcess::(_processLogs) (199155) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:47,849::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199155) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:47,851::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:47,852::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:47,852::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:47,852::__init__::232::IOProcess::(_processLogs) (199156) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:47,854::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199156) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:48,239::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:48,241::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135126::DEBUG::2014-10-29 11:04:48,245::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:48,247::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:48,249::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135127::DEBUG::2014-10-29 11:04:48,253::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135127::DEBUG::2014-10-29 11:04:48,255::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:48,348::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:48,349::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:48,351::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:04:48,979::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53778 >Detector thread::DEBUG::2014-10-29 11:04:48,979::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53778 >Detector thread::DEBUG::2014-10-29 11:04:48,980::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53778 >Detector thread::DEBUG::2014-10-29 11:04:48,980::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53778) >Thread-135128::DEBUG::2014-10-29 11:04:49,019::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135128::DEBUG::2014-10-29 11:04:49,021::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135128::DEBUG::2014-10-29 11:04:49,039::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135128::DEBUG::2014-10-29 11:04:49,097::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '31', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '31', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:04:50,075::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53779 >Detector thread::DEBUG::2014-10-29 11:04:50,076::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53779 >Detector thread::DEBUG::2014-10-29 11:04:50,076::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53779 >Detector thread::DEBUG::2014-10-29 11:04:50,077::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53779) >Thread-135129::DEBUG::2014-10-29 11:04:50,116::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135129::DEBUG::2014-10-29 11:04:50,117::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135129::DEBUG::2014-10-29 11:04:50,118::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.62', 'elapsedTime': '513322', 'displayType': 'vnc', 'cpuSys': '0.49', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '41967372', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '60000', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '30115.58'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.30', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:04:50,342::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53781 >Detector thread::DEBUG::2014-10-29 11:04:50,343::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53781 >Detector thread::DEBUG::2014-10-29 11:04:50,343::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53781 >Detector thread::DEBUG::2014-10-29 11:04:50,343::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53781) >Thread-135130::DEBUG::2014-10-29 11:04:50,383::task::595::Storage.TaskManager.Task::(_updateState) Task=`4e47359c-1513-469e-ac1c-1760a2ca3a89`::moving from state init -> state preparing >Thread-135130::INFO::2014-10-29 11:04:50,383::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135130::INFO::2014-10-29 11:04:50,384::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000469164', 'lastCheck': '4.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000536089', 'lastCheck': '4.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000470169', 'lastCheck': '2.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000467078', 'lastCheck': '2.5', 'valid': True}} >Thread-135130::DEBUG::2014-10-29 11:04:50,384::task::1191::Storage.TaskManager.Task::(prepare) Task=`4e47359c-1513-469e-ac1c-1760a2ca3a89`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000469164', 'lastCheck': '4.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000536089', 'lastCheck': '4.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000470169', 'lastCheck': '2.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000467078', 'lastCheck': '2.5', 'valid': True}} >Thread-135130::DEBUG::2014-10-29 11:04:50,385::task::595::Storage.TaskManager.Task::(_updateState) Task=`4e47359c-1513-469e-ac1c-1760a2ca3a89`::moving from state preparing -> state finished >Thread-135130::DEBUG::2014-10-29 11:04:50,385::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135130::DEBUG::2014-10-29 11:04:50,385::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135130::DEBUG::2014-10-29 11:04:50,385::task::993::Storage.TaskManager.Task::(_decref) Task=`4e47359c-1513-469e-ac1c-1760a2ca3a89`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:51,268::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:51,271::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135131::DEBUG::2014-10-29 11:04:51,276::task::595::Storage.TaskManager.Task::(_updateState) Task=`c21f228d-9443-4033-9f35-c58db7a7a5a7`::moving from state init -> state preparing >Thread-135131::INFO::2014-10-29 11:04:51,276::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135131::INFO::2014-10-29 11:04:51,277::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000469164', 'lastCheck': '5.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000536089', 'lastCheck': '5.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000470169', 'lastCheck': '3.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000467078', 'lastCheck': '3.4', 'valid': True}} >Thread-135131::DEBUG::2014-10-29 11:04:51,277::task::1191::Storage.TaskManager.Task::(prepare) Task=`c21f228d-9443-4033-9f35-c58db7a7a5a7`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000469164', 'lastCheck': '5.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000536089', 'lastCheck': '5.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000470169', 'lastCheck': '3.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000467078', 'lastCheck': '3.4', 'valid': True}} >Thread-135131::DEBUG::2014-10-29 11:04:51,278::task::595::Storage.TaskManager.Task::(_updateState) Task=`c21f228d-9443-4033-9f35-c58db7a7a5a7`::moving from state preparing -> state finished >Thread-135131::DEBUG::2014-10-29 11:04:51,278::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135131::DEBUG::2014-10-29 11:04:51,278::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135131::DEBUG::2014-10-29 11:04:51,278::task::993::Storage.TaskManager.Task::(_decref) Task=`c21f228d-9443-4033-9f35-c58db7a7a5a7`::ref 0 aborting False >Thread-135131::DEBUG::2014-10-29 11:04:51,301::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:51,324::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:51,325::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135132::DEBUG::2014-10-29 11:04:51,329::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135132::DEBUG::2014-10-29 11:04:51,331::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:53,358::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:53,360::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:53,361::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:54,421::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:54,423::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135133::DEBUG::2014-10-29 11:04:54,426::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:54,428::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:54,430::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135134::DEBUG::2014-10-29 11:04:54,433::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135134::DEBUG::2014-10-29 11:04:54,438::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:04:55,678::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:55,680::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-178::DEBUG::2014-10-29 11:04:55,682::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:04:55,682::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:55,702::__init__::232::IOProcess::(_processLogs) (199157) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:04:55,704::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000459526 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:04:55,705::__init__::232::IOProcess::(_processLogs) (199157) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:55,708::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:55,708::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:55,708::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:55,710::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199158) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:55,712::__init__::232::IOProcess::(_processLogs) (199158) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:55,712::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:55,713::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:55,713::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:55,713::__init__::232::IOProcess::(_processLogs) (199159) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:55,714::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199159) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:55,715::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:55,715::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:55,716::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:55,716::__init__::232::IOProcess::(_processLogs) (199160) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:55,717::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199160) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:55,718::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:55,718::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:55,719::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:55,719::__init__::232::IOProcess::(_processLogs) (199161) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:55,720::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199161) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:55,784::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:55,786::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-33::DEBUG::2014-10-29 11:04:55,788::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:04:55,788::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:55,804::__init__::232::IOProcess::(_processLogs) (199162) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:55,805::__init__::232::IOProcess::(_processLogs) (199162) Queuing response >Thread-33::DEBUG::2014-10-29 11:04:55,807::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000538356 s, 905 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:04:55,808::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:55,809::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:55,809::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:55,809::__init__::232::IOProcess::(_processLogs) (199163) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:55,811::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199163) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:55,813::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:55,813::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:55,813::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:55,813::__init__::232::IOProcess::(_processLogs) (199164) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:55,814::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199164) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:55,815::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:55,816::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:55,816::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:55,816::__init__::232::IOProcess::(_processLogs) (199165) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:55,816::__init__::232::IOProcess::(_processLogs) (199165) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:55,819::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:55,820::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:55,820::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:55,820::__init__::232::IOProcess::(_processLogs) (199166) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:55,821::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199166) Queuing response >Detector thread::DEBUG::2014-10-29 11:04:56,455::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53783 >Detector thread::DEBUG::2014-10-29 11:04:56,456::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53783 >Detector thread::DEBUG::2014-10-29 11:04:56,456::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53783 >Detector thread::DEBUG::2014-10-29 11:04:56,457::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53783) >Thread-135135::DEBUG::2014-10-29 11:04:56,496::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135135::DEBUG::2014-10-29 11:04:56,497::task::595::Storage.TaskManager.Task::(_updateState) Task=`527c8da9-c25e-46e8-9d1b-5a7313565027`::moving from state init -> state preparing >Thread-135135::INFO::2014-10-29 11:04:56,497::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135135::DEBUG::2014-10-29 11:04:56,501::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:04:56,505::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:56,505::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:56,506::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:56,506::__init__::232::IOProcess::(_processLogs) (199167) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:04:57,290::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199167) Queuing response >Thread-135135::DEBUG::2014-10-29 11:04:57,291::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135135::DEBUG::2014-10-29 11:04:57,291::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135135::INFO::2014-10-29 11:04:57,292::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135135::DEBUG::2014-10-29 11:04:57,292::task::1191::Storage.TaskManager.Task::(prepare) Task=`527c8da9-c25e-46e8-9d1b-5a7313565027`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135135::DEBUG::2014-10-29 11:04:57,292::task::595::Storage.TaskManager.Task::(_updateState) Task=`527c8da9-c25e-46e8-9d1b-5a7313565027`::moving from state preparing -> state finished >Thread-135135::DEBUG::2014-10-29 11:04:57,292::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135135::DEBUG::2014-10-29 11:04:57,293::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135135::DEBUG::2014-10-29 11:04:57,293::task::993::Storage.TaskManager.Task::(_decref) Task=`527c8da9-c25e-46e8-9d1b-5a7313565027`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:04:57,337::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53784 >Detector thread::DEBUG::2014-10-29 11:04:57,338::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53784 >Detector thread::DEBUG::2014-10-29 11:04:57,338::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53784 >Detector thread::DEBUG::2014-10-29 11:04:57,338::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53784) >Thread-135136::DEBUG::2014-10-29 11:04:57,377::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135136::DEBUG::2014-10-29 11:04:57,378::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc4a2aec-191a-4a1e-80bf-fa28b8475b0d`::moving from state init -> state preparing >Thread-135136::INFO::2014-10-29 11:04:57,378::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135136::DEBUG::2014-10-29 11:04:57,378::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135136::DEBUG::2014-10-29 11:04:57,379::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135136::DEBUG::2014-10-29 11:04:57,379::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135136::DEBUG::2014-10-29 11:04:57,379::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135136::DEBUG::2014-10-29 11:04:57,379::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135136::DEBUG::2014-10-29 11:04:57,380::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:57,458::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:57,462::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135136::DEBUG::2014-10-29 11:04:57,467::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135137::DEBUG::2014-10-29 11:04:57,470::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-135136::DEBUG::2014-10-29 11:04:57,470::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:04:57,491::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:04:57,497::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135138::DEBUG::2014-10-29 11:04:57,501::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135138::DEBUG::2014-10-29 11:04:57,504::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-135136::DEBUG::2014-10-29 11:04:57,656::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135136::DEBUG::2014-10-29 11:04:57,657::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135136::DEBUG::2014-10-29 11:04:57,657::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135136::DEBUG::2014-10-29 11:04:57,657::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135136::DEBUG::2014-10-29 11:04:57,658::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135136::DEBUG::2014-10-29 11:04:57,658::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135136::DEBUG::2014-10-29 11:04:57,658::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135136::DEBUG::2014-10-29 11:04:57,659::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:04:57,666::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:57,667::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:57,667::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:57,668::__init__::232::IOProcess::(_processLogs) (199168) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:04:57,668::__init__::232::IOProcess::(_processLogs) (199168) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:57,670::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:57,670::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:57,671::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:57,671::__init__::232::IOProcess::(_processLogs) (199169) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:04:57,672::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199169) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:57,673::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:57,673::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:57,674::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:57,674::__init__::232::IOProcess::(_processLogs) (199170) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:04:57,676::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199170) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:57,681::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:57,681::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:57,683::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:57,686::__init__::232::IOProcess::(_processLogs) (199171) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:04:57,687::__init__::232::IOProcess::(_processLogs) (199171) Queuing response >Thread-135136::DEBUG::2014-10-29 11:04:57,689::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:04:57,690::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:57,691::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:57,691::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:57,691::__init__::232::IOProcess::(_processLogs) (199172) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:04:57,692::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199172) Queuing response >Thread-135136::DEBUG::2014-10-29 11:04:57,693::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:04:57,694::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:57,694::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:57,694::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:57,694::__init__::232::IOProcess::(_processLogs) (199173) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:04:57,695::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199173) Queuing response >Thread-135136::DEBUG::2014-10-29 11:04:57,695::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:04:57,698::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:57,698::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:57,698::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:57,698::__init__::232::IOProcess::(_processLogs) (199174) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:04:57,699::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199174) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:57,700::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:57,700::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:57,701::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:57,701::__init__::232::IOProcess::(_processLogs) (199175) Got request for method 'glob' >Thread-135136::DEBUG::2014-10-29 11:04:57,702::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:04:57,702::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199175) Queuing response >Thread-135136::INFO::2014-10-29 11:04:57,703::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135136::INFO::2014-10-29 11:04:57,704::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135136::INFO::2014-10-29 11:04:57,704::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:04:57,705::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:57,705::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:57,705::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:57,706::__init__::232::IOProcess::(_processLogs) (199176) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:04:57,706::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199176) Queuing response >Thread-135136::DEBUG::2014-10-29 11:04:57,707::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135136::DEBUG::2014-10-29 11:04:57,709::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`be473158-88ae-49af-a4de-47f8c84b2b68`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135136::DEBUG::2014-10-29 11:04:57,709::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135136::DEBUG::2014-10-29 11:04:57,709::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135136::DEBUG::2014-10-29 11:04:57,710::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`be473158-88ae-49af-a4de-47f8c84b2b68`::Granted request >Thread-135136::DEBUG::2014-10-29 11:04:57,710::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`dc4a2aec-191a-4a1e-80bf-fa28b8475b0d`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135136::DEBUG::2014-10-29 11:04:57,711::task::993::Storage.TaskManager.Task::(_decref) Task=`dc4a2aec-191a-4a1e-80bf-fa28b8475b0d`::ref 1 aborting False >Thread-135136::INFO::2014-10-29 11:04:57,713::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135136::DEBUG::2014-10-29 11:04:57,714::task::1191::Storage.TaskManager.Task::(prepare) Task=`dc4a2aec-191a-4a1e-80bf-fa28b8475b0d`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135136::DEBUG::2014-10-29 11:04:57,714::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc4a2aec-191a-4a1e-80bf-fa28b8475b0d`::moving from state preparing -> state finished >Thread-135136::DEBUG::2014-10-29 11:04:57,714::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135136::DEBUG::2014-10-29 11:04:57,714::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135136::DEBUG::2014-10-29 11:04:57,715::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135136::DEBUG::2014-10-29 11:04:57,715::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135136::DEBUG::2014-10-29 11:04:57,715::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135136::DEBUG::2014-10-29 11:04:57,716::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135136::DEBUG::2014-10-29 11:04:57,716::task::993::Storage.TaskManager.Task::(_decref) Task=`dc4a2aec-191a-4a1e-80bf-fa28b8475b0d`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:04:57,736::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53785 >Detector thread::DEBUG::2014-10-29 11:04:57,737::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53785 >Detector thread::DEBUG::2014-10-29 11:04:57,737::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53785 >Detector thread::DEBUG::2014-10-29 11:04:57,737::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53785) >Thread-135143::DEBUG::2014-10-29 11:04:57,776::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135143::DEBUG::2014-10-29 11:04:57,777::task::595::Storage.TaskManager.Task::(_updateState) Task=`5cf76568-430e-4ac1-bd97-d6d35414fdb4`::moving from state init -> state preparing >Thread-135143::INFO::2014-10-29 11:04:57,777::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135143::INFO::2014-10-29 11:04:57,778::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000459526', 'lastCheck': '2.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538356', 'lastCheck': '2.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000470169', 'lastCheck': '9.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000467078', 'lastCheck': '9.9', 'valid': True}} >Thread-135143::DEBUG::2014-10-29 11:04:57,778::task::1191::Storage.TaskManager.Task::(prepare) Task=`5cf76568-430e-4ac1-bd97-d6d35414fdb4`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000459526', 'lastCheck': '2.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538356', 'lastCheck': '2.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000470169', 'lastCheck': '9.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000467078', 'lastCheck': '9.9', 'valid': True}} >Thread-135143::DEBUG::2014-10-29 11:04:57,778::task::595::Storage.TaskManager.Task::(_updateState) Task=`5cf76568-430e-4ac1-bd97-d6d35414fdb4`::moving from state preparing -> state finished >Thread-135143::DEBUG::2014-10-29 11:04:57,779::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135143::DEBUG::2014-10-29 11:04:57,779::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135143::DEBUG::2014-10-29 11:04:57,779::task::993::Storage.TaskManager.Task::(_decref) Task=`5cf76568-430e-4ac1-bd97-d6d35414fdb4`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:04:57,852::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:57,854::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-179::DEBUG::2014-10-29 11:04:57,856::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:04:57,856::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:57,878::__init__::232::IOProcess::(_processLogs) (199177) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:57,879::__init__::232::IOProcess::(_processLogs) (199177) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:57,880::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:57,880::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:57,880::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:57,881::__init__::232::IOProcess::(_processLogs) (199178) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:57,881::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199178) Queuing response >Thread-10269::DEBUG::2014-10-29 11:04:57,883::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:04:57,905::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00905364 s, 41.1 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:04:57,909::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-10269::DEBUG::2014-10-29 11:04:57,910::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00235606 s, 213 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:04:57,910::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:57,912::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:57,912::__init__::232::IOProcess::(_processLogs) (199179) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:57,914::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199179) Queuing response >Thread-17::DEBUG::2014-10-29 11:04:57,919::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:04:57,921::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:04:57,921::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:04:57,921::__init__::232::IOProcess::(_processLogs) (199180) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:04:57,921::__init__::232::IOProcess::(_processLogs) (199180) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:58,371::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:58,372::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:04:58,375::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:04:59,154::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53786 >Detector thread::DEBUG::2014-10-29 11:04:59,155::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53786 >Detector thread::DEBUG::2014-10-29 11:04:59,155::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53786 >Detector thread::DEBUG::2014-10-29 11:04:59,155::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53786) >Thread-135144::DEBUG::2014-10-29 11:04:59,194::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135144::DEBUG::2014-10-29 11:04:59,196::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135144::DEBUG::2014-10-29 11:04:59,216::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135144::DEBUG::2014-10-29 11:04:59,263::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '14', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '14', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:04:59,278::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53787 >Detector thread::DEBUG::2014-10-29 11:04:59,284::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53787 >Detector thread::DEBUG::2014-10-29 11:04:59,284::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53787 >Detector thread::DEBUG::2014-10-29 11:04:59,285::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53787) >Thread-135145::DEBUG::2014-10-29 11:04:59,324::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135145::DEBUG::2014-10-29 11:04:59,325::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135145::DEBUG::2014-10-29 11:04:59,326::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.62', 'elapsedTime': '513331', 'displayType': 'vnc', 'cpuSys': '0.49', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '41967372', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '60000', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '30115.58'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.51', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:05:00,445::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53789 >Detector thread::DEBUG::2014-10-29 11:05:00,445::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53789 >Detector thread::DEBUG::2014-10-29 11:05:00,446::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53789 >Detector thread::DEBUG::2014-10-29 11:05:00,446::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53789) >Thread-135146::DEBUG::2014-10-29 11:05:00,486::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd7c7fda-7f9c-45d6-80c4-854cb60500e5`::moving from state init -> state preparing >Thread-135146::INFO::2014-10-29 11:05:00,486::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135146::INFO::2014-10-29 11:05:00,487::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000459526', 'lastCheck': '4.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538356', 'lastCheck': '4.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00905364', 'lastCheck': '2.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00235606', 'lastCheck': '2.6', 'valid': True}} >Thread-135146::DEBUG::2014-10-29 11:05:00,487::task::1191::Storage.TaskManager.Task::(prepare) Task=`dd7c7fda-7f9c-45d6-80c4-854cb60500e5`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000459526', 'lastCheck': '4.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538356', 'lastCheck': '4.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00905364', 'lastCheck': '2.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00235606', 'lastCheck': '2.6', 'valid': True}} >Thread-135146::DEBUG::2014-10-29 11:05:00,488::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd7c7fda-7f9c-45d6-80c4-854cb60500e5`::moving from state preparing -> state finished >Thread-135146::DEBUG::2014-10-29 11:05:00,488::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135146::DEBUG::2014-10-29 11:05:00,488::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135146::DEBUG::2014-10-29 11:05:00,488::task::993::Storage.TaskManager.Task::(_decref) Task=`dd7c7fda-7f9c-45d6-80c4-854cb60500e5`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:00,519::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:00,522::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135147::DEBUG::2014-10-29 11:05:00,530::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:00,534::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:00,537::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135148::DEBUG::2014-10-29 11:05:00,547::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135148::DEBUG::2014-10-29 11:05:00,565::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:05:00,841::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >VM Channels Listener::DEBUG::2014-10-29 11:05:03,006::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:03,383::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:03,384::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:03,386::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:03,580::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:03,586::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135149::DEBUG::2014-10-29 11:05:03,589::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:03,592::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:03,594::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135150::DEBUG::2014-10-29 11:05:03,597::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135150::DEBUG::2014-10-29 11:05:03,599::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:05:05,722::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:05,722::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:05,722::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:05,723::__init__::232::IOProcess::(_processLogs) (199181) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:05,723::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199181) Queuing response >Thread-178::DEBUG::2014-10-29 11:05:05,725::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:05:05,748::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000553823 s, 917 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:05:05,753::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:05,753::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:05,754::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:05,754::__init__::232::IOProcess::(_processLogs) (199182) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:05,756::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199182) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:05,758::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:05,759::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:05,760::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:05,760::__init__::232::IOProcess::(_processLogs) (199183) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:05,760::__init__::232::IOProcess::(_processLogs) (199183) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:05,761::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:05,761::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:05,762::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:05,762::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199184) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:05,763::__init__::232::IOProcess::(_processLogs) (199184) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:05,764::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:05,764::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:05,764::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:05,765::__init__::232::IOProcess::(_processLogs) (199185) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:05,766::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199185) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:05,824::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:05,825::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:05,825::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:05,825::__init__::232::IOProcess::(_processLogs) (199186) Got request for method 'statvfs' >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:06,612::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:06,616::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135151::DEBUG::2014-10-29 11:05:06,619::task::595::Storage.TaskManager.Task::(_updateState) Task=`6019a8cc-0b0d-4e64-8dd1-3746236cded1`::moving from state init -> state preparing >Thread-135151::INFO::2014-10-29 11:05:06,620::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135151::INFO::2014-10-29 11:05:06,621::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000553823', 'lastCheck': '0.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538356', 'lastCheck': '10.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00905364', 'lastCheck': '8.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00235606', 'lastCheck': '8.7', 'valid': True}} >Thread-135151::DEBUG::2014-10-29 11:05:06,621::task::1191::Storage.TaskManager.Task::(prepare) Task=`6019a8cc-0b0d-4e64-8dd1-3746236cded1`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000553823', 'lastCheck': '0.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538356', 'lastCheck': '10.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00905364', 'lastCheck': '8.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00235606', 'lastCheck': '8.7', 'valid': True}} >Thread-135151::DEBUG::2014-10-29 11:05:06,621::task::595::Storage.TaskManager.Task::(_updateState) Task=`6019a8cc-0b0d-4e64-8dd1-3746236cded1`::moving from state preparing -> state finished >Thread-135151::DEBUG::2014-10-29 11:05:06,621::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135151::DEBUG::2014-10-29 11:05:06,622::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135151::DEBUG::2014-10-29 11:05:06,622::task::993::Storage.TaskManager.Task::(_decref) Task=`6019a8cc-0b0d-4e64-8dd1-3746236cded1`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:05:07,919::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:07,919::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:07,920::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:07,920::__init__::232::IOProcess::(_processLogs) (199187) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:07,921::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:07,922::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:07,923::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:07,924::__init__::232::IOProcess::(_processLogs) (199188) Got request for method 'statvfs' >Detector thread::DEBUG::2014-10-29 11:05:08,324::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53790 >Detector thread::DEBUG::2014-10-29 11:05:08,325::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53790 >Detector thread::DEBUG::2014-10-29 11:05:08,325::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53790 >Detector thread::DEBUG::2014-10-29 11:05:08,326::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53790) >Thread-135152::DEBUG::2014-10-29 11:05:08,364::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135152::DEBUG::2014-10-29 11:05:08,366::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135152::DEBUG::2014-10-29 11:05:08,385::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:08,393::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:08,414::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:08,421::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135152::DEBUG::2014-10-29 11:05:08,466::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '94', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '94', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-17::DEBUG::2014-10-29 11:05:08,794::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199186) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:08,796::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199188) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:08,798::__init__::232::IOProcess::(_processLogs) (199187) Queuing response >Thread-33::DEBUG::2014-10-29 11:05:08,799::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:05:08,824::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:05:08,843::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:05:08,869::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00283394 s, 131 kB/s\n'; <rc> = 0 >Thread-10269::DEBUG::2014-10-29 11:05:08,868::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00664701 s, 75.5 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:05:08,881::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-33::DEBUG::2014-10-29 11:05:08,879::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.0067722 s, 71.9 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:05:08,884::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:08,886::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:08,886::__init__::232::IOProcess::(_processLogs) (199189) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:08,886::__init__::232::IOProcess::(_processLogs) (199189) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:08,892::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:08,896::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:08,898::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:08,899::__init__::232::IOProcess::(_processLogs) (199190) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:08,901::__init__::232::IOProcess::(_processLogs) (199190) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:08,905::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:08,906::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:08,914::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:08,915::__init__::232::IOProcess::(_processLogs) (199191) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:08,917::__init__::232::IOProcess::(_processLogs) (199191) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:08,921::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:08,923::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:08,925::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:08,927::__init__::232::IOProcess::(_processLogs) (199192) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:08,929::__init__::232::IOProcess::(_processLogs) (199192) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:08,935::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:08,938::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:08,939::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-135151::DEBUG::2014-10-29 11:05:08,939::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:05:08,940::__init__::232::IOProcess::(_processLogs) (199193) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:08,943::__init__::232::IOProcess::(_processLogs) (199193) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:08,944::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:08,944::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:08,944::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:08,945::__init__::232::IOProcess::(_processLogs) (199194) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:08,945::__init__::232::IOProcess::(_processLogs) (199194) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:08,967::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:08,972::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135153::DEBUG::2014-10-29 11:05:08,976::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135153::DEBUG::2014-10-29 11:05:08,978::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:05:09,280::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53792 >Detector thread::DEBUG::2014-10-29 11:05:09,280::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53792 >Detector thread::DEBUG::2014-10-29 11:05:09,280::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53792 >Detector thread::DEBUG::2014-10-29 11:05:09,281::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53792) >Thread-135154::DEBUG::2014-10-29 11:05:09,321::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135154::DEBUG::2014-10-29 11:05:09,322::task::595::Storage.TaskManager.Task::(_updateState) Task=`e79e1a4a-bb12-4784-9b76-5c7ae410bd70`::moving from state init -> state preparing >Thread-135154::INFO::2014-10-29 11:05:09,322::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135154::DEBUG::2014-10-29 11:05:09,326::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:05:09,327::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:09,327::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:09,327::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:09,327::__init__::232::IOProcess::(_processLogs) (199195) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:05:09,328::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199195) Queuing response >Thread-135154::DEBUG::2014-10-29 11:05:09,328::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135154::DEBUG::2014-10-29 11:05:09,330::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135154::INFO::2014-10-29 11:05:09,330::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135154::DEBUG::2014-10-29 11:05:09,330::task::1191::Storage.TaskManager.Task::(prepare) Task=`e79e1a4a-bb12-4784-9b76-5c7ae410bd70`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135154::DEBUG::2014-10-29 11:05:09,331::task::595::Storage.TaskManager.Task::(_updateState) Task=`e79e1a4a-bb12-4784-9b76-5c7ae410bd70`::moving from state preparing -> state finished >Thread-135154::DEBUG::2014-10-29 11:05:09,331::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135154::DEBUG::2014-10-29 11:05:09,331::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135154::DEBUG::2014-10-29 11:05:09,331::task::993::Storage.TaskManager.Task::(_decref) Task=`e79e1a4a-bb12-4784-9b76-5c7ae410bd70`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:05:09,375::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53793 >Detector thread::DEBUG::2014-10-29 11:05:09,375::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53793 >Detector thread::DEBUG::2014-10-29 11:05:09,375::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53793 >Detector thread::DEBUG::2014-10-29 11:05:09,376::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53793) >Thread-135155::DEBUG::2014-10-29 11:05:09,415::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135155::DEBUG::2014-10-29 11:05:09,416::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d29cde2-4c69-4822-a932-d6c29221c910`::moving from state init -> state preparing >Thread-135155::INFO::2014-10-29 11:05:09,416::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135155::DEBUG::2014-10-29 11:05:09,417::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135155::DEBUG::2014-10-29 11:05:09,417::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135155::DEBUG::2014-10-29 11:05:09,417::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135155::DEBUG::2014-10-29 11:05:09,417::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135155::DEBUG::2014-10-29 11:05:09,418::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135155::DEBUG::2014-10-29 11:05:09,418::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Detector thread::DEBUG::2014-10-29 11:05:09,477::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53794 >Detector thread::DEBUG::2014-10-29 11:05:09,478::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53794 >Detector thread::DEBUG::2014-10-29 11:05:09,478::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53794 >Detector thread::DEBUG::2014-10-29 11:05:09,479::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53794) >Thread-135155::DEBUG::2014-10-29 11:05:09,516::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135155::DEBUG::2014-10-29 11:05:09,517::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135156::DEBUG::2014-10-29 11:05:09,534::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135156::DEBUG::2014-10-29 11:05:09,536::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135156::DEBUG::2014-10-29 11:05:09,536::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.97', 'elapsedTime': '513342', 'displayType': 'vnc', 'cpuSys': '1.32', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '41967372', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '60000', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '30115.58'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.69', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-135155::DEBUG::2014-10-29 11:05:09,748::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135155::DEBUG::2014-10-29 11:05:09,749::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135155::DEBUG::2014-10-29 11:05:09,749::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135155::DEBUG::2014-10-29 11:05:09,750::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135155::DEBUG::2014-10-29 11:05:09,750::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135155::DEBUG::2014-10-29 11:05:09,750::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135155::DEBUG::2014-10-29 11:05:09,751::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135155::DEBUG::2014-10-29 11:05:09,751::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:05:09,754::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:09,755::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:09,755::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:09,755::__init__::232::IOProcess::(_processLogs) (199196) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:05:09,757::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199196) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:09,762::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:09,762::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:09,763::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:09,763::__init__::232::IOProcess::(_processLogs) (199197) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:05:09,763::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:09,763::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:09,764::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:09,764::__init__::232::IOProcess::(_processLogs) (199198) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:05:09,764::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:09,764::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:09,765::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:09,767::__init__::232::IOProcess::(_processLogs) (199199) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:05:09,769::__init__::232::IOProcess::(_processLogs) (199197) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:09,771::__init__::232::IOProcess::(_processLogs) (199198) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:09,773::__init__::232::IOProcess::(_processLogs) (199199) Queuing response >Thread-135155::DEBUG::2014-10-29 11:05:09,779::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:05:09,782::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:09,782::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:09,782::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:09,782::__init__::232::IOProcess::(_processLogs) (199200) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:05:09,783::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199200) Queuing response >Thread-135155::DEBUG::2014-10-29 11:05:09,784::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:05:09,785::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:09,785::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:09,786::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:09,786::__init__::232::IOProcess::(_processLogs) (199201) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:05:09,786::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199201) Queuing response >Thread-135155::DEBUG::2014-10-29 11:05:09,787::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:05:09,788::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:09,789::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:09,790::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:09,790::__init__::232::IOProcess::(_processLogs) (199202) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:09,790::__init__::232::IOProcess::(_processLogs) (199202) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:09,791::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:09,791::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:09,791::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:09,792::__init__::232::IOProcess::(_processLogs) (199203) Got request for method 'glob' >Thread-135155::DEBUG::2014-10-29 11:05:09,792::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:05:09,792::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199203) Queuing response >Thread-135155::INFO::2014-10-29 11:05:09,794::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135155::INFO::2014-10-29 11:05:09,794::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135155::INFO::2014-10-29 11:05:09,795::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:05:09,796::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:09,796::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:09,796::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:09,797::__init__::232::IOProcess::(_processLogs) (199204) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:05:09,797::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199204) Queuing response >Thread-135155::DEBUG::2014-10-29 11:05:09,798::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135155::DEBUG::2014-10-29 11:05:09,800::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`15edae78-1da3-4bb2-88d9-fbd39ff20b0b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135155::DEBUG::2014-10-29 11:05:09,800::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135155::DEBUG::2014-10-29 11:05:09,800::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135155::DEBUG::2014-10-29 11:05:09,801::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`15edae78-1da3-4bb2-88d9-fbd39ff20b0b`::Granted request >Thread-135155::DEBUG::2014-10-29 11:05:09,801::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8d29cde2-4c69-4822-a932-d6c29221c910`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135155::DEBUG::2014-10-29 11:05:09,802::task::993::Storage.TaskManager.Task::(_decref) Task=`8d29cde2-4c69-4822-a932-d6c29221c910`::ref 1 aborting False >Thread-135155::INFO::2014-10-29 11:05:09,804::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135155::DEBUG::2014-10-29 11:05:09,805::task::1191::Storage.TaskManager.Task::(prepare) Task=`8d29cde2-4c69-4822-a932-d6c29221c910`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135155::DEBUG::2014-10-29 11:05:09,805::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d29cde2-4c69-4822-a932-d6c29221c910`::moving from state preparing -> state finished >Thread-135155::DEBUG::2014-10-29 11:05:09,805::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135155::DEBUG::2014-10-29 11:05:09,805::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135155::DEBUG::2014-10-29 11:05:09,806::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135155::DEBUG::2014-10-29 11:05:09,806::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135155::DEBUG::2014-10-29 11:05:09,806::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135155::DEBUG::2014-10-29 11:05:09,807::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135155::DEBUG::2014-10-29 11:05:09,807::task::993::Storage.TaskManager.Task::(_decref) Task=`8d29cde2-4c69-4822-a932-d6c29221c910`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:05:09,829::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53796 >Detector thread::DEBUG::2014-10-29 11:05:09,829::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53796 >Detector thread::DEBUG::2014-10-29 11:05:09,830::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53796 >Detector thread::DEBUG::2014-10-29 11:05:09,830::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53796) >Thread-135161::DEBUG::2014-10-29 11:05:09,869::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135161::DEBUG::2014-10-29 11:05:09,869::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9e25d14-0398-4e06-9c86-0a6310b503cc`::moving from state init -> state preparing >Thread-135161::INFO::2014-10-29 11:05:09,870::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135161::INFO::2014-10-29 11:05:09,870::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000553823', 'lastCheck': '4.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0067722', 'lastCheck': '0.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00283394', 'lastCheck': '1.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00664701', 'lastCheck': '1.0', 'valid': True}} >Thread-135161::DEBUG::2014-10-29 11:05:09,871::task::1191::Storage.TaskManager.Task::(prepare) Task=`e9e25d14-0398-4e06-9c86-0a6310b503cc`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000553823', 'lastCheck': '4.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0067722', 'lastCheck': '0.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00283394', 'lastCheck': '1.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00664701', 'lastCheck': '1.0', 'valid': True}} >Thread-135161::DEBUG::2014-10-29 11:05:09,871::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9e25d14-0398-4e06-9c86-0a6310b503cc`::moving from state preparing -> state finished >Thread-135161::DEBUG::2014-10-29 11:05:09,871::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135161::DEBUG::2014-10-29 11:05:09,871::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135161::DEBUG::2014-10-29 11:05:09,872::task::993::Storage.TaskManager.Task::(_decref) Task=`e9e25d14-0398-4e06-9c86-0a6310b503cc`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:05:10,605::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53797 >Detector thread::DEBUG::2014-10-29 11:05:10,606::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53797 >Detector thread::DEBUG::2014-10-29 11:05:10,606::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53797 >Detector thread::DEBUG::2014-10-29 11:05:10,606::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53797) >Thread-135162::DEBUG::2014-10-29 11:05:10,647::task::595::Storage.TaskManager.Task::(_updateState) Task=`71db483d-0324-4e71-8969-ced4fb7a6dd8`::moving from state init -> state preparing >Thread-135162::INFO::2014-10-29 11:05:10,647::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135162::INFO::2014-10-29 11:05:10,648::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000553823', 'lastCheck': '4.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0067722', 'lastCheck': '1.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00283394', 'lastCheck': '1.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00664701', 'lastCheck': '1.8', 'valid': True}} >Thread-135162::DEBUG::2014-10-29 11:05:10,648::task::1191::Storage.TaskManager.Task::(prepare) Task=`71db483d-0324-4e71-8969-ced4fb7a6dd8`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000553823', 'lastCheck': '4.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0067722', 'lastCheck': '1.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00283394', 'lastCheck': '1.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00664701', 'lastCheck': '1.8', 'valid': True}} >Thread-135162::DEBUG::2014-10-29 11:05:10,648::task::595::Storage.TaskManager.Task::(_updateState) Task=`71db483d-0324-4e71-8969-ced4fb7a6dd8`::moving from state preparing -> state finished >Thread-135162::DEBUG::2014-10-29 11:05:10,648::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135162::DEBUG::2014-10-29 11:05:10,649::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135162::DEBUG::2014-10-29 11:05:10,649::task::993::Storage.TaskManager.Task::(_decref) Task=`71db483d-0324-4e71-8969-ced4fb7a6dd8`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:12,053::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:12,056::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135163::DEBUG::2014-10-29 11:05:12,061::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:12,063::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:12,065::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135164::DEBUG::2014-10-29 11:05:12,068::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135164::DEBUG::2014-10-29 11:05:12,070::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:13,429::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:13,431::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:13,432::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:05:15,767::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:15,768::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:15,768::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:15,769::__init__::232::IOProcess::(_processLogs) (199205) Got request for method 'statvfs' >Thread-22::DEBUG::2014-10-29 11:05:15,865::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-17::DEBUG::2014-10-29 11:05:17,295::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199205) Queuing response >Thread-178::DEBUG::2014-10-29 11:05:17,298::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:05:17,315::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000431433 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:05:17,317::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:17,318::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:17,318::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:17,318::__init__::232::IOProcess::(_processLogs) (199206) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:17,320::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199206) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:17,322::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:17,322::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:17,323::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:17,323::__init__::232::IOProcess::(_processLogs) (199207) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:17,323::__init__::232::IOProcess::(_processLogs) (199207) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:17,324::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:17,324::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:17,325::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:17,326::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199208) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:17,326::__init__::232::IOProcess::(_processLogs) (199208) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:17,326::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:17,327::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:17,327::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:17,327::__init__::232::IOProcess::(_processLogs) (199209) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:17,328::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199209) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:17,423::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:17,427::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135165::DEBUG::2014-10-29 11:05:17,432::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:17,435::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:17,438::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135166::DEBUG::2014-10-29 11:05:17,441::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135166::DEBUG::2014-10-29 11:05:17,444::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:18,438::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:18,440::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:18,454::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:05:18,510::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53798 >Detector thread::DEBUG::2014-10-29 11:05:18,510::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53798 >Detector thread::DEBUG::2014-10-29 11:05:18,511::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53798 >Detector thread::DEBUG::2014-10-29 11:05:18,511::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53798) >Thread-135167::DEBUG::2014-10-29 11:05:18,550::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135167::DEBUG::2014-10-29 11:05:18,552::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135167::DEBUG::2014-10-29 11:05:18,570::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135167::DEBUG::2014-10-29 11:05:18,632::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '77', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '77', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-17::DEBUG::2014-10-29 11:05:18,896::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:18,897::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:18,897::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:18,897::__init__::232::IOProcess::(_processLogs) (199210) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:18,898::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:18,899::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:18,901::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-179::DEBUG::2014-10-29 11:05:18,902::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:05:18,903::__init__::232::IOProcess::(_processLogs) (199211) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:18,921::__init__::232::IOProcess::(_processLogs) (199210) Queuing response >Thread-179::DEBUG::2014-10-29 11:05:18,923::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000511163 s, 728 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:05:18,923::__init__::232::IOProcess::(_processLogs) (199211) Queuing response >Thread-10269::DEBUG::2014-10-29 11:05:18,928::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:05:18,949::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-10269::DEBUG::2014-10-29 11:05:18,953::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000615152 s, 816 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:05:18,955::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:18,956::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:18,956::__init__::232::IOProcess::(_processLogs) (199212) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:18,957::__init__::232::IOProcess::(_processLogs) (199212) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:18,957::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:18,958::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:18,958::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:18,958::__init__::232::IOProcess::(_processLogs) (199213) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:18,960::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199213) Queuing response >Thread-33::DEBUG::2014-10-29 11:05:18,961::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:05:18,962::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:18,978::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:18,979::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:18,979::__init__::232::IOProcess::(_processLogs) (199214) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:18,979::__init__::232::IOProcess::(_processLogs) (199214) Queuing response >Thread-33::DEBUG::2014-10-29 11:05:18,984::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00307487 s, 158 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:05:18,985::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:18,985::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:18,985::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:18,986::__init__::232::IOProcess::(_processLogs) (199215) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:18,986::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199215) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:18,988::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:18,989::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:18,990::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:18,990::__init__::232::IOProcess::(_processLogs) (199216) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:18,990::__init__::232::IOProcess::(_processLogs) (199216) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:18,991::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:18,991::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:18,992::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:18,993::__init__::232::IOProcess::(_processLogs) (199217) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:18,993::__init__::232::IOProcess::(_processLogs) (199217) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:18,993::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:18,994::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:18,994::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:18,994::__init__::232::IOProcess::(_processLogs) (199218) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:18,995::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199218) Queuing response >Detector thread::DEBUG::2014-10-29 11:05:19,689::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53799 >Detector thread::DEBUG::2014-10-29 11:05:19,689::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53799 >Detector thread::DEBUG::2014-10-29 11:05:19,690::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53799 >Detector thread::DEBUG::2014-10-29 11:05:19,690::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53799) >Thread-135168::DEBUG::2014-10-29 11:05:19,729::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135168::DEBUG::2014-10-29 11:05:19,732::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135168::DEBUG::2014-10-29 11:05:19,733::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.08', 'elapsedTime': '513352', 'displayType': 'vnc', 'cpuSys': '0.67', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '41967372', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '60000', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '30115.58'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.87', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:20,459::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:20,462::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135169::DEBUG::2014-10-29 11:05:20,466::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:20,468::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:20,470::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135170::DEBUG::2014-10-29 11:05:20,473::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135170::DEBUG::2014-10-29 11:05:20,475::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:05:20,481::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53802 >Detector thread::DEBUG::2014-10-29 11:05:20,481::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53802 >Detector thread::DEBUG::2014-10-29 11:05:20,481::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53802 >Detector thread::DEBUG::2014-10-29 11:05:20,482::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53802) >Thread-135171::DEBUG::2014-10-29 11:05:20,522::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135171::DEBUG::2014-10-29 11:05:20,523::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f3fc861-de88-4786-ad4a-d9d1793958ed`::moving from state init -> state preparing >Thread-135171::INFO::2014-10-29 11:05:20,523::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135171::DEBUG::2014-10-29 11:05:20,541::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:05:20,542::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:20,542::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:20,542::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:20,543::__init__::232::IOProcess::(_processLogs) (199219) Got request for method 'glob' >Detector thread::DEBUG::2014-10-29 11:05:20,704::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53803 >Detector thread::DEBUG::2014-10-29 11:05:20,704::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53803 >Detector thread::DEBUG::2014-10-29 11:05:20,705::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53803 >Detector thread::DEBUG::2014-10-29 11:05:20,705::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53803) >Thread-135172::DEBUG::2014-10-29 11:05:20,745::task::595::Storage.TaskManager.Task::(_updateState) Task=`f4331554-c0e6-4874-9131-2cfadc315d4e`::moving from state init -> state preparing >Thread-135172::INFO::2014-10-29 11:05:20,745::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135172::INFO::2014-10-29 11:05:20,746::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431433', 'lastCheck': '3.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00307487', 'lastCheck': '1.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511163', 'lastCheck': '1.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000615152', 'lastCheck': '1.8', 'valid': True}} >Thread-135172::DEBUG::2014-10-29 11:05:20,746::task::1191::Storage.TaskManager.Task::(prepare) Task=`f4331554-c0e6-4874-9131-2cfadc315d4e`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431433', 'lastCheck': '3.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00307487', 'lastCheck': '1.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511163', 'lastCheck': '1.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000615152', 'lastCheck': '1.8', 'valid': True}} >Thread-135172::DEBUG::2014-10-29 11:05:20,746::task::595::Storage.TaskManager.Task::(_updateState) Task=`f4331554-c0e6-4874-9131-2cfadc315d4e`::moving from state preparing -> state finished >Thread-135172::DEBUG::2014-10-29 11:05:20,747::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135172::DEBUG::2014-10-29 11:05:20,747::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135172::DEBUG::2014-10-29 11:05:20,747::task::993::Storage.TaskManager.Task::(_decref) Task=`f4331554-c0e6-4874-9131-2cfadc315d4e`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:05:21,798::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199219) Queuing response >Thread-135171::DEBUG::2014-10-29 11:05:21,800::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135171::DEBUG::2014-10-29 11:05:21,802::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135171::INFO::2014-10-29 11:05:21,803::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135171::DEBUG::2014-10-29 11:05:21,803::task::1191::Storage.TaskManager.Task::(prepare) Task=`7f3fc861-de88-4786-ad4a-d9d1793958ed`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135171::DEBUG::2014-10-29 11:05:21,804::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f3fc861-de88-4786-ad4a-d9d1793958ed`::moving from state preparing -> state finished >Thread-135171::DEBUG::2014-10-29 11:05:21,804::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135171::DEBUG::2014-10-29 11:05:21,804::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135171::DEBUG::2014-10-29 11:05:21,805::task::993::Storage.TaskManager.Task::(_decref) Task=`7f3fc861-de88-4786-ad4a-d9d1793958ed`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:05:21,852::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53804 >Detector thread::DEBUG::2014-10-29 11:05:21,853::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53804 >Detector thread::DEBUG::2014-10-29 11:05:21,853::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53804 >Detector thread::DEBUG::2014-10-29 11:05:21,854::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53804) >Thread-135173::DEBUG::2014-10-29 11:05:21,893::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135173::DEBUG::2014-10-29 11:05:21,894::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e00c041-e51f-4e2d-938c-be91824647be`::moving from state init -> state preparing >Thread-135173::INFO::2014-10-29 11:05:21,894::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135173::DEBUG::2014-10-29 11:05:21,895::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135173::DEBUG::2014-10-29 11:05:21,895::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135173::DEBUG::2014-10-29 11:05:21,895::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135173::DEBUG::2014-10-29 11:05:21,895::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135173::DEBUG::2014-10-29 11:05:21,896::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135173::DEBUG::2014-10-29 11:05:21,896::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135173::DEBUG::2014-10-29 11:05:21,974::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135173::DEBUG::2014-10-29 11:05:21,975::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135173::DEBUG::2014-10-29 11:05:22,148::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135173::DEBUG::2014-10-29 11:05:22,149::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135173::DEBUG::2014-10-29 11:05:22,150::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135173::DEBUG::2014-10-29 11:05:22,150::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135173::DEBUG::2014-10-29 11:05:22,150::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135173::DEBUG::2014-10-29 11:05:22,151::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135173::DEBUG::2014-10-29 11:05:22,151::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135173::DEBUG::2014-10-29 11:05:22,151::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:05:22,158::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:22,158::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:22,159::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:22,159::__init__::232::IOProcess::(_processLogs) (199220) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:05:22,161::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199220) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:22,164::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:22,165::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:22,165::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:22,166::__init__::232::IOProcess::(_processLogs) (199221) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:05:22,166::__init__::232::IOProcess::(_processLogs) (199221) Queuing response >Thread-135173::DEBUG::2014-10-29 11:05:22,171::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:05:22,173::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:22,173::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:22,173::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:22,173::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:22,174::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:22,174::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:22,174::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:22,174::__init__::232::IOProcess::(_processLogs) (199222) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:05:22,175::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:22,175::__init__::232::IOProcess::(_processLogs) (199223) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:05:22,175::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:22,175::__init__::232::IOProcess::(_processLogs) (199224) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:05:22,176::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199222) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:22,177::__init__::232::IOProcess::(_processLogs) (199224) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:22,178::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199223) Queuing response >Thread-135173::DEBUG::2014-10-29 11:05:22,179::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:05:22,182::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:22,183::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:22,183::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:22,183::__init__::232::IOProcess::(_processLogs) (199225) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:05:22,184::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199225) Queuing response >Thread-135173::DEBUG::2014-10-29 11:05:22,184::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:05:22,186::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:22,187::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:22,188::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:22,188::__init__::232::IOProcess::(_processLogs) (199226) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:22,188::__init__::232::IOProcess::(_processLogs) (199226) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:22,189::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:22,189::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:22,190::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:22,190::__init__::232::IOProcess::(_processLogs) (199227) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:05:22,190::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199227) Queuing response >Thread-135173::DEBUG::2014-10-29 11:05:22,191::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-135173::INFO::2014-10-29 11:05:22,192::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135173::INFO::2014-10-29 11:05:22,192::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135173::INFO::2014-10-29 11:05:22,193::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:05:22,193::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:22,194::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:22,194::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:22,194::__init__::232::IOProcess::(_processLogs) (199228) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:05:22,195::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199228) Queuing response >Thread-135173::DEBUG::2014-10-29 11:05:22,195::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135173::DEBUG::2014-10-29 11:05:22,196::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`0952f579-6072-4b5c-907b-961c7f2d2eea`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135173::DEBUG::2014-10-29 11:05:22,197::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135173::DEBUG::2014-10-29 11:05:22,197::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135173::DEBUG::2014-10-29 11:05:22,197::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`0952f579-6072-4b5c-907b-961c7f2d2eea`::Granted request >Thread-135173::DEBUG::2014-10-29 11:05:22,198::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3e00c041-e51f-4e2d-938c-be91824647be`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135173::DEBUG::2014-10-29 11:05:22,198::task::993::Storage.TaskManager.Task::(_decref) Task=`3e00c041-e51f-4e2d-938c-be91824647be`::ref 1 aborting False >Thread-135173::INFO::2014-10-29 11:05:22,201::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135173::DEBUG::2014-10-29 11:05:22,201::task::1191::Storage.TaskManager.Task::(prepare) Task=`3e00c041-e51f-4e2d-938c-be91824647be`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135173::DEBUG::2014-10-29 11:05:22,202::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e00c041-e51f-4e2d-938c-be91824647be`::moving from state preparing -> state finished >Thread-135173::DEBUG::2014-10-29 11:05:22,202::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135173::DEBUG::2014-10-29 11:05:22,202::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135173::DEBUG::2014-10-29 11:05:22,203::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135173::DEBUG::2014-10-29 11:05:22,203::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135173::DEBUG::2014-10-29 11:05:22,203::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135173::DEBUG::2014-10-29 11:05:22,203::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135173::DEBUG::2014-10-29 11:05:22,204::task::993::Storage.TaskManager.Task::(_decref) Task=`3e00c041-e51f-4e2d-938c-be91824647be`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:05:22,226::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53805 >Detector thread::DEBUG::2014-10-29 11:05:22,227::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53805 >Detector thread::DEBUG::2014-10-29 11:05:22,227::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53805 >Detector thread::DEBUG::2014-10-29 11:05:22,228::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53805) >Thread-135178::DEBUG::2014-10-29 11:05:22,267::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135178::DEBUG::2014-10-29 11:05:22,267::task::595::Storage.TaskManager.Task::(_updateState) Task=`f0ac1486-bfab-44f0-b09b-dbae30c86471`::moving from state init -> state preparing >Thread-135178::INFO::2014-10-29 11:05:22,268::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135178::INFO::2014-10-29 11:05:22,269::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431433', 'lastCheck': '4.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00307487', 'lastCheck': '3.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511163', 'lastCheck': '3.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000615152', 'lastCheck': '3.3', 'valid': True}} >Thread-135178::DEBUG::2014-10-29 11:05:22,269::task::1191::Storage.TaskManager.Task::(prepare) Task=`f0ac1486-bfab-44f0-b09b-dbae30c86471`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431433', 'lastCheck': '4.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00307487', 'lastCheck': '3.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511163', 'lastCheck': '3.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000615152', 'lastCheck': '3.3', 'valid': True}} >Thread-135178::DEBUG::2014-10-29 11:05:22,269::task::595::Storage.TaskManager.Task::(_updateState) Task=`f0ac1486-bfab-44f0-b09b-dbae30c86471`::moving from state preparing -> state finished >Thread-135178::DEBUG::2014-10-29 11:05:22,269::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135178::DEBUG::2014-10-29 11:05:22,270::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135178::DEBUG::2014-10-29 11:05:22,270::task::993::Storage.TaskManager.Task::(_decref) Task=`f0ac1486-bfab-44f0-b09b-dbae30c86471`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:23,461::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:23,463::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:23,466::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:23,489::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:23,491::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135179::DEBUG::2014-10-29 11:05:23,495::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:23,497::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:23,498::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135180::DEBUG::2014-10-29 11:05:23,501::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135180::DEBUG::2014-10-29 11:05:23,504::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:26,519::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:26,522::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135181::DEBUG::2014-10-29 11:05:26,526::task::595::Storage.TaskManager.Task::(_updateState) Task=`65994871-f49d-4fc0-a489-c8cdc5b18dad`::moving from state init -> state preparing >Thread-135181::INFO::2014-10-29 11:05:26,527::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135181::INFO::2014-10-29 11:05:26,528::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431433', 'lastCheck': '9.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00307487', 'lastCheck': '7.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511163', 'lastCheck': '7.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000615152', 'lastCheck': '7.5', 'valid': True}} >Thread-135181::DEBUG::2014-10-29 11:05:26,528::task::1191::Storage.TaskManager.Task::(prepare) Task=`65994871-f49d-4fc0-a489-c8cdc5b18dad`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431433', 'lastCheck': '9.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00307487', 'lastCheck': '7.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511163', 'lastCheck': '7.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000615152', 'lastCheck': '7.5', 'valid': True}} >Thread-135181::DEBUG::2014-10-29 11:05:26,528::task::595::Storage.TaskManager.Task::(_updateState) Task=`65994871-f49d-4fc0-a489-c8cdc5b18dad`::moving from state preparing -> state finished >Thread-135181::DEBUG::2014-10-29 11:05:26,529::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135181::DEBUG::2014-10-29 11:05:26,529::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135181::DEBUG::2014-10-29 11:05:26,529::task::993::Storage.TaskManager.Task::(_decref) Task=`65994871-f49d-4fc0-a489-c8cdc5b18dad`::ref 0 aborting False >Thread-135181::DEBUG::2014-10-29 11:05:26,551::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:26,574::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:26,577::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135182::DEBUG::2014-10-29 11:05:26,580::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135182::DEBUG::2014-10-29 11:05:26,582::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:05:27,330::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:27,331::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:27,331::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:27,332::__init__::232::IOProcess::(_processLogs) (199229) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:27,333::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199229) Queuing response >Thread-178::DEBUG::2014-10-29 11:05:27,335::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:05:27,352::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000540596 s, 940 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:05:27,354::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:27,354::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:27,355::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:27,355::__init__::232::IOProcess::(_processLogs) (199230) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:27,356::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199230) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:27,358::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:27,358::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:27,358::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:27,359::__init__::232::IOProcess::(_processLogs) (199231) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:27,359::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199231) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:27,361::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:27,361::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:27,361::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:27,361::__init__::232::IOProcess::(_processLogs) (199232) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:27,362::__init__::232::IOProcess::(_processLogs) (199232) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:27,363::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:27,363::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:27,363::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:27,363::__init__::232::IOProcess::(_processLogs) (199233) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:27,364::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199233) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:28,474::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:28,475::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:28,476::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:05:28,682::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53806 >Detector thread::DEBUG::2014-10-29 11:05:28,683::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53806 >Detector thread::DEBUG::2014-10-29 11:05:28,683::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53806 >Detector thread::DEBUG::2014-10-29 11:05:28,684::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53806) >Thread-135183::DEBUG::2014-10-29 11:05:28,722::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135183::DEBUG::2014-10-29 11:05:28,724::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135183::DEBUG::2014-10-29 11:05:28,742::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135183::DEBUG::2014-10-29 11:05:28,789::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '62', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '62', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-17::DEBUG::2014-10-29 11:05:28,956::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:28,956::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:28,956::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:28,957::__init__::232::IOProcess::(_processLogs) (199234) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:28,958::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199234) Queuing response >Thread-179::DEBUG::2014-10-29 11:05:28,959::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:05:28,977::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000521919 s, 713 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:05:28,979::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:28,979::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:28,980::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:28,980::__init__::232::IOProcess::(_processLogs) (199235) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:28,982::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199235) Queuing response >Thread-10269::DEBUG::2014-10-29 11:05:28,984::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain de096187-36e2-44e5-b8db-a9b67c3960de >Thread-17::DEBUG::2014-10-29 11:05:28,988::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:28,992::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:28,993::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:28,993::__init__::232::IOProcess::(_processLogs) (199236) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:05:28,994::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199236) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:28,996::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:28,997::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:28,997::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:28,998::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:28,998::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:28,998::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:28,999::__init__::232::IOProcess::(_processLogs) (199237) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:05:28,999::__init__::232::IOProcess::(_processLogs) (199238) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:05:29,000::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199237) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:29,001::__init__::232::IOProcess::(_processLogs) (199238) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:29,001::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:29,001::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:29,002::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:29,003::__init__::232::IOProcess::(_processLogs) (199239) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:05:29,003::__init__::232::IOProcess::(_processLogs) (199239) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:29,005::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:29,006::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:29,008::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:29,010::__init__::232::IOProcess::(_processLogs) (199240) Got request for method 'statvfs' >Thread-10269::DEBUG::2014-10-29 11:05:29,013::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de >Thread-17::DEBUG::2014-10-29 11:05:29,015::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199240) Queuing response >Thread-33::DEBUG::2014-10-29 11:05:29,016::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:05:29,018::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:29,033::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:29,034::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:29,035::__init__::232::IOProcess::(_processLogs) (199241) Got request for method 'touch' >Thread-33::DEBUG::2014-10-29 11:05:29,036::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000746824 s, 652 kB/s\n'; <rc> = 0 >Thread-10269::DEBUG::2014-10-29 11:05:29,040::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:05:29,040::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199241) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:29,043::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:29,043::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:29,043::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:29,044::__init__::232::IOProcess::(_processLogs) (199242) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:29,045::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199242) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:29,046::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:29,047::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:29,048::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-10269::DEBUG::2014-10-29 11:05:29,048::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nsednev-iso-domain', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=00000002-0002-0002-0002-000000000324,00000002-0002-0002-0002-00000000002d,00000002-0002-0002-0002-0000000003d4,00000002-0002-0002-0002-000000000321', 'REMOTE_PATH=monster-nfs.scl.lab.tlv.redhat.com:/RHEV/nsednev-iso-domain', 'ROLE=Regular', 'SDUUID=de096187-36e2-44e5-b8db-a9b67c3960de', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=4fa36e197e83f2488bfc8aea7825ed34cc463260'] >Thread-17::DEBUG::2014-10-29 11:05:29,049::__init__::232::IOProcess::(_processLogs) (199243) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:05:29,051::__init__::232::IOProcess::(_processLogs) (199243) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:29,053::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:29,053::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:29,053::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:29,053::__init__::232::IOProcess::(_processLogs) (199244) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:29,054::__init__::232::IOProcess::(_processLogs) (199244) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:29,054::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:29,054::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:29,055::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:29,056::__init__::232::IOProcess::(_processLogs) (199245) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:29,056::__init__::232::IOProcess::(_processLogs) (199245) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:29,056::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:29,057::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:29,057::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:29,057::__init__::232::IOProcess::(_processLogs) (199246) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:29,058::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199246) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:29,059::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:29,059::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:29,059::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-10269::DEBUG::2014-10-29 11:05:29,060::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:05:29,060::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199247) Got request for method 'glob' >Thread-10269::INFO::2014-10-29 11:05:29,061::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace de096187-36e2-44e5-b8db-a9b67c3960de_imageNS already registered >Thread-10269::INFO::2014-10-29 11:05:29,062::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace de096187-36e2-44e5-b8db-a9b67c3960de_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:05:29,063::__init__::232::IOProcess::(_processLogs) (199247) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:29,064::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:29,064::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:29,065::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:29,065::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:29,066::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:29,066::__init__::232::IOProcess::(_processLogs) (199249) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:29,067::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:29,067::__init__::232::IOProcess::(_processLogs) (199248) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:29,068::__init__::232::IOProcess::(_processLogs) (199248) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:29,068::__init__::232::IOProcess::(_processLogs) (199249) Queuing response >Thread-10269::DEBUG::2014-10-29 11:05:29,069::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:05:29,086::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000826787 s, 607 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:05:29,088::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:29,089::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:29,089::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:29,089::__init__::232::IOProcess::(_processLogs) (199250) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:29,090::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199250) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:29,623::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:29,626::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135188::DEBUG::2014-10-29 11:05:29,629::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:29,632::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:29,633::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135189::DEBUG::2014-10-29 11:05:29,637::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135189::DEBUG::2014-10-29 11:05:29,639::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:05:29,906::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53807 >Detector thread::DEBUG::2014-10-29 11:05:29,906::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53807 >Detector thread::DEBUG::2014-10-29 11:05:29,907::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53807 >Detector thread::DEBUG::2014-10-29 11:05:29,907::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53807) >Thread-135190::DEBUG::2014-10-29 11:05:29,946::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135190::DEBUG::2014-10-29 11:05:29,947::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135190::DEBUG::2014-10-29 11:05:29,948::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.08', 'elapsedTime': '513362', 'displayType': 'vnc', 'cpuSys': '0.67', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '41967372', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '60000', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '30115.58'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.08', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:05:30,866::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53809 >Detector thread::DEBUG::2014-10-29 11:05:30,866::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53809 >Detector thread::DEBUG::2014-10-29 11:05:30,866::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53809 >Detector thread::DEBUG::2014-10-29 11:05:30,867::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53809) >Thread-22::DEBUG::2014-10-29 11:05:30,888::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-135191::DEBUG::2014-10-29 11:05:30,907::task::595::Storage.TaskManager.Task::(_updateState) Task=`11b6ed26-8cad-4fcc-933d-0d013e7f7f43`::moving from state init -> state preparing >Thread-135191::INFO::2014-10-29 11:05:30,907::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135191::INFO::2014-10-29 11:05:30,908::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540596', 'lastCheck': '3.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000746824', 'lastCheck': '1.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521919', 'lastCheck': '1.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000826787', 'lastCheck': '1.8', 'valid': True}} >Thread-135191::DEBUG::2014-10-29 11:05:30,908::task::1191::Storage.TaskManager.Task::(prepare) Task=`11b6ed26-8cad-4fcc-933d-0d013e7f7f43`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540596', 'lastCheck': '3.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000746824', 'lastCheck': '1.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521919', 'lastCheck': '1.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000826787', 'lastCheck': '1.8', 'valid': True}} >Thread-135191::DEBUG::2014-10-29 11:05:30,908::task::595::Storage.TaskManager.Task::(_updateState) Task=`11b6ed26-8cad-4fcc-933d-0d013e7f7f43`::moving from state preparing -> state finished >Thread-135191::DEBUG::2014-10-29 11:05:30,909::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135191::DEBUG::2014-10-29 11:05:30,909::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135191::DEBUG::2014-10-29 11:05:30,909::task::993::Storage.TaskManager.Task::(_decref) Task=`11b6ed26-8cad-4fcc-933d-0d013e7f7f43`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:05:32,844::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53811 >Detector thread::DEBUG::2014-10-29 11:05:32,844::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53811 >Detector thread::DEBUG::2014-10-29 11:05:32,845::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53811 >Detector thread::DEBUG::2014-10-29 11:05:32,845::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53811) >Thread-135192::DEBUG::2014-10-29 11:05:32,885::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135192::DEBUG::2014-10-29 11:05:32,886::task::595::Storage.TaskManager.Task::(_updateState) Task=`50704a7b-5ba5-40eb-b405-09ab18f2ffc5`::moving from state init -> state preparing >Thread-135192::INFO::2014-10-29 11:05:32,886::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135192::DEBUG::2014-10-29 11:05:32,889::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:05:32,890::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:32,891::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:32,891::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:32,891::__init__::232::IOProcess::(_processLogs) (199251) Got request for method 'glob' >Thread-135192::DEBUG::2014-10-29 11:05:32,892::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:05:32,892::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199251) Queuing response >Thread-135192::DEBUG::2014-10-29 11:05:32,894::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135192::INFO::2014-10-29 11:05:32,894::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135192::DEBUG::2014-10-29 11:05:32,895::task::1191::Storage.TaskManager.Task::(prepare) Task=`50704a7b-5ba5-40eb-b405-09ab18f2ffc5`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135192::DEBUG::2014-10-29 11:05:32,895::task::595::Storage.TaskManager.Task::(_updateState) Task=`50704a7b-5ba5-40eb-b405-09ab18f2ffc5`::moving from state preparing -> state finished >Thread-135192::DEBUG::2014-10-29 11:05:32,895::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135192::DEBUG::2014-10-29 11:05:32,895::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135192::DEBUG::2014-10-29 11:05:32,896::task::993::Storage.TaskManager.Task::(_decref) Task=`50704a7b-5ba5-40eb-b405-09ab18f2ffc5`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:05:32,939::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53812 >Detector thread::DEBUG::2014-10-29 11:05:32,939::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53812 >Detector thread::DEBUG::2014-10-29 11:05:32,940::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53812 >Detector thread::DEBUG::2014-10-29 11:05:32,940::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53812) >Thread-135193::DEBUG::2014-10-29 11:05:32,979::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135193::DEBUG::2014-10-29 11:05:32,980::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ca84212-f830-476e-ac7c-ce0a97a91f3b`::moving from state init -> state preparing >Thread-135193::INFO::2014-10-29 11:05:32,980::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135193::DEBUG::2014-10-29 11:05:32,980::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135193::DEBUG::2014-10-29 11:05:32,981::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135193::DEBUG::2014-10-29 11:05:32,981::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135193::DEBUG::2014-10-29 11:05:32,981::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135193::DEBUG::2014-10-29 11:05:32,982::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135193::DEBUG::2014-10-29 11:05:32,982::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >VM Channels Listener::DEBUG::2014-10-29 11:05:33,042::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >Thread-135193::DEBUG::2014-10-29 11:05:33,073::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135193::DEBUG::2014-10-29 11:05:33,073::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135193::DEBUG::2014-10-29 11:05:33,240::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135193::DEBUG::2014-10-29 11:05:33,241::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135193::DEBUG::2014-10-29 11:05:33,242::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135193::DEBUG::2014-10-29 11:05:33,242::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135193::DEBUG::2014-10-29 11:05:33,243::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135193::DEBUG::2014-10-29 11:05:33,243::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135193::DEBUG::2014-10-29 11:05:33,243::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135193::DEBUG::2014-10-29 11:05:33,244::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:05:33,251::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:33,253::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:33,253::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:33,253::__init__::232::IOProcess::(_processLogs) (199252) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:05:33,254::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199252) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:33,258::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:33,261::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:33,263::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:33,265::__init__::232::IOProcess::(_processLogs) (199253) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:05:33,266::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:33,268::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:33,269::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-135193::DEBUG::2014-10-29 11:05:33,271::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:05:33,271::__init__::232::IOProcess::(_processLogs) (199254) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:05:33,273::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:33,274::__init__::232::IOProcess::(_processLogs) (199253) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:33,274::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:33,274::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:33,274::__init__::232::IOProcess::(_processLogs) (199255) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:05:33,275::__init__::232::IOProcess::(_processLogs) (199254) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:33,275::__init__::232::IOProcess::(_processLogs) (199255) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:33,276::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:33,276::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:33,276::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:33,276::__init__::232::IOProcess::(_processLogs) (199256) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:05:33,277::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199256) Queuing response >Thread-135193::DEBUG::2014-10-29 11:05:33,278::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:05:33,279::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:33,279::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:33,279::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:33,279::__init__::232::IOProcess::(_processLogs) (199257) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:05:33,280::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199257) Queuing response >Thread-135193::DEBUG::2014-10-29 11:05:33,281::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:05:33,283::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:33,283::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:33,284::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:33,284::__init__::232::IOProcess::(_processLogs) (199258) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:33,285::__init__::232::IOProcess::(_processLogs) (199258) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:33,285::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:33,286::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:33,286::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:33,286::__init__::232::IOProcess::(_processLogs) (199259) Got request for method 'glob' >Thread-135193::DEBUG::2014-10-29 11:05:33,287::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:05:33,287::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199259) Queuing response >Thread-135193::INFO::2014-10-29 11:05:33,288::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135193::INFO::2014-10-29 11:05:33,289::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135193::INFO::2014-10-29 11:05:33,289::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:05:33,290::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:33,290::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:33,290::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:33,291::__init__::232::IOProcess::(_processLogs) (199260) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:05:33,291::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199260) Queuing response >Thread-135193::DEBUG::2014-10-29 11:05:33,292::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135193::DEBUG::2014-10-29 11:05:33,293::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`6b6dc7d2-02a7-4cbd-854a-da73d283b0f5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135193::DEBUG::2014-10-29 11:05:33,294::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135193::DEBUG::2014-10-29 11:05:33,294::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135193::DEBUG::2014-10-29 11:05:33,294::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`6b6dc7d2-02a7-4cbd-854a-da73d283b0f5`::Granted request >Thread-135193::DEBUG::2014-10-29 11:05:33,295::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2ca84212-f830-476e-ac7c-ce0a97a91f3b`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135193::DEBUG::2014-10-29 11:05:33,295::task::993::Storage.TaskManager.Task::(_decref) Task=`2ca84212-f830-476e-ac7c-ce0a97a91f3b`::ref 1 aborting False >Thread-135193::INFO::2014-10-29 11:05:33,298::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135193::DEBUG::2014-10-29 11:05:33,299::task::1191::Storage.TaskManager.Task::(prepare) Task=`2ca84212-f830-476e-ac7c-ce0a97a91f3b`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135193::DEBUG::2014-10-29 11:05:33,299::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ca84212-f830-476e-ac7c-ce0a97a91f3b`::moving from state preparing -> state finished >Thread-135193::DEBUG::2014-10-29 11:05:33,299::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135193::DEBUG::2014-10-29 11:05:33,299::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135193::DEBUG::2014-10-29 11:05:33,300::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135193::DEBUG::2014-10-29 11:05:33,300::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135193::DEBUG::2014-10-29 11:05:33,300::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135193::DEBUG::2014-10-29 11:05:33,301::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135193::DEBUG::2014-10-29 11:05:33,301::task::993::Storage.TaskManager.Task::(_decref) Task=`2ca84212-f830-476e-ac7c-ce0a97a91f3b`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:05:33,323::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53813 >Detector thread::DEBUG::2014-10-29 11:05:33,324::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53813 >Detector thread::DEBUG::2014-10-29 11:05:33,324::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53813 >Detector thread::DEBUG::2014-10-29 11:05:33,324::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53813) >Thread-135198::DEBUG::2014-10-29 11:05:33,363::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135198::DEBUG::2014-10-29 11:05:33,364::task::595::Storage.TaskManager.Task::(_updateState) Task=`e393385d-7253-4726-bf0c-064e80509a14`::moving from state init -> state preparing >Thread-135198::INFO::2014-10-29 11:05:33,364::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135198::INFO::2014-10-29 11:05:33,365::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540596', 'lastCheck': '6.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000746824', 'lastCheck': '4.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521919', 'lastCheck': '4.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000826787', 'lastCheck': '4.3', 'valid': True}} >Thread-135198::DEBUG::2014-10-29 11:05:33,365::task::1191::Storage.TaskManager.Task::(prepare) Task=`e393385d-7253-4726-bf0c-064e80509a14`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540596', 'lastCheck': '6.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000746824', 'lastCheck': '4.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521919', 'lastCheck': '4.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000826787', 'lastCheck': '4.3', 'valid': True}} >Thread-135198::DEBUG::2014-10-29 11:05:33,365::task::595::Storage.TaskManager.Task::(_updateState) Task=`e393385d-7253-4726-bf0c-064e80509a14`::moving from state preparing -> state finished >Thread-135198::DEBUG::2014-10-29 11:05:33,366::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135198::DEBUG::2014-10-29 11:05:33,366::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135198::DEBUG::2014-10-29 11:05:33,366::task::993::Storage.TaskManager.Task::(_decref) Task=`e393385d-7253-4726-bf0c-064e80509a14`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:33,483::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:33,486::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:33,492::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:33,826::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:33,828::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135199::DEBUG::2014-10-29 11:05:33,833::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:33,835::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:33,837::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135200::DEBUG::2014-10-29 11:05:33,840::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135200::DEBUG::2014-10-29 11:05:33,842::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:36,859::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:36,862::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135201::DEBUG::2014-10-29 11:05:36,865::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:36,868::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:36,870::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135202::DEBUG::2014-10-29 11:05:36,872::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135202::DEBUG::2014-10-29 11:05:36,875::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:05:37,366::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:37,367::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:37,367::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:37,367::__init__::232::IOProcess::(_processLogs) (199261) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:37,369::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199261) Queuing response >Thread-178::DEBUG::2014-10-29 11:05:37,370::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:05:37,387::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000535694 s, 948 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:05:37,389::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:37,391::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:37,393::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:37,393::__init__::232::IOProcess::(_processLogs) (199262) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:37,393::__init__::232::IOProcess::(_processLogs) (199262) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:37,394::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:37,395::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:37,396::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:37,396::__init__::232::IOProcess::(_processLogs) (199263) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:37,396::__init__::232::IOProcess::(_processLogs) (199263) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:37,397::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:37,399::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:37,399::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:37,399::__init__::232::IOProcess::(_processLogs) (199264) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:37,399::__init__::232::IOProcess::(_processLogs) (199264) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:37,400::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:37,400::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:37,401::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:37,402::__init__::232::IOProcess::(_processLogs) (199265) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:37,402::__init__::232::IOProcess::(_processLogs) (199265) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:38,499::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:38,500::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:38,502::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:05:38,838::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53814 >Detector thread::DEBUG::2014-10-29 11:05:38,839::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53814 >Detector thread::DEBUG::2014-10-29 11:05:38,839::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53814 >Detector thread::DEBUG::2014-10-29 11:05:38,840::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53814) >Thread-135203::DEBUG::2014-10-29 11:05:38,878::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135203::DEBUG::2014-10-29 11:05:38,880::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135203::DEBUG::2014-10-29 11:05:38,901::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135203::DEBUG::2014-10-29 11:05:38,949::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '46', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '46', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-17::DEBUG::2014-10-29 11:05:38,984::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:38,985::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:38,985::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:38,985::__init__::232::IOProcess::(_processLogs) (199266) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:39,068::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:39,068::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:39,069::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:39,069::__init__::232::IOProcess::(_processLogs) (199267) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:39,093::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:39,093::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:39,093::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:39,094::__init__::232::IOProcess::(_processLogs) (199268) Got request for method 'statvfs' >Thread-179::DEBUG::2014-10-29 11:05:39,299::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:05:39,318::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199266) Queuing response >Thread-10269::DEBUG::2014-10-29 11:05:39,322::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:05:39,322::__init__::232::IOProcess::(_processLogs) (199268) Queuing response >Thread-179::DEBUG::2014-10-29 11:05:39,322::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000523479 s, 711 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:05:39,340::__init__::232::IOProcess::(_processLogs) (199267) Queuing response >Thread-10269::DEBUG::2014-10-29 11:05:39,344::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000678941 s, 739 kB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-10-29 11:05:39,350::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:05:39,350::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:39,368::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-33::DEBUG::2014-10-29 11:05:39,370::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000583523 s, 835 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:05:39,371::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:39,373::__init__::232::IOProcess::(_processLogs) (199269) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:39,375::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199269) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:39,378::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:39,379::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:39,379::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:39,379::__init__::232::IOProcess::(_processLogs) (199270) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:39,379::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:39,380::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:39,380::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:39,380::__init__::232::IOProcess::(_processLogs) (199271) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:39,381::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199270) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:39,383::__init__::232::IOProcess::(_processLogs) (199271) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:39,385::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:39,386::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:39,386::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:39,386::__init__::232::IOProcess::(_processLogs) (199272) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:39,387::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199272) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:39,388::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:39,389::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:39,390::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:39,390::__init__::232::IOProcess::(_processLogs) (199273) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:39,390::__init__::232::IOProcess::(_processLogs) (199273) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:39,391::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:39,391::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:39,391::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:39,392::__init__::232::IOProcess::(_processLogs) (199274) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:39,393::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199274) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:39,892::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:39,894::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135204::DEBUG::2014-10-29 11:05:39,898::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:39,900::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:39,902::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135205::DEBUG::2014-10-29 11:05:39,906::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135205::DEBUG::2014-10-29 11:05:39,908::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:05:40,104::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53815 >Detector thread::DEBUG::2014-10-29 11:05:40,105::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53815 >Detector thread::DEBUG::2014-10-29 11:05:40,105::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53815 >Detector thread::DEBUG::2014-10-29 11:05:40,106::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53815) >Thread-135206::DEBUG::2014-10-29 11:05:40,144::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135206::DEBUG::2014-10-29 11:05:40,145::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135206::DEBUG::2014-10-29 11:05:40,146::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.88', 'elapsedTime': '513372', 'displayType': 'vnc', 'cpuSys': '0.87', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '41967372', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '60000', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '30115.58'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.25', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:05:40,968::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53817 >Detector thread::DEBUG::2014-10-29 11:05:40,968::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53817 >Detector thread::DEBUG::2014-10-29 11:05:40,969::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53817 >Detector thread::DEBUG::2014-10-29 11:05:40,969::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53817) >Thread-135207::DEBUG::2014-10-29 11:05:41,009::task::595::Storage.TaskManager.Task::(_updateState) Task=`30d39e2c-006f-4277-b26a-48cd911afd7d`::moving from state init -> state preparing >Thread-135207::INFO::2014-10-29 11:05:41,009::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135207::INFO::2014-10-29 11:05:41,010::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535694', 'lastCheck': '3.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000583523', 'lastCheck': '1.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523479', 'lastCheck': '1.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000678941', 'lastCheck': '1.6', 'valid': True}} >Thread-135207::DEBUG::2014-10-29 11:05:41,010::task::1191::Storage.TaskManager.Task::(prepare) Task=`30d39e2c-006f-4277-b26a-48cd911afd7d`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535694', 'lastCheck': '3.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000583523', 'lastCheck': '1.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523479', 'lastCheck': '1.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000678941', 'lastCheck': '1.6', 'valid': True}} >Thread-135207::DEBUG::2014-10-29 11:05:41,011::task::595::Storage.TaskManager.Task::(_updateState) Task=`30d39e2c-006f-4277-b26a-48cd911afd7d`::moving from state preparing -> state finished >Thread-135207::DEBUG::2014-10-29 11:05:41,011::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135207::DEBUG::2014-10-29 11:05:41,011::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135207::DEBUG::2014-10-29 11:05:41,011::task::993::Storage.TaskManager.Task::(_decref) Task=`30d39e2c-006f-4277-b26a-48cd911afd7d`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:42,921::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:42,923::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135208::DEBUG::2014-10-29 11:05:42,927::task::595::Storage.TaskManager.Task::(_updateState) Task=`7e645614-4215-4d8d-af08-ffd4c207f80e`::moving from state init -> state preparing >Thread-135208::INFO::2014-10-29 11:05:42,927::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135208::INFO::2014-10-29 11:05:42,928::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535694', 'lastCheck': '5.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000583523', 'lastCheck': '3.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523479', 'lastCheck': '3.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000678941', 'lastCheck': '3.5', 'valid': True}} >Thread-135208::DEBUG::2014-10-29 11:05:42,928::task::1191::Storage.TaskManager.Task::(prepare) Task=`7e645614-4215-4d8d-af08-ffd4c207f80e`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535694', 'lastCheck': '5.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000583523', 'lastCheck': '3.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523479', 'lastCheck': '3.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000678941', 'lastCheck': '3.5', 'valid': True}} >Thread-135208::DEBUG::2014-10-29 11:05:42,929::task::595::Storage.TaskManager.Task::(_updateState) Task=`7e645614-4215-4d8d-af08-ffd4c207f80e`::moving from state preparing -> state finished >Thread-135208::DEBUG::2014-10-29 11:05:42,929::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135208::DEBUG::2014-10-29 11:05:42,929::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135208::DEBUG::2014-10-29 11:05:42,930::task::993::Storage.TaskManager.Task::(_decref) Task=`7e645614-4215-4d8d-af08-ffd4c207f80e`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:43,509::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:43,530::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:43,531::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135208::DEBUG::2014-10-29 11:05:43,828::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:43,890::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:43,892::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135209::DEBUG::2014-10-29 11:05:43,896::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135209::DEBUG::2014-10-29 11:05:43,898::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:05:44,175::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53819 >Detector thread::DEBUG::2014-10-29 11:05:44,178::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53819 >Detector thread::DEBUG::2014-10-29 11:05:44,179::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53819 >Detector thread::DEBUG::2014-10-29 11:05:44,181::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53819) >Thread-135210::DEBUG::2014-10-29 11:05:44,220::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135210::DEBUG::2014-10-29 11:05:44,223::task::595::Storage.TaskManager.Task::(_updateState) Task=`2180a6e4-5d9b-470f-afa3-63a0c4ffd9af`::moving from state init -> state preparing >Thread-135210::INFO::2014-10-29 11:05:44,225::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135210::DEBUG::2014-10-29 11:05:44,243::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:05:44,247::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:44,249::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:44,250::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:44,252::__init__::232::IOProcess::(_processLogs) (199275) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:05:44,256::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199275) Queuing response >Thread-135210::DEBUG::2014-10-29 11:05:44,256::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135210::DEBUG::2014-10-29 11:05:44,259::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135210::INFO::2014-10-29 11:05:44,260::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135210::DEBUG::2014-10-29 11:05:44,262::task::1191::Storage.TaskManager.Task::(prepare) Task=`2180a6e4-5d9b-470f-afa3-63a0c4ffd9af`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135210::DEBUG::2014-10-29 11:05:44,263::task::595::Storage.TaskManager.Task::(_updateState) Task=`2180a6e4-5d9b-470f-afa3-63a0c4ffd9af`::moving from state preparing -> state finished >Thread-135210::DEBUG::2014-10-29 11:05:44,264::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135210::DEBUG::2014-10-29 11:05:44,266::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135210::DEBUG::2014-10-29 11:05:44,268::task::993::Storage.TaskManager.Task::(_decref) Task=`2180a6e4-5d9b-470f-afa3-63a0c4ffd9af`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:05:44,316::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53820 >Detector thread::DEBUG::2014-10-29 11:05:44,317::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53820 >Detector thread::DEBUG::2014-10-29 11:05:44,317::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53820 >Detector thread::DEBUG::2014-10-29 11:05:44,317::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53820) >Thread-135211::DEBUG::2014-10-29 11:05:44,356::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135211::DEBUG::2014-10-29 11:05:44,357::task::595::Storage.TaskManager.Task::(_updateState) Task=`4464f12b-1ce3-4d0d-bb5e-81741a28fba7`::moving from state init -> state preparing >Thread-135211::INFO::2014-10-29 11:05:44,357::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135211::DEBUG::2014-10-29 11:05:44,357::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135211::DEBUG::2014-10-29 11:05:44,358::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135211::DEBUG::2014-10-29 11:05:44,358::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135211::DEBUG::2014-10-29 11:05:44,358::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135211::DEBUG::2014-10-29 11:05:44,359::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135211::DEBUG::2014-10-29 11:05:44,359::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135211::DEBUG::2014-10-29 11:05:44,459::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135211::DEBUG::2014-10-29 11:05:44,460::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135211::DEBUG::2014-10-29 11:05:44,644::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135211::DEBUG::2014-10-29 11:05:44,645::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135211::DEBUG::2014-10-29 11:05:44,646::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135211::DEBUG::2014-10-29 11:05:44,646::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135211::DEBUG::2014-10-29 11:05:44,647::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135211::DEBUG::2014-10-29 11:05:44,647::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135211::DEBUG::2014-10-29 11:05:44,647::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135211::DEBUG::2014-10-29 11:05:44,648::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:05:44,654::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:44,658::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:44,659::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:44,659::__init__::232::IOProcess::(_processLogs) (199276) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:05:44,660::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199276) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:44,662::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:44,662::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:44,663::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:44,663::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:44,663::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:44,664::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:44,664::__init__::232::IOProcess::(_processLogs) (199277) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:05:44,664::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:44,664::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:44,665::__init__::232::IOProcess::(_processLogs) (199278) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:05:44,665::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:44,665::__init__::232::IOProcess::(_processLogs) (199279) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:05:44,666::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199277) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:44,668::__init__::232::IOProcess::(_processLogs) (199278) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:44,669::__init__::232::IOProcess::(_processLogs) (199279) Queuing response >Thread-135211::DEBUG::2014-10-29 11:05:44,672::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:05:44,675::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:44,675::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:44,675::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:44,676::__init__::232::IOProcess::(_processLogs) (199280) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:05:44,677::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199280) Queuing response >Thread-135211::DEBUG::2014-10-29 11:05:44,677::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:05:44,678::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:44,679::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:44,679::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:44,679::__init__::232::IOProcess::(_processLogs) (199281) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:05:44,680::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199281) Queuing response >Thread-135211::DEBUG::2014-10-29 11:05:44,681::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:05:44,682::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:44,682::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:44,682::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:44,683::__init__::232::IOProcess::(_processLogs) (199282) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:44,684::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199282) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:44,684::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:44,685::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:44,685::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:44,685::__init__::232::IOProcess::(_processLogs) (199283) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:05:44,686::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199283) Queuing response >Thread-135211::DEBUG::2014-10-29 11:05:44,686::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-135211::INFO::2014-10-29 11:05:44,688::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135211::INFO::2014-10-29 11:05:44,688::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135211::INFO::2014-10-29 11:05:44,688::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:05:44,689::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:44,689::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:44,689::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:44,690::__init__::232::IOProcess::(_processLogs) (199284) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:05:44,691::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199284) Queuing response >Thread-135211::DEBUG::2014-10-29 11:05:44,691::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135211::DEBUG::2014-10-29 11:05:44,693::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`410cbc33-b74d-450e-bea9-1fb4441d1a9c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135211::DEBUG::2014-10-29 11:05:44,693::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135211::DEBUG::2014-10-29 11:05:44,694::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135211::DEBUG::2014-10-29 11:05:44,694::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`410cbc33-b74d-450e-bea9-1fb4441d1a9c`::Granted request >Thread-135211::DEBUG::2014-10-29 11:05:44,695::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4464f12b-1ce3-4d0d-bb5e-81741a28fba7`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135211::DEBUG::2014-10-29 11:05:44,695::task::993::Storage.TaskManager.Task::(_decref) Task=`4464f12b-1ce3-4d0d-bb5e-81741a28fba7`::ref 1 aborting False >Thread-135211::INFO::2014-10-29 11:05:44,698::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135211::DEBUG::2014-10-29 11:05:44,698::task::1191::Storage.TaskManager.Task::(prepare) Task=`4464f12b-1ce3-4d0d-bb5e-81741a28fba7`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135211::DEBUG::2014-10-29 11:05:44,698::task::595::Storage.TaskManager.Task::(_updateState) Task=`4464f12b-1ce3-4d0d-bb5e-81741a28fba7`::moving from state preparing -> state finished >Thread-135211::DEBUG::2014-10-29 11:05:44,699::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135211::DEBUG::2014-10-29 11:05:44,699::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135211::DEBUG::2014-10-29 11:05:44,699::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135211::DEBUG::2014-10-29 11:05:44,700::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135211::DEBUG::2014-10-29 11:05:44,700::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135211::DEBUG::2014-10-29 11:05:44,700::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135211::DEBUG::2014-10-29 11:05:44,701::task::993::Storage.TaskManager.Task::(_decref) Task=`4464f12b-1ce3-4d0d-bb5e-81741a28fba7`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:05:44,721::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53821 >Detector thread::DEBUG::2014-10-29 11:05:44,722::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53821 >Detector thread::DEBUG::2014-10-29 11:05:44,722::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53821 >Detector thread::DEBUG::2014-10-29 11:05:44,723::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53821) >Thread-135216::DEBUG::2014-10-29 11:05:44,762::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135216::DEBUG::2014-10-29 11:05:44,762::task::595::Storage.TaskManager.Task::(_updateState) Task=`c332ed23-49b3-4bf9-ac0b-6c8024caf1a7`::moving from state init -> state preparing >Thread-135216::INFO::2014-10-29 11:05:44,763::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135216::INFO::2014-10-29 11:05:44,763::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535694', 'lastCheck': '7.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000583523', 'lastCheck': '5.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523479', 'lastCheck': '5.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000678941', 'lastCheck': '5.4', 'valid': True}} >Thread-135216::DEBUG::2014-10-29 11:05:44,764::task::1191::Storage.TaskManager.Task::(prepare) Task=`c332ed23-49b3-4bf9-ac0b-6c8024caf1a7`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535694', 'lastCheck': '7.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000583523', 'lastCheck': '5.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523479', 'lastCheck': '5.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000678941', 'lastCheck': '5.4', 'valid': True}} >Thread-135216::DEBUG::2014-10-29 11:05:44,764::task::595::Storage.TaskManager.Task::(_updateState) Task=`c332ed23-49b3-4bf9-ac0b-6c8024caf1a7`::moving from state preparing -> state finished >Thread-135216::DEBUG::2014-10-29 11:05:44,764::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135216::DEBUG::2014-10-29 11:05:44,765::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135216::DEBUG::2014-10-29 11:05:44,765::task::993::Storage.TaskManager.Task::(_decref) Task=`c332ed23-49b3-4bf9-ac0b-6c8024caf1a7`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:05:45,894::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d7488af-81ce-4767-866c-02b3154d12c2`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:05:45,894::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:05:45,895::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:45,895::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:45,896::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:45,896::__init__::232::IOProcess::(_processLogs) (199285) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:05:45,898::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199285) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:45,899::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:45,899::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:45,900::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-22::INFO::2014-10-29 11:05:45,901::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010855424', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:05:45,902::__init__::232::IOProcess::(_processLogs) (199286) Got request for method 'stat' >Thread-22::DEBUG::2014-10-29 11:05:45,903::task::1191::Storage.TaskManager.Task::(prepare) Task=`7d7488af-81ce-4767-866c-02b3154d12c2`::finished: {'truesize': '6010855424', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:05:45,904::__init__::232::IOProcess::(_processLogs) (199286) Queuing response >Thread-22::DEBUG::2014-10-29 11:05:45,904::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d7488af-81ce-4767-866c-02b3154d12c2`::moving from state preparing -> state finished >Thread-22::DEBUG::2014-10-29 11:05:45,905::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-10-29 11:05:45,906::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2014-10-29 11:05:45,906::task::993::Storage.TaskManager.Task::(_decref) Task=`7d7488af-81ce-4767-866c-02b3154d12c2`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:05:45,977::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:46,956::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:46,962::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135217::DEBUG::2014-10-29 11:05:46,971::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:46,976::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:46,981::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135218::DEBUG::2014-10-29 11:05:46,990::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135218::DEBUG::2014-10-29 11:05:47,002::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:05:47,404::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:47,405::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:47,405::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:47,405::__init__::232::IOProcess::(_processLogs) (199287) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:47,406::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199287) Queuing response >Thread-178::DEBUG::2014-10-29 11:05:47,408::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:05:47,425::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000512546 s, 991 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:05:47,427::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:47,427::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:47,428::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:47,430::__init__::232::IOProcess::(_processLogs) (199288) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:47,430::__init__::232::IOProcess::(_processLogs) (199288) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:47,431::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:47,432::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:47,433::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:47,433::__init__::232::IOProcess::(_processLogs) (199289) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:47,433::__init__::232::IOProcess::(_processLogs) (199289) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:47,434::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:47,434::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:47,435::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:47,435::__init__::232::IOProcess::(_processLogs) (199290) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:47,436::__init__::232::IOProcess::(_processLogs) (199290) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:47,437::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:47,438::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:47,439::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:47,439::__init__::232::IOProcess::(_processLogs) (199291) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:47,440::__init__::232::IOProcess::(_processLogs) (199291) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:48,537::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:48,539::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:48,542::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:05:48,990::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53822 >Detector thread::DEBUG::2014-10-29 11:05:48,991::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53822 >Detector thread::DEBUG::2014-10-29 11:05:48,991::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53822 >Detector thread::DEBUG::2014-10-29 11:05:48,992::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53822) >Thread-135219::DEBUG::2014-10-29 11:05:49,031::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135219::DEBUG::2014-10-29 11:05:49,033::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135219::DEBUG::2014-10-29 11:05:49,052::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135219::DEBUG::2014-10-29 11:05:49,098::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '31', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '31', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:05:49,296::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53823 >Detector thread::DEBUG::2014-10-29 11:05:49,297::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53823 >Detector thread::DEBUG::2014-10-29 11:05:49,297::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53823 >Detector thread::DEBUG::2014-10-29 11:05:49,298::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53823) >Thread-135220::DEBUG::2014-10-29 11:05:49,336::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135220::DEBUG::2014-10-29 11:05:49,337::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135220::DEBUG::2014-10-29 11:05:49,338::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.48', 'elapsedTime': '513381', 'displayType': 'vnc', 'cpuSys': '0.40', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '297907754', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '212460', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '44842.84'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.36', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-17::DEBUG::2014-10-29 11:05:49,379::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:49,379::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:49,380::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:49,380::__init__::232::IOProcess::(_processLogs) (199292) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:49,380::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199292) Queuing response >Thread-179::DEBUG::2014-10-29 11:05:49,382::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:05:49,403::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:49,403::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:49,404::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:49,404::__init__::232::IOProcess::(_processLogs) (199293) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:49,406::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199293) Queuing response >Thread-33::DEBUG::2014-10-29 11:05:49,409::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:05:49,409::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-179::DEBUG::2014-10-29 11:05:49,411::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00230267 s, 162 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:05:49,429::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-33::DEBUG::2014-10-29 11:05:49,434::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00136373 s, 357 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:05:49,439::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-10269::DEBUG::2014-10-29 11:05:49,440::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:05:49,441::__init__::232::IOProcess::(_processLogs) (199294) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:49,457::__init__::232::IOProcess::(_processLogs) (199294) Queuing response >Thread-10269::DEBUG::2014-10-29 11:05:49,462::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000735275 s, 683 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:05:49,464::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:49,468::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:49,469::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:49,469::__init__::232::IOProcess::(_processLogs) (199295) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:49,469::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:49,469::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:49,469::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:49,470::__init__::232::IOProcess::(_processLogs) (199296) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:49,470::__init__::232::IOProcess::(_processLogs) (199295) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:49,470::__init__::232::IOProcess::(_processLogs) (199296) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:49,473::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:49,473::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:49,473::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:49,474::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:49,474::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:49,475::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:49,476::__init__::232::IOProcess::(_processLogs) (199298) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:49,476::__init__::232::IOProcess::(_processLogs) (199298) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:49,477::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199297) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:49,480::__init__::232::IOProcess::(_processLogs) (199297) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:49,480::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:49,480::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:49,481::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:49,482::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199299) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:49,482::__init__::232::IOProcess::(_processLogs) (199299) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:49,483::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:49,483::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:49,483::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:49,484::__init__::232::IOProcess::(_processLogs) (199300) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:49,485::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199300) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:50,025::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:50,028::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135221::DEBUG::2014-10-29 11:05:50,031::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:50,034::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:50,036::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135222::DEBUG::2014-10-29 11:05:50,039::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135222::DEBUG::2014-10-29 11:05:50,041::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:05:50,342::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53825 >Detector thread::DEBUG::2014-10-29 11:05:50,342::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53825 >Detector thread::DEBUG::2014-10-29 11:05:50,343::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53825 >Detector thread::DEBUG::2014-10-29 11:05:50,343::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53825) >Thread-135223::DEBUG::2014-10-29 11:05:50,383::task::595::Storage.TaskManager.Task::(_updateState) Task=`3550d257-5ce4-4418-8edc-63e5c0758d6f`::moving from state init -> state preparing >Thread-135223::INFO::2014-10-29 11:05:50,383::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135223::INFO::2014-10-29 11:05:50,384::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000512546', 'lastCheck': '2.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00136373', 'lastCheck': '0.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00230267', 'lastCheck': '0.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000735275', 'lastCheck': '0.9', 'valid': True}} >Thread-135223::DEBUG::2014-10-29 11:05:50,384::task::1191::Storage.TaskManager.Task::(prepare) Task=`3550d257-5ce4-4418-8edc-63e5c0758d6f`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000512546', 'lastCheck': '2.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00136373', 'lastCheck': '0.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00230267', 'lastCheck': '0.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000735275', 'lastCheck': '0.9', 'valid': True}} >Thread-135223::DEBUG::2014-10-29 11:05:50,385::task::595::Storage.TaskManager.Task::(_updateState) Task=`3550d257-5ce4-4418-8edc-63e5c0758d6f`::moving from state preparing -> state finished >Thread-135223::DEBUG::2014-10-29 11:05:50,385::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135223::DEBUG::2014-10-29 11:05:50,385::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135223::DEBUG::2014-10-29 11:05:50,385::task::993::Storage.TaskManager.Task::(_decref) Task=`3550d257-5ce4-4418-8edc-63e5c0758d6f`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:53,055::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:53,058::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135224::DEBUG::2014-10-29 11:05:53,061::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:53,063::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:53,065::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135225::DEBUG::2014-10-29 11:05:53,068::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135225::DEBUG::2014-10-29 11:05:53,071::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:53,549::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:53,550::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:53,551::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:05:55,330::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53827 >Detector thread::DEBUG::2014-10-29 11:05:55,331::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53827 >Detector thread::DEBUG::2014-10-29 11:05:55,331::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53827 >Detector thread::DEBUG::2014-10-29 11:05:55,331::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53827) >Thread-135226::DEBUG::2014-10-29 11:05:55,371::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135226::DEBUG::2014-10-29 11:05:55,372::task::595::Storage.TaskManager.Task::(_updateState) Task=`627b5a55-179b-4d71-8caf-90cb66e1c939`::moving from state init -> state preparing >Thread-135226::INFO::2014-10-29 11:05:55,372::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135226::DEBUG::2014-10-29 11:05:55,375::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:05:55,376::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:55,376::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:55,377::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:55,377::__init__::232::IOProcess::(_processLogs) (199301) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:05:55,378::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199301) Queuing response >Thread-135226::DEBUG::2014-10-29 11:05:55,379::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135226::DEBUG::2014-10-29 11:05:55,379::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135226::INFO::2014-10-29 11:05:55,380::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135226::DEBUG::2014-10-29 11:05:55,380::task::1191::Storage.TaskManager.Task::(prepare) Task=`627b5a55-179b-4d71-8caf-90cb66e1c939`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135226::DEBUG::2014-10-29 11:05:55,380::task::595::Storage.TaskManager.Task::(_updateState) Task=`627b5a55-179b-4d71-8caf-90cb66e1c939`::moving from state preparing -> state finished >Thread-135226::DEBUG::2014-10-29 11:05:55,380::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135226::DEBUG::2014-10-29 11:05:55,381::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135226::DEBUG::2014-10-29 11:05:55,381::task::993::Storage.TaskManager.Task::(_decref) Task=`627b5a55-179b-4d71-8caf-90cb66e1c939`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:05:55,424::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53828 >Detector thread::DEBUG::2014-10-29 11:05:55,425::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53828 >Detector thread::DEBUG::2014-10-29 11:05:55,425::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53828 >Detector thread::DEBUG::2014-10-29 11:05:55,426::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53828) >Thread-135227::DEBUG::2014-10-29 11:05:55,464::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135227::DEBUG::2014-10-29 11:05:55,465::task::595::Storage.TaskManager.Task::(_updateState) Task=`c100ed47-6013-4eb6-873c-dc210fd05eaf`::moving from state init -> state preparing >Thread-135227::INFO::2014-10-29 11:05:55,465::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135227::DEBUG::2014-10-29 11:05:55,466::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135227::DEBUG::2014-10-29 11:05:55,466::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135227::DEBUG::2014-10-29 11:05:55,466::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135227::DEBUG::2014-10-29 11:05:55,466::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135227::DEBUG::2014-10-29 11:05:55,467::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135227::DEBUG::2014-10-29 11:05:55,467::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135227::DEBUG::2014-10-29 11:05:55,558::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135227::DEBUG::2014-10-29 11:05:55,559::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135227::DEBUG::2014-10-29 11:05:55,800::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135227::DEBUG::2014-10-29 11:05:55,801::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135227::DEBUG::2014-10-29 11:05:55,802::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135227::DEBUG::2014-10-29 11:05:55,802::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135227::DEBUG::2014-10-29 11:05:55,803::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135227::DEBUG::2014-10-29 11:05:55,803::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135227::DEBUG::2014-10-29 11:05:55,803::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135227::DEBUG::2014-10-29 11:05:55,804::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:05:55,809::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:55,810::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:55,810::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:55,810::__init__::232::IOProcess::(_processLogs) (199302) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:05:55,812::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199302) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:55,816::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:55,816::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:55,816::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:55,817::__init__::232::IOProcess::(_processLogs) (199303) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:05:55,817::__init__::232::IOProcess::(_processLogs) (199303) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:55,820::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:55,822::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:55,824::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:55,826::__init__::232::IOProcess::(_processLogs) (199304) Got request for method 'glob' >Thread-135227::DEBUG::2014-10-29 11:05:55,829::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:05:55,831::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199304) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:55,833::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:55,833::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:55,833::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:55,833::__init__::232::IOProcess::(_processLogs) (199305) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:05:55,834::__init__::232::IOProcess::(_processLogs) (199305) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:55,836::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:55,836::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:55,836::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:55,836::__init__::232::IOProcess::(_processLogs) (199306) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:05:55,839::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199306) Queuing response >Thread-135227::DEBUG::2014-10-29 11:05:55,840::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:05:55,841::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:55,841::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:55,842::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:55,842::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199307) Got request for method 'readfile' >Thread-135227::DEBUG::2014-10-29 11:05:55,843::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:05:55,844::__init__::232::IOProcess::(_processLogs) (199307) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:55,846::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:55,846::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:55,847::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:55,848::__init__::232::IOProcess::(_processLogs) (199308) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:55,848::__init__::232::IOProcess::(_processLogs) (199308) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:55,849::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:55,849::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:55,850::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-135227::DEBUG::2014-10-29 11:05:55,850::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:05:55,851::__init__::232::IOProcess::(_processLogs) (199309) Got request for method 'glob' >Thread-135227::INFO::2014-10-29 11:05:55,851::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:05:55,852::__init__::232::IOProcess::(_processLogs) (199309) Queuing response >Thread-135227::INFO::2014-10-29 11:05:55,853::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135227::INFO::2014-10-29 11:05:55,854::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:05:55,855::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:55,855::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:55,855::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:55,855::__init__::232::IOProcess::(_processLogs) (199310) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:05:55,856::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199310) Queuing response >Thread-135227::DEBUG::2014-10-29 11:05:55,857::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135227::DEBUG::2014-10-29 11:05:55,859::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`c3c4284b-82dd-4414-ad66-a5663ff30f6c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135227::DEBUG::2014-10-29 11:05:55,859::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135227::DEBUG::2014-10-29 11:05:55,859::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135227::DEBUG::2014-10-29 11:05:55,860::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`c3c4284b-82dd-4414-ad66-a5663ff30f6c`::Granted request >Thread-135227::DEBUG::2014-10-29 11:05:55,860::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c100ed47-6013-4eb6-873c-dc210fd05eaf`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135227::DEBUG::2014-10-29 11:05:55,861::task::993::Storage.TaskManager.Task::(_decref) Task=`c100ed47-6013-4eb6-873c-dc210fd05eaf`::ref 1 aborting False >Thread-135227::INFO::2014-10-29 11:05:55,863::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135227::DEBUG::2014-10-29 11:05:55,864::task::1191::Storage.TaskManager.Task::(prepare) Task=`c100ed47-6013-4eb6-873c-dc210fd05eaf`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135227::DEBUG::2014-10-29 11:05:55,864::task::595::Storage.TaskManager.Task::(_updateState) Task=`c100ed47-6013-4eb6-873c-dc210fd05eaf`::moving from state preparing -> state finished >Thread-135227::DEBUG::2014-10-29 11:05:55,864::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135227::DEBUG::2014-10-29 11:05:55,864::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135227::DEBUG::2014-10-29 11:05:55,865::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135227::DEBUG::2014-10-29 11:05:55,865::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135227::DEBUG::2014-10-29 11:05:55,865::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135227::DEBUG::2014-10-29 11:05:55,866::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135227::DEBUG::2014-10-29 11:05:55,866::task::993::Storage.TaskManager.Task::(_decref) Task=`c100ed47-6013-4eb6-873c-dc210fd05eaf`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:05:55,888::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53829 >Detector thread::DEBUG::2014-10-29 11:05:55,889::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53829 >Detector thread::DEBUG::2014-10-29 11:05:55,889::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53829 >Detector thread::DEBUG::2014-10-29 11:05:55,890::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53829) >Thread-135232::DEBUG::2014-10-29 11:05:55,928::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135232::DEBUG::2014-10-29 11:05:55,929::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb2e64bd-39e8-43a4-a966-5d1a692078e7`::moving from state init -> state preparing >Thread-135232::INFO::2014-10-29 11:05:55,929::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135232::INFO::2014-10-29 11:05:55,930::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000512546', 'lastCheck': '8.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00136373', 'lastCheck': '6.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00230267', 'lastCheck': '6.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000735275', 'lastCheck': '6.5', 'valid': True}} >Thread-135232::DEBUG::2014-10-29 11:05:55,930::task::1191::Storage.TaskManager.Task::(prepare) Task=`fb2e64bd-39e8-43a4-a966-5d1a692078e7`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000512546', 'lastCheck': '8.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00136373', 'lastCheck': '6.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00230267', 'lastCheck': '6.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000735275', 'lastCheck': '6.5', 'valid': True}} >Thread-135232::DEBUG::2014-10-29 11:05:55,930::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb2e64bd-39e8-43a4-a966-5d1a692078e7`::moving from state preparing -> state finished >Thread-135232::DEBUG::2014-10-29 11:05:55,930::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135232::DEBUG::2014-10-29 11:05:55,931::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135232::DEBUG::2014-10-29 11:05:55,931::task::993::Storage.TaskManager.Task::(_decref) Task=`fb2e64bd-39e8-43a4-a966-5d1a692078e7`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:56,086::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:56,088::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135233::DEBUG::2014-10-29 11:05:56,093::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:56,095::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:56,097::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135234::DEBUG::2014-10-29 11:05:56,100::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135234::DEBUG::2014-10-29 11:05:56,103::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:05:57,442::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:57,443::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:57,444::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:57,446::__init__::232::IOProcess::(_processLogs) (199311) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:05:57,446::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:05:57,447::__init__::232::IOProcess::(_processLogs) (199311) Queuing response >Thread-178::DEBUG::2014-10-29 11:05:57,467::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000612245 s, 830 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:05:57,469::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:57,469::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:57,469::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:57,470::__init__::232::IOProcess::(_processLogs) (199312) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:57,470::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199312) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:57,472::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:57,472::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:57,473::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:57,473::__init__::232::IOProcess::(_processLogs) (199313) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:57,474::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199313) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:57,475::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:57,475::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:57,476::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:57,477::__init__::232::IOProcess::(_processLogs) (199314) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:57,477::__init__::232::IOProcess::(_processLogs) (199314) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:57,477::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:57,478::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:57,478::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:57,478::__init__::232::IOProcess::(_processLogs) (199315) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:57,479::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199315) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:58,559::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:58,560::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:05:58,563::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:59,128::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:59,131::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135235::DEBUG::2014-10-29 11:05:59,135::task::595::Storage.TaskManager.Task::(_updateState) Task=`766609d6-0ba2-49bd-84fe-61fcb6aedde2`::moving from state init -> state preparing >Thread-135235::INFO::2014-10-29 11:05:59,135::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135235::INFO::2014-10-29 11:05:59,136::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612245', 'lastCheck': '1.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00136373', 'lastCheck': '9.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00230267', 'lastCheck': '9.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000735275', 'lastCheck': '9.7', 'valid': True}} >Thread-135235::DEBUG::2014-10-29 11:05:59,136::task::1191::Storage.TaskManager.Task::(prepare) Task=`766609d6-0ba2-49bd-84fe-61fcb6aedde2`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612245', 'lastCheck': '1.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00136373', 'lastCheck': '9.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00230267', 'lastCheck': '9.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000735275', 'lastCheck': '9.7', 'valid': True}} >Thread-135235::DEBUG::2014-10-29 11:05:59,136::task::595::Storage.TaskManager.Task::(_updateState) Task=`766609d6-0ba2-49bd-84fe-61fcb6aedde2`::moving from state preparing -> state finished >Thread-135235::DEBUG::2014-10-29 11:05:59,137::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135235::DEBUG::2014-10-29 11:05:59,137::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135235::DEBUG::2014-10-29 11:05:59,137::task::993::Storage.TaskManager.Task::(_decref) Task=`766609d6-0ba2-49bd-84fe-61fcb6aedde2`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:05:59,152::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53830 >Detector thread::DEBUG::2014-10-29 11:05:59,153::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53830 >Detector thread::DEBUG::2014-10-29 11:05:59,153::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53830 >Detector thread::DEBUG::2014-10-29 11:05:59,153::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53830) >Thread-135235::DEBUG::2014-10-29 11:05:59,169::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-135236::DEBUG::2014-10-29 11:05:59,192::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135236::DEBUG::2014-10-29 11:05:59,195::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:05:59,213::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:05:59,216::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135236::DEBUG::2014-10-29 11:05:59,218::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135237::DEBUG::2014-10-29 11:05:59,227::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135237::DEBUG::2014-10-29 11:05:59,243::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-135236::DEBUG::2014-10-29 11:05:59,284::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '12', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '12', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-17::DEBUG::2014-10-29 11:05:59,469::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:59,469::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:59,470::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:59,470::__init__::232::IOProcess::(_processLogs) (199316) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:59,471::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199316) Queuing response >Thread-179::DEBUG::2014-10-29 11:05:59,473::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:05:59,495::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-179::DEBUG::2014-10-29 11:05:59,496::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000547694 s, 679 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:05:59,498::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:59,500::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:59,501::__init__::232::IOProcess::(_processLogs) (199317) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:59,501::__init__::232::IOProcess::(_processLogs) (199317) Queuing response >Thread-33::DEBUG::2014-10-29 11:05:59,502::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:05:59,517::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:59,520::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:59,521::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:59,521::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:59,521::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:59,522::__init__::232::IOProcess::(_processLogs) (199318) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:59,522::__init__::232::IOProcess::(_processLogs) (199318) Queuing response >Detector thread::DEBUG::2014-10-29 11:05:59,525::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53831 >Thread-17::DEBUG::2014-10-29 11:05:59,526::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-10269::DEBUG::2014-10-29 11:05:59,531::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:05:59,531::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000552045 s, 882 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:05:59,532::__init__::232::IOProcess::(_processLogs) (199319) Got request for method 'statvfs' >Detector thread::DEBUG::2014-10-29 11:05:59,533::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53831 >Thread-17::DEBUG::2014-10-29 11:05:59,554::__init__::232::IOProcess::(_processLogs) (199319) Queuing response >Detector thread::DEBUG::2014-10-29 11:05:59,555::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53831 >Thread-10269::DEBUG::2014-10-29 11:05:59,557::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00251937 s, 199 kB/s\n'; <rc> = 0 >Detector thread::DEBUG::2014-10-29 11:05:59,560::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53831) >Thread-135238::DEBUG::2014-10-29 11:05:59,570::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-17::DEBUG::2014-10-29 11:05:59,572::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:59,575::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-135238::DEBUG::2014-10-29 11:05:59,576::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:05:59,576::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:59,578::__init__::232::IOProcess::(_processLogs) (199320) Got request for method 'statvfs' >Thread-135238::DEBUG::2014-10-29 11:05:59,580::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.48', 'elapsedTime': '513392', 'displayType': 'vnc', 'cpuSys': '0.40', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '297907754', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '212460', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '44842.84'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.59', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-17::DEBUG::2014-10-29 11:05:59,585::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199320) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:59,588::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:59,589::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:59,596::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:59,598::__init__::232::IOProcess::(_processLogs) (199321) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:05:59,601::__init__::232::IOProcess::(_processLogs) (199321) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:59,602::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:59,602::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:59,603::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:59,604::__init__::232::IOProcess::(_processLogs) (199322) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:59,604::__init__::232::IOProcess::(_processLogs) (199322) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:59,605::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:59,605::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:59,605::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:59,606::__init__::232::IOProcess::(_processLogs) (199323) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:59,606::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199323) Queuing response >Thread-17::DEBUG::2014-10-29 11:05:59,607::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:05:59,608::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:05:59,608::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:05:59,608::__init__::232::IOProcess::(_processLogs) (199324) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:05:59,609::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199324) Queuing response >Detector thread::DEBUG::2014-10-29 11:06:00,445::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53833 >Detector thread::DEBUG::2014-10-29 11:06:00,446::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53833 >Detector thread::DEBUG::2014-10-29 11:06:00,446::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53833 >Detector thread::DEBUG::2014-10-29 11:06:00,446::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53833) >Thread-135239::DEBUG::2014-10-29 11:06:00,486::task::595::Storage.TaskManager.Task::(_updateState) Task=`96639e84-753d-4dfb-a985-f37f3514c3db`::moving from state init -> state preparing >Thread-135239::INFO::2014-10-29 11:06:00,486::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135239::INFO::2014-10-29 11:06:00,487::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612245', 'lastCheck': '3.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552045', 'lastCheck': '0.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000547694', 'lastCheck': '0.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00251937', 'lastCheck': '0.9', 'valid': True}} >Thread-135239::DEBUG::2014-10-29 11:06:00,487::task::1191::Storage.TaskManager.Task::(prepare) Task=`96639e84-753d-4dfb-a985-f37f3514c3db`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612245', 'lastCheck': '3.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552045', 'lastCheck': '0.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000547694', 'lastCheck': '0.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00251937', 'lastCheck': '0.9', 'valid': True}} >Thread-135239::DEBUG::2014-10-29 11:06:00,488::task::595::Storage.TaskManager.Task::(_updateState) Task=`96639e84-753d-4dfb-a985-f37f3514c3db`::moving from state preparing -> state finished >Thread-135239::DEBUG::2014-10-29 11:06:00,488::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135239::DEBUG::2014-10-29 11:06:00,488::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135239::DEBUG::2014-10-29 11:06:00,488::task::993::Storage.TaskManager.Task::(_decref) Task=`96639e84-753d-4dfb-a985-f37f3514c3db`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:06:01,003::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:02,310::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:02,313::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135240::DEBUG::2014-10-29 11:06:02,316::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:02,319::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:02,321::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135241::DEBUG::2014-10-29 11:06:02,324::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135241::DEBUG::2014-10-29 11:06:02,326::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:06:03,078::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:03,567::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:03,568::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:03,570::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:05,343::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:05,347::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135242::DEBUG::2014-10-29 11:06:05,349::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:05,353::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:05,354::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135243::DEBUG::2014-10-29 11:06:05,357::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135243::DEBUG::2014-10-29 11:06:05,359::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:06:06,500::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53835 >Detector thread::DEBUG::2014-10-29 11:06:06,502::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53835 >Detector thread::DEBUG::2014-10-29 11:06:06,502::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53835 >Detector thread::DEBUG::2014-10-29 11:06:06,503::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53835) >Thread-135244::DEBUG::2014-10-29 11:06:06,541::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135244::DEBUG::2014-10-29 11:06:06,542::task::595::Storage.TaskManager.Task::(_updateState) Task=`b781058f-29bb-44b8-b202-612c925dd080`::moving from state init -> state preparing >Thread-135244::INFO::2014-10-29 11:06:06,542::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135244::DEBUG::2014-10-29 11:06:06,549::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:06:06,551::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:06,551::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:06,551::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:06,551::__init__::232::IOProcess::(_processLogs) (199325) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:06:06,552::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199325) Queuing response >Thread-135244::DEBUG::2014-10-29 11:06:06,552::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135244::DEBUG::2014-10-29 11:06:06,553::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135244::INFO::2014-10-29 11:06:06,553::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135244::DEBUG::2014-10-29 11:06:06,553::task::1191::Storage.TaskManager.Task::(prepare) Task=`b781058f-29bb-44b8-b202-612c925dd080`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135244::DEBUG::2014-10-29 11:06:06,554::task::595::Storage.TaskManager.Task::(_updateState) Task=`b781058f-29bb-44b8-b202-612c925dd080`::moving from state preparing -> state finished >Thread-135244::DEBUG::2014-10-29 11:06:06,554::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135244::DEBUG::2014-10-29 11:06:06,554::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135244::DEBUG::2014-10-29 11:06:06,555::task::993::Storage.TaskManager.Task::(_decref) Task=`b781058f-29bb-44b8-b202-612c925dd080`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:06:06,601::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53836 >Detector thread::DEBUG::2014-10-29 11:06:06,602::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53836 >Detector thread::DEBUG::2014-10-29 11:06:06,602::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53836 >Detector thread::DEBUG::2014-10-29 11:06:06,603::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53836) >Thread-135245::DEBUG::2014-10-29 11:06:06,642::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135245::DEBUG::2014-10-29 11:06:06,643::task::595::Storage.TaskManager.Task::(_updateState) Task=`bb519c21-bcb2-479e-99ba-997f7e1cf5c4`::moving from state init -> state preparing >Thread-135245::INFO::2014-10-29 11:06:06,643::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135245::DEBUG::2014-10-29 11:06:06,643::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135245::DEBUG::2014-10-29 11:06:06,644::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135245::DEBUG::2014-10-29 11:06:06,644::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135245::DEBUG::2014-10-29 11:06:06,644::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135245::DEBUG::2014-10-29 11:06:06,644::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135245::DEBUG::2014-10-29 11:06:06,645::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135245::DEBUG::2014-10-29 11:06:06,735::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135245::DEBUG::2014-10-29 11:06:06,736::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135245::DEBUG::2014-10-29 11:06:06,924::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135245::DEBUG::2014-10-29 11:06:06,926::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135245::DEBUG::2014-10-29 11:06:06,927::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135245::DEBUG::2014-10-29 11:06:06,927::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135245::DEBUG::2014-10-29 11:06:06,928::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135245::DEBUG::2014-10-29 11:06:06,928::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135245::DEBUG::2014-10-29 11:06:06,929::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135245::DEBUG::2014-10-29 11:06:06,929::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:06:06,938::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:06,942::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:06,943::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:06,943::__init__::232::IOProcess::(_processLogs) (199326) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:06:06,944::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199326) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:06,945::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:06,947::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:06,949::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:06,951::__init__::232::IOProcess::(_processLogs) (199327) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:06:06,953::__init__::232::IOProcess::(_processLogs) (199327) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:06,955::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:06,958::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-135245::DEBUG::2014-10-29 11:06:06,960::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:06:06,962::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:06,963::__init__::232::IOProcess::(_processLogs) (199328) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:06:06,964::__init__::232::IOProcess::(_processLogs) (199328) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:06,965::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:06,965::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:06,965::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:06,965::__init__::232::IOProcess::(_processLogs) (199329) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:06:06,966::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199329) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:06,967::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:06,968::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:06,968::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:06,968::__init__::232::IOProcess::(_processLogs) (199330) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:06:06,969::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199330) Queuing response >Thread-135245::DEBUG::2014-10-29 11:06:06,969::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:06:06,971::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:06,972::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:06,972::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:06,972::__init__::232::IOProcess::(_processLogs) (199331) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:06:06,973::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199331) Queuing response >Thread-135245::DEBUG::2014-10-29 11:06:06,973::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:06:06,975::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:06,976::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:06,977::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:06,977::__init__::232::IOProcess::(_processLogs) (199332) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:06,977::__init__::232::IOProcess::(_processLogs) (199332) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:06,978::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:06,978::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:06,978::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:06,978::__init__::232::IOProcess::(_processLogs) (199333) Got request for method 'glob' >Thread-135245::DEBUG::2014-10-29 11:06:06,979::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:06:06,979::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199333) Queuing response >Thread-135245::INFO::2014-10-29 11:06:06,980::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135245::INFO::2014-10-29 11:06:06,981::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135245::INFO::2014-10-29 11:06:06,982::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:06:06,982::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:06,983::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:06,983::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:06,983::__init__::232::IOProcess::(_processLogs) (199334) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:06:06,984::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199334) Queuing response >Thread-135245::DEBUG::2014-10-29 11:06:06,984::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135245::DEBUG::2014-10-29 11:06:06,986::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`5060bac3-b807-4879-8f86-69ccdf75b916`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135245::DEBUG::2014-10-29 11:06:06,987::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135245::DEBUG::2014-10-29 11:06:06,987::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135245::DEBUG::2014-10-29 11:06:06,987::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`5060bac3-b807-4879-8f86-69ccdf75b916`::Granted request >Thread-135245::DEBUG::2014-10-29 11:06:06,988::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bb519c21-bcb2-479e-99ba-997f7e1cf5c4`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135245::DEBUG::2014-10-29 11:06:06,988::task::993::Storage.TaskManager.Task::(_decref) Task=`bb519c21-bcb2-479e-99ba-997f7e1cf5c4`::ref 1 aborting False >Thread-135245::INFO::2014-10-29 11:06:06,991::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135245::DEBUG::2014-10-29 11:06:06,991::task::1191::Storage.TaskManager.Task::(prepare) Task=`bb519c21-bcb2-479e-99ba-997f7e1cf5c4`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135245::DEBUG::2014-10-29 11:06:06,992::task::595::Storage.TaskManager.Task::(_updateState) Task=`bb519c21-bcb2-479e-99ba-997f7e1cf5c4`::moving from state preparing -> state finished >Thread-135245::DEBUG::2014-10-29 11:06:06,992::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135245::DEBUG::2014-10-29 11:06:06,992::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135245::DEBUG::2014-10-29 11:06:06,993::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135245::DEBUG::2014-10-29 11:06:06,993::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135245::DEBUG::2014-10-29 11:06:06,993::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135245::DEBUG::2014-10-29 11:06:06,993::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135245::DEBUG::2014-10-29 11:06:06,994::task::993::Storage.TaskManager.Task::(_decref) Task=`bb519c21-bcb2-479e-99ba-997f7e1cf5c4`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:06:07,017::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53837 >Detector thread::DEBUG::2014-10-29 11:06:07,018::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53837 >Detector thread::DEBUG::2014-10-29 11:06:07,018::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53837 >Detector thread::DEBUG::2014-10-29 11:06:07,018::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53837) >Thread-135250::DEBUG::2014-10-29 11:06:07,057::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135250::DEBUG::2014-10-29 11:06:07,058::task::595::Storage.TaskManager.Task::(_updateState) Task=`b41497f4-9598-4aba-80d1-c8a333a1108c`::moving from state init -> state preparing >Thread-135250::INFO::2014-10-29 11:06:07,058::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135250::INFO::2014-10-29 11:06:07,059::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612245', 'lastCheck': '9.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552045', 'lastCheck': '7.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000547694', 'lastCheck': '7.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00251937', 'lastCheck': '7.5', 'valid': True}} >Thread-135250::DEBUG::2014-10-29 11:06:07,059::task::1191::Storage.TaskManager.Task::(prepare) Task=`b41497f4-9598-4aba-80d1-c8a333a1108c`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612245', 'lastCheck': '9.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552045', 'lastCheck': '7.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000547694', 'lastCheck': '7.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00251937', 'lastCheck': '7.5', 'valid': True}} >Thread-135250::DEBUG::2014-10-29 11:06:07,059::task::595::Storage.TaskManager.Task::(_updateState) Task=`b41497f4-9598-4aba-80d1-c8a333a1108c`::moving from state preparing -> state finished >Thread-135250::DEBUG::2014-10-29 11:06:07,060::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135250::DEBUG::2014-10-29 11:06:07,060::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135250::DEBUG::2014-10-29 11:06:07,060::task::993::Storage.TaskManager.Task::(_decref) Task=`b41497f4-9598-4aba-80d1-c8a333a1108c`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:06:07,482::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:07,482::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:07,482::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:07,483::__init__::232::IOProcess::(_processLogs) (199335) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:07,483::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199335) Queuing response >Thread-178::DEBUG::2014-10-29 11:06:07,484::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:06:07,502::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000513697 s, 989 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:06:07,504::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:07,505::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:07,505::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:07,505::__init__::232::IOProcess::(_processLogs) (199336) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:07,507::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199336) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:07,509::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:07,510::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:07,511::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:07,511::__init__::232::IOProcess::(_processLogs) (199337) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:07,511::__init__::232::IOProcess::(_processLogs) (199337) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:07,512::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:07,512::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:07,512::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:07,513::__init__::232::IOProcess::(_processLogs) (199338) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:07,514::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199338) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:07,515::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:07,515::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:07,515::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:07,515::__init__::232::IOProcess::(_processLogs) (199339) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:07,516::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199339) Queuing response >Detector thread::DEBUG::2014-10-29 11:06:08,334::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53838 >Detector thread::DEBUG::2014-10-29 11:06:08,335::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53838 >Detector thread::DEBUG::2014-10-29 11:06:08,335::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53838 >Detector thread::DEBUG::2014-10-29 11:06:08,335::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53838) >Thread-135251::DEBUG::2014-10-29 11:06:08,375::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:08,376::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:08,384::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135251::DEBUG::2014-10-29 11:06:08,386::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135252::DEBUG::2014-10-29 11:06:08,409::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-135251::DEBUG::2014-10-29 11:06:08,410::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:08,416::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:08,419::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135253::DEBUG::2014-10-29 11:06:08,423::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135253::DEBUG::2014-10-29 11:06:08,425::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-135251::DEBUG::2014-10-29 11:06:08,474::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '93', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '93', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:08,573::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:08,575::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:08,578::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:06:09,574::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:09,575::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:09,575::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:09,576::__init__::232::IOProcess::(_processLogs) (199340) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:09,576::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199340) Queuing response >Thread-179::DEBUG::2014-10-29 11:06:09,578::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:06:09,594::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000573432 s, 649 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:06:09,596::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:09,597::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:09,597::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:09,597::__init__::232::IOProcess::(_processLogs) (199341) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:09,597::__init__::232::IOProcess::(_processLogs) (199341) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:09,601::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:09,601::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:09,601::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:09,602::__init__::232::IOProcess::(_processLogs) (199342) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:09,603::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199342) Queuing response >Thread-10269::DEBUG::2014-10-29 11:06:09,604::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:06:09,623::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:09,624::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:09,624::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:09,624::__init__::232::IOProcess::(_processLogs) (199343) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:09,626::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199343) Queuing response >Thread-33::DEBUG::2014-10-29 11:06:09,629::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:06:09,629::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00379272 s, 132 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:06:09,647::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:09,648::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:09,648::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-33::DEBUG::2014-10-29 11:06:09,650::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00194074 s, 251 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:06:09,651::__init__::232::IOProcess::(_processLogs) (199344) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:09,654::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199344) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:09,656::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:09,656::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:09,657::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:09,657::__init__::232::IOProcess::(_processLogs) (199345) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:09,658::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199345) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:09,660::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:09,661::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:09,662::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:09,662::__init__::232::IOProcess::(_processLogs) (199346) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:09,662::__init__::232::IOProcess::(_processLogs) (199346) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:09,663::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:09,664::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:09,665::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:09,665::__init__::232::IOProcess::(_processLogs) (199347) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:09,665::__init__::232::IOProcess::(_processLogs) (199347) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:09,665::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:09,666::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:09,667::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:09,668::__init__::232::IOProcess::(_processLogs) (199348) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:09,668::__init__::232::IOProcess::(_processLogs) (199348) Queuing response >Detector thread::DEBUG::2014-10-29 11:06:09,748::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53839 >Detector thread::DEBUG::2014-10-29 11:06:09,749::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53839 >Detector thread::DEBUG::2014-10-29 11:06:09,749::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53839 >Detector thread::DEBUG::2014-10-29 11:06:09,749::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53839) >Thread-135254::DEBUG::2014-10-29 11:06:09,788::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135254::DEBUG::2014-10-29 11:06:09,790::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135254::DEBUG::2014-10-29 11:06:09,791::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.94', 'elapsedTime': '513402', 'displayType': 'vnc', 'cpuSys': '1.06', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '297907754', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '212460', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '44842.84'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.78', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:06:10,552::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53841 >Detector thread::DEBUG::2014-10-29 11:06:10,552::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53841 >Detector thread::DEBUG::2014-10-29 11:06:10,553::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53841 >Detector thread::DEBUG::2014-10-29 11:06:10,553::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53841) >Thread-135255::DEBUG::2014-10-29 11:06:10,593::task::595::Storage.TaskManager.Task::(_updateState) Task=`7472d097-61b4-4b05-a1bc-a94f2bd2035c`::moving from state init -> state preparing >Thread-135255::INFO::2014-10-29 11:06:10,593::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135255::INFO::2014-10-29 11:06:10,594::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000513697', 'lastCheck': '3.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00194074', 'lastCheck': '0.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000573432', 'lastCheck': '1.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00379272', 'lastCheck': '0.9', 'valid': True}} >Thread-135255::DEBUG::2014-10-29 11:06:10,594::task::1191::Storage.TaskManager.Task::(prepare) Task=`7472d097-61b4-4b05-a1bc-a94f2bd2035c`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000513697', 'lastCheck': '3.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00194074', 'lastCheck': '0.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000573432', 'lastCheck': '1.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00379272', 'lastCheck': '0.9', 'valid': True}} >Thread-135255::DEBUG::2014-10-29 11:06:10,595::task::595::Storage.TaskManager.Task::(_updateState) Task=`7472d097-61b4-4b05-a1bc-a94f2bd2035c`::moving from state preparing -> state finished >Thread-135255::DEBUG::2014-10-29 11:06:10,595::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135255::DEBUG::2014-10-29 11:06:10,595::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135255::DEBUG::2014-10-29 11:06:10,596::task::993::Storage.TaskManager.Task::(_decref) Task=`7472d097-61b4-4b05-a1bc-a94f2bd2035c`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:11,440::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:11,443::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135256::DEBUG::2014-10-29 11:06:11,447::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:11,450::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:11,452::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135257::DEBUG::2014-10-29 11:06:11,455::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135257::DEBUG::2014-10-29 11:06:11,457::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:13,585::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:13,586::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:13,587::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:14,473::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:14,479::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135258::DEBUG::2014-10-29 11:06:14,490::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a24c2d7-4f97-4b9e-9f3a-469edcc726f5`::moving from state init -> state preparing >Thread-135258::INFO::2014-10-29 11:06:14,492::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135258::INFO::2014-10-29 11:06:14,495::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000513697', 'lastCheck': '7.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00194074', 'lastCheck': '4.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000573432', 'lastCheck': '4.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00379272', 'lastCheck': '4.8', 'valid': True}} >Thread-135258::DEBUG::2014-10-29 11:06:14,497::task::1191::Storage.TaskManager.Task::(prepare) Task=`3a24c2d7-4f97-4b9e-9f3a-469edcc726f5`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000513697', 'lastCheck': '7.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00194074', 'lastCheck': '4.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000573432', 'lastCheck': '4.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00379272', 'lastCheck': '4.8', 'valid': True}} >Thread-135258::DEBUG::2014-10-29 11:06:14,498::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a24c2d7-4f97-4b9e-9f3a-469edcc726f5`::moving from state preparing -> state finished >Thread-135258::DEBUG::2014-10-29 11:06:14,500::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135258::DEBUG::2014-10-29 11:06:14,502::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135258::DEBUG::2014-10-29 11:06:14,504::task::993::Storage.TaskManager.Task::(_decref) Task=`3a24c2d7-4f97-4b9e-9f3a-469edcc726f5`::ref 0 aborting False >Thread-135258::DEBUG::2014-10-29 11:06:14,568::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:14,591::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:14,593::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135259::DEBUG::2014-10-29 11:06:14,596::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135259::DEBUG::2014-10-29 11:06:14,599::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:06:16,026::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-17::DEBUG::2014-10-29 11:06:17,520::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:17,520::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:17,521::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:17,521::__init__::232::IOProcess::(_processLogs) (199349) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:17,522::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199349) Queuing response >Thread-178::DEBUG::2014-10-29 11:06:17,524::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:06:17,546::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000592148 s, 858 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:06:17,548::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:17,548::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:17,549::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:17,551::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199350) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:17,553::__init__::232::IOProcess::(_processLogs) (199350) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:17,554::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:17,554::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:17,554::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:17,554::__init__::232::IOProcess::(_processLogs) (199351) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:17,555::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199351) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:17,557::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:17,557::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:17,557::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:17,558::__init__::232::IOProcess::(_processLogs) (199352) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:17,559::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199352) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:17,560::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:17,560::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:17,561::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:17,561::__init__::232::IOProcess::(_processLogs) (199353) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:17,562::__init__::232::IOProcess::(_processLogs) (199353) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:17,643::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:17,646::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135260::DEBUG::2014-10-29 11:06:17,650::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:17,653::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Detector thread::DEBUG::2014-10-29 11:06:17,657::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53843 >Detector thread::DEBUG::2014-10-29 11:06:17,657::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53843 >Detector thread::DEBUG::2014-10-29 11:06:17,657::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53843 >Detector thread::DEBUG::2014-10-29 11:06:17,658::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53843) >JsonRpcServer::DEBUG::2014-10-29 11:06:17,662::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135262::DEBUG::2014-10-29 11:06:17,667::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135262::DEBUG::2014-10-29 11:06:17,669::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-135261::DEBUG::2014-10-29 11:06:17,698::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135261::DEBUG::2014-10-29 11:06:17,699::task::595::Storage.TaskManager.Task::(_updateState) Task=`f7bffb25-7130-4041-a362-8ce3919f112d`::moving from state init -> state preparing >Thread-135261::INFO::2014-10-29 11:06:17,699::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135261::DEBUG::2014-10-29 11:06:17,702::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:06:17,703::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:17,703::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:17,704::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:17,704::__init__::232::IOProcess::(_processLogs) (199354) Got request for method 'glob' >Thread-135261::DEBUG::2014-10-29 11:06:17,705::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:06:17,705::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199354) Queuing response >Thread-135261::DEBUG::2014-10-29 11:06:17,706::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135261::INFO::2014-10-29 11:06:17,707::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135261::DEBUG::2014-10-29 11:06:17,707::task::1191::Storage.TaskManager.Task::(prepare) Task=`f7bffb25-7130-4041-a362-8ce3919f112d`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135261::DEBUG::2014-10-29 11:06:17,708::task::595::Storage.TaskManager.Task::(_updateState) Task=`f7bffb25-7130-4041-a362-8ce3919f112d`::moving from state preparing -> state finished >Thread-135261::DEBUG::2014-10-29 11:06:17,708::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135261::DEBUG::2014-10-29 11:06:17,708::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135261::DEBUG::2014-10-29 11:06:17,708::task::993::Storage.TaskManager.Task::(_decref) Task=`f7bffb25-7130-4041-a362-8ce3919f112d`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:06:17,752::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53844 >Detector thread::DEBUG::2014-10-29 11:06:17,752::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53844 >Detector thread::DEBUG::2014-10-29 11:06:17,753::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53844 >Detector thread::DEBUG::2014-10-29 11:06:17,753::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53844) >Thread-135263::DEBUG::2014-10-29 11:06:17,792::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135263::DEBUG::2014-10-29 11:06:17,792::task::595::Storage.TaskManager.Task::(_updateState) Task=`b8ce8a72-233e-447b-8578-3de1387b4fdc`::moving from state init -> state preparing >Thread-135263::INFO::2014-10-29 11:06:17,793::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135263::DEBUG::2014-10-29 11:06:17,793::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135263::DEBUG::2014-10-29 11:06:17,793::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135263::DEBUG::2014-10-29 11:06:17,794::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135263::DEBUG::2014-10-29 11:06:17,794::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135263::DEBUG::2014-10-29 11:06:17,794::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135263::DEBUG::2014-10-29 11:06:17,795::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135263::DEBUG::2014-10-29 11:06:17,878::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135263::DEBUG::2014-10-29 11:06:17,879::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135263::DEBUG::2014-10-29 11:06:18,048::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135263::DEBUG::2014-10-29 11:06:18,049::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135263::DEBUG::2014-10-29 11:06:18,050::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135263::DEBUG::2014-10-29 11:06:18,050::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135263::DEBUG::2014-10-29 11:06:18,050::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135263::DEBUG::2014-10-29 11:06:18,051::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135263::DEBUG::2014-10-29 11:06:18,051::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135263::DEBUG::2014-10-29 11:06:18,052::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:06:18,057::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:18,060::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:18,061::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:18,061::__init__::232::IOProcess::(_processLogs) (199355) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:06:18,062::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199355) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:18,063::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:18,064::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:18,064::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:18,064::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:18,065::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:18,065::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:18,065::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:18,066::__init__::232::IOProcess::(_processLogs) (199356) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:06:18,066::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:18,066::__init__::232::IOProcess::(_processLogs) (199357) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:06:18,066::__init__::232::IOProcess::(_processLogs) (199356) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:18,067::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:18,067::__init__::232::IOProcess::(_processLogs) (199358) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:06:18,067::__init__::232::IOProcess::(_processLogs) (199357) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:18,067::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199358) Queuing response >Thread-135263::DEBUG::2014-10-29 11:06:18,076::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:06:18,077::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:18,077::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:18,077::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:18,078::__init__::232::IOProcess::(_processLogs) (199359) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:06:18,079::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199359) Queuing response >Thread-135263::DEBUG::2014-10-29 11:06:18,079::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:06:18,081::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:18,081::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:18,081::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:18,082::__init__::232::IOProcess::(_processLogs) (199360) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:06:18,083::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199360) Queuing response >Thread-135263::DEBUG::2014-10-29 11:06:18,084::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:06:18,085::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:18,086::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:18,087::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:18,087::__init__::232::IOProcess::(_processLogs) (199361) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:18,087::__init__::232::IOProcess::(_processLogs) (199361) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:18,088::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:18,088::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:18,088::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:18,089::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199362) Got request for method 'glob' >Thread-135263::DEBUG::2014-10-29 11:06:18,089::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:06:18,090::__init__::232::IOProcess::(_processLogs) (199362) Queuing response >Thread-135263::INFO::2014-10-29 11:06:18,091::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135263::INFO::2014-10-29 11:06:18,091::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135263::INFO::2014-10-29 11:06:18,092::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:06:18,093::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:18,093::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:18,094::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-135263::DEBUG::2014-10-29 11:06:18,094::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:06:18,096::__init__::232::IOProcess::(_processLogs) (199363) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:06:18,097::__init__::232::IOProcess::(_processLogs) (199363) Queuing response >Thread-135263::DEBUG::2014-10-29 11:06:18,099::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`7072a957-3d6a-41b2-9ae3-931033bbfe93`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135263::DEBUG::2014-10-29 11:06:18,100::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135263::DEBUG::2014-10-29 11:06:18,100::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135263::DEBUG::2014-10-29 11:06:18,100::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`7072a957-3d6a-41b2-9ae3-931033bbfe93`::Granted request >Thread-135263::DEBUG::2014-10-29 11:06:18,101::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b8ce8a72-233e-447b-8578-3de1387b4fdc`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135263::DEBUG::2014-10-29 11:06:18,101::task::993::Storage.TaskManager.Task::(_decref) Task=`b8ce8a72-233e-447b-8578-3de1387b4fdc`::ref 1 aborting False >Thread-135263::INFO::2014-10-29 11:06:18,104::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135263::DEBUG::2014-10-29 11:06:18,105::task::1191::Storage.TaskManager.Task::(prepare) Task=`b8ce8a72-233e-447b-8578-3de1387b4fdc`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135263::DEBUG::2014-10-29 11:06:18,105::task::595::Storage.TaskManager.Task::(_updateState) Task=`b8ce8a72-233e-447b-8578-3de1387b4fdc`::moving from state preparing -> state finished >Thread-135263::DEBUG::2014-10-29 11:06:18,105::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135263::DEBUG::2014-10-29 11:06:18,105::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135263::DEBUG::2014-10-29 11:06:18,106::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135263::DEBUG::2014-10-29 11:06:18,106::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135263::DEBUG::2014-10-29 11:06:18,106::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135263::DEBUG::2014-10-29 11:06:18,107::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135263::DEBUG::2014-10-29 11:06:18,107::task::993::Storage.TaskManager.Task::(_decref) Task=`b8ce8a72-233e-447b-8578-3de1387b4fdc`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:06:18,139::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53845 >Detector thread::DEBUG::2014-10-29 11:06:18,141::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53845 >Detector thread::DEBUG::2014-10-29 11:06:18,142::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53845 >Detector thread::DEBUG::2014-10-29 11:06:18,142::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53845) >Thread-135268::DEBUG::2014-10-29 11:06:18,181::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135268::DEBUG::2014-10-29 11:06:18,182::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e7b7422-4232-41f8-bbab-ae65868665ed`::moving from state init -> state preparing >Thread-135268::INFO::2014-10-29 11:06:18,182::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135268::INFO::2014-10-29 11:06:18,183::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000592148', 'lastCheck': '0.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00194074', 'lastCheck': '8.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000573432', 'lastCheck': '8.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00379272', 'lastCheck': '8.5', 'valid': True}} >Thread-135268::DEBUG::2014-10-29 11:06:18,183::task::1191::Storage.TaskManager.Task::(prepare) Task=`8e7b7422-4232-41f8-bbab-ae65868665ed`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000592148', 'lastCheck': '0.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00194074', 'lastCheck': '8.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000573432', 'lastCheck': '8.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00379272', 'lastCheck': '8.5', 'valid': True}} >Thread-135268::DEBUG::2014-10-29 11:06:18,183::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e7b7422-4232-41f8-bbab-ae65868665ed`::moving from state preparing -> state finished >Thread-135268::DEBUG::2014-10-29 11:06:18,183::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135268::DEBUG::2014-10-29 11:06:18,184::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135268::DEBUG::2014-10-29 11:06:18,184::task::993::Storage.TaskManager.Task::(_decref) Task=`8e7b7422-4232-41f8-bbab-ae65868665ed`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:06:18,516::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53846 >Detector thread::DEBUG::2014-10-29 11:06:18,516::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53846 >Detector thread::DEBUG::2014-10-29 11:06:18,517::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53846 >Detector thread::DEBUG::2014-10-29 11:06:18,517::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53846) >Thread-135269::DEBUG::2014-10-29 11:06:18,556::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135269::DEBUG::2014-10-29 11:06:18,560::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135269::DEBUG::2014-10-29 11:06:18,579::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:18,599::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:18,602::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:18,610::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135269::DEBUG::2014-10-29 11:06:18,651::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '76', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '76', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-17::DEBUG::2014-10-29 11:06:19,601::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:19,602::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:19,602::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:19,603::__init__::232::IOProcess::(_processLogs) (199364) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:19,603::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199364) Queuing response >Thread-179::DEBUG::2014-10-29 11:06:19,605::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:06:19,624::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000440107 s, 845 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:06:19,625::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:19,626::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:19,626::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:19,627::__init__::232::IOProcess::(_processLogs) (199365) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:19,628::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199365) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:19,657::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:19,657::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:19,657::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:19,658::__init__::232::IOProcess::(_processLogs) (199366) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:19,659::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199366) Queuing response >Thread-10269::DEBUG::2014-10-29 11:06:19,660::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:06:19,680::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-10269::DEBUG::2014-10-29 11:06:19,681::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000531344 s, 945 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:06:19,683::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:19,684::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:19,684::__init__::232::IOProcess::(_processLogs) (199367) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:19,686::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199367) Queuing response >Thread-33::DEBUG::2014-10-29 11:06:19,687::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:06:19,689::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:19,705::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:19,705::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:19,705::__init__::232::IOProcess::(_processLogs) (199368) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:19,708::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199368) Queuing response >Thread-33::DEBUG::2014-10-29 11:06:19,711::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000493467 s, 987 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:06:19,712::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:19,713::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:19,713::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:19,713::__init__::232::IOProcess::(_processLogs) (199369) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:19,715::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199369) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:19,716::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:19,717::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:19,718::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:19,718::__init__::232::IOProcess::(_processLogs) (199370) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:19,718::__init__::232::IOProcess::(_processLogs) (199370) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:19,719::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:19,719::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:19,719::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:19,720::__init__::232::IOProcess::(_processLogs) (199371) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:19,720::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199371) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:19,721::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:19,722::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:19,722::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:19,722::__init__::232::IOProcess::(_processLogs) (199372) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:19,723::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199372) Queuing response >Detector thread::DEBUG::2014-10-29 11:06:19,952::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53847 >Detector thread::DEBUG::2014-10-29 11:06:19,953::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53847 >Detector thread::DEBUG::2014-10-29 11:06:19,953::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53847 >Detector thread::DEBUG::2014-10-29 11:06:19,953::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53847) >Thread-135270::DEBUG::2014-10-29 11:06:19,992::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135270::DEBUG::2014-10-29 11:06:19,993::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135270::DEBUG::2014-10-29 11:06:19,994::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.06', 'elapsedTime': '513412', 'displayType': 'vnc', 'cpuSys': '0.80', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '297907754', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '212460', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '44842.84'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.97', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:06:20,666::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53849 >Detector thread::DEBUG::2014-10-29 11:06:20,666::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53849 >Detector thread::DEBUG::2014-10-29 11:06:20,667::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53849 >Detector thread::DEBUG::2014-10-29 11:06:20,667::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53849) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:20,687::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:20,689::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135272::DEBUG::2014-10-29 11:06:20,692::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:20,695::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:20,697::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135273::DEBUG::2014-10-29 11:06:20,699::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135273::DEBUG::2014-10-29 11:06:20,702::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-135271::DEBUG::2014-10-29 11:06:20,707::task::595::Storage.TaskManager.Task::(_updateState) Task=`75bcfb92-01f4-489f-9ccc-dfc8bc70fbbd`::moving from state init -> state preparing >Thread-135271::INFO::2014-10-29 11:06:20,707::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135271::INFO::2014-10-29 11:06:20,708::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000592148', 'lastCheck': '3.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493467', 'lastCheck': '1.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440107', 'lastCheck': '1.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000531344', 'lastCheck': '1.0', 'valid': True}} >Thread-135271::DEBUG::2014-10-29 11:06:20,709::task::1191::Storage.TaskManager.Task::(prepare) Task=`75bcfb92-01f4-489f-9ccc-dfc8bc70fbbd`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000592148', 'lastCheck': '3.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493467', 'lastCheck': '1.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440107', 'lastCheck': '1.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000531344', 'lastCheck': '1.0', 'valid': True}} >Thread-135271::DEBUG::2014-10-29 11:06:20,709::task::595::Storage.TaskManager.Task::(_updateState) Task=`75bcfb92-01f4-489f-9ccc-dfc8bc70fbbd`::moving from state preparing -> state finished >Thread-135271::DEBUG::2014-10-29 11:06:20,709::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135271::DEBUG::2014-10-29 11:06:20,709::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135271::DEBUG::2014-10-29 11:06:20,710::task::993::Storage.TaskManager.Task::(_decref) Task=`75bcfb92-01f4-489f-9ccc-dfc8bc70fbbd`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:23,622::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:23,624::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:23,625::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:23,716::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:23,718::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135274::DEBUG::2014-10-29 11:06:23,722::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:23,725::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:23,726::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135275::DEBUG::2014-10-29 11:06:23,729::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135275::DEBUG::2014-10-29 11:06:23,732::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:26,745::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:26,747::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135276::DEBUG::2014-10-29 11:06:26,750::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:26,752::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:26,754::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135277::DEBUG::2014-10-29 11:06:26,757::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135277::DEBUG::2014-10-29 11:06:26,759::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:06:27,575::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:27,576::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:27,576::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:27,576::__init__::232::IOProcess::(_processLogs) (199373) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:27,577::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199373) Queuing response >Thread-178::DEBUG::2014-10-29 11:06:27,579::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:06:27,597::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000481417 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:06:27,598::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:27,599::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:27,599::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:27,600::__init__::232::IOProcess::(_processLogs) (199374) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:27,602::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199374) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:27,604::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:27,604::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:27,605::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:27,606::__init__::232::IOProcess::(_processLogs) (199375) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:27,606::__init__::232::IOProcess::(_processLogs) (199375) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:27,606::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:27,607::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:27,608::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:27,608::__init__::232::IOProcess::(_processLogs) (199376) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:27,609::__init__::232::IOProcess::(_processLogs) (199376) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:27,609::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:27,609::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:27,610::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:27,610::__init__::232::IOProcess::(_processLogs) (199377) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:27,611::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199377) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:28,634::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:28,636::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:28,639::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:06:28,709::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53850 >Detector thread::DEBUG::2014-10-29 11:06:28,710::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53850 >Detector thread::DEBUG::2014-10-29 11:06:28,710::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53850 >Detector thread::DEBUG::2014-10-29 11:06:28,711::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53850) >Detector thread::DEBUG::2014-10-29 11:06:28,747::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53852 >Detector thread::DEBUG::2014-10-29 11:06:28,748::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53852 >Detector thread::DEBUG::2014-10-29 11:06:28,748::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53852 >Detector thread::DEBUG::2014-10-29 11:06:28,749::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53852) >Thread-135278::DEBUG::2014-10-29 11:06:28,751::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135278::DEBUG::2014-10-29 11:06:28,756::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135278::DEBUG::2014-10-29 11:06:28,774::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135279::DEBUG::2014-10-29 11:06:28,791::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135279::DEBUG::2014-10-29 11:06:28,795::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d1a0943-ae42-4451-ac53-370312ef3e80`::moving from state init -> state preparing >Thread-135279::INFO::2014-10-29 11:06:28,798::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135279::DEBUG::2014-10-29 11:06:28,817::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:06:28,821::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:28,823::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:28,825::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:28,826::__init__::232::IOProcess::(_processLogs) (199378) Got request for method 'glob' >Thread-135278::DEBUG::2014-10-29 11:06:28,850::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '55', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '55', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-179::DEBUG::2014-10-29 11:06:29,631::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 38dc6c98-2b6a-45c0-b765-c5ce685415f9 >Thread-17::DEBUG::2014-10-29 11:06:29,636::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:29,639::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:29,640::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:29,640::__init__::232::IOProcess::(_processLogs) (199379) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:06:29,641::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:29,641::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:29,641::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:29,641::__init__::232::IOProcess::(_processLogs) (199380) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:06:29,642::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:29,642::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:29,642::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:29,643::__init__::232::IOProcess::(_processLogs) (199381) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:06:29,643::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:29,643::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:29,643::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:29,644::__init__::232::IOProcess::(_processLogs) (199382) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:06:29,712::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:29,712::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:29,712::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:29,712::__init__::232::IOProcess::(_processLogs) (199383) Got request for method 'statvfs' >Thread-33::DEBUG::2014-10-29 11:06:29,724::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:06:29,729::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:29,729::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:29,730::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:29,731::__init__::232::IOProcess::(_processLogs) (199384) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:06:29,735::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:29,735::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:29,735::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:29,736::__init__::232::IOProcess::(_processLogs) (199385) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:06:29,736::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:29,736::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:29,737::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:29,737::__init__::232::IOProcess::(_processLogs) (199386) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:06:29,737::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:29,738::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:29,738::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:29,738::__init__::232::IOProcess::(_processLogs) (199387) Got request for method 'glob' >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:29,772::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:29,775::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135288::DEBUG::2014-10-29 11:06:29,778::task::595::Storage.TaskManager.Task::(_updateState) Task=`4820fd69-edd1-45e0-8549-6e0439b5608f`::moving from state init -> state preparing >Thread-135288::INFO::2014-10-29 11:06:29,779::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135288::INFO::2014-10-29 11:06:29,779::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481417', 'lastCheck': '2.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493467', 'lastCheck': '10.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440107', 'lastCheck': '10.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000531344', 'lastCheck': '10.1', 'valid': True}} >Thread-135288::DEBUG::2014-10-29 11:06:29,779::task::1191::Storage.TaskManager.Task::(prepare) Task=`4820fd69-edd1-45e0-8549-6e0439b5608f`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481417', 'lastCheck': '2.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493467', 'lastCheck': '10.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440107', 'lastCheck': '10.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000531344', 'lastCheck': '10.1', 'valid': True}} >Thread-135288::DEBUG::2014-10-29 11:06:29,780::task::595::Storage.TaskManager.Task::(_updateState) Task=`4820fd69-edd1-45e0-8549-6e0439b5608f`::moving from state preparing -> state finished >Thread-135288::DEBUG::2014-10-29 11:06:29,780::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135288::DEBUG::2014-10-29 11:06:29,780::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135288::DEBUG::2014-10-29 11:06:29,780::task::993::Storage.TaskManager.Task::(_decref) Task=`4820fd69-edd1-45e0-8549-6e0439b5608f`::ref 0 aborting False >Thread-135279::DEBUG::2014-10-29 11:06:29,789::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:06:29,789::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199378) Queuing response >Thread-135279::DEBUG::2014-10-29 11:06:29,791::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-17::DEBUG::2014-10-29 11:06:29,791::__init__::232::IOProcess::(_processLogs) (199379) Queuing response >Thread-135279::INFO::2014-10-29 11:06:29,792::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-17::DEBUG::2014-10-29 11:06:29,793::__init__::232::IOProcess::(_processLogs) (199380) Queuing response >Thread-135279::DEBUG::2014-10-29 11:06:29,794::task::1191::Storage.TaskManager.Task::(prepare) Task=`6d1a0943-ae42-4451-ac53-370312ef3e80`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-17::DEBUG::2014-10-29 11:06:29,795::__init__::232::IOProcess::(_processLogs) (199383) Queuing response >Thread-135279::DEBUG::2014-10-29 11:06:29,796::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d1a0943-ae42-4451-ac53-370312ef3e80`::moving from state preparing -> state finished >Thread-135279::DEBUG::2014-10-29 11:06:29,797::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17::DEBUG::2014-10-29 11:06:29,797::__init__::232::IOProcess::(_processLogs) (199381) Queuing response >Thread-135279::DEBUG::2014-10-29 11:06:29,799::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17::DEBUG::2014-10-29 11:06:29,799::__init__::232::IOProcess::(_processLogs) (199385) Queuing response >Thread-135279::DEBUG::2014-10-29 11:06:29,800::task::993::Storage.TaskManager.Task::(_decref) Task=`6d1a0943-ae42-4451-ac53-370312ef3e80`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:06:29,802::__init__::232::IOProcess::(_processLogs) (199387) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:29,804::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199382) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:29,810::__init__::232::IOProcess::(_processLogs) (199384) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:29,811::__init__::232::IOProcess::(_processLogs) (199386) Queuing response >Thread-10269::DEBUG::2014-10-29 11:06:29,819::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:06:29,860::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000717015 s, 700 kB/s\n'; <rc> = 0 >Detector thread::DEBUG::2014-10-29 11:06:29,868::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53853 >Detector thread::DEBUG::2014-10-29 11:06:29,881::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53853 >Detector thread::DEBUG::2014-10-29 11:06:29,890::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53853 >Thread-17::DEBUG::2014-10-29 11:06:29,892::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Detector thread::DEBUG::2014-10-29 11:06:29,898::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53853) >Thread-17::DEBUG::2014-10-29 11:06:29,902::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-179::DEBUG::2014-10-29 11:06:29,909::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9 >Thread-17::DEBUG::2014-10-29 11:06:29,910::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-33::DEBUG::2014-10-29 11:06:29,912::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:06:29,916::__init__::232::IOProcess::(_processLogs) (199388) Got request for method 'statvfs' >Thread-135289::DEBUG::2014-10-29 11:06:29,919::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135289::DEBUG::2014-10-29 11:06:29,924::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6398097-452c-4ba3-94d8-1c1df80fd801`::moving from state init -> state preparing >Thread-135289::INFO::2014-10-29 11:06:29,928::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-17::DEBUG::2014-10-29 11:06:29,931::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199388) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:29,936::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:29,937::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:29,939::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:29,940::__init__::232::IOProcess::(_processLogs) (199389) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:06:29,944::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199389) Queuing response >Thread-179::DEBUG::2014-10-29 11:06:29,945::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:06:29,947::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:29,949::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:29,951::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:29,952::__init__::232::IOProcess::(_processLogs) (199390) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:06:29,955::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199390) Queuing response >Thread-33::DEBUG::2014-10-29 11:06:29,956::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:06:29,960::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-135288::DEBUG::2014-10-29 11:06:29,960::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:06:29,962::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:29,965::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:29,966::__init__::232::IOProcess::(_processLogs) (199391) Got request for method 'readfile' >Thread-179::DEBUG::2014-10-29 11:06:29,966::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nsednev_rhevm_3_5_second_SD', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=00000002-0002-0002-0002-000000000321', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_rhevm_3_5_second_SD', 'ROLE=Regular', 'SDUUID=38dc6c98-2b6a-45c0-b765-c5ce685415f9', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ea5c54387b91bc1e37853d7501f0d1b2d7d233e7'] >Thread-17::DEBUG::2014-10-29 11:06:29,967::__init__::232::IOProcess::(_processLogs) (199391) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:29,970::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:29,970::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:29,971::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-33::DEBUG::2014-10-29 11:06:29,972::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:06:29,972::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199392) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:06:29,973::__init__::232::IOProcess::(_processLogs) (199392) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:29,975::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:29,976::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:29,976::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:29,976::__init__::232::IOProcess::(_processLogs) (199393) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:29,977::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199393) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:29,979::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:29,979::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:29,980::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:29,981::__init__::232::IOProcess::(_processLogs) (199394) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:29,981::__init__::232::IOProcess::(_processLogs) (199394) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:29,982::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:29,982::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:29,983::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:29,983::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:29,983::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:29,984::__init__::232::IOProcess::(_processLogs) (199395) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:06:29,984::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199395) Queuing response >Thread-179::DEBUG::2014-10-29 11:06:29,985::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:06:29,985::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-179::INFO::2014-10-29 11:06:29,986::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 38dc6c98-2b6a-45c0-b765-c5ce685415f9_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:06:29,987::__init__::232::IOProcess::(_processLogs) (199396) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:06:29,988::__init__::232::IOProcess::(_processLogs) (199396) Queuing response >Thread-179::INFO::2014-10-29 11:06:29,988::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 38dc6c98-2b6a-45c0-b765-c5ce685415f9_volumeNS already registered >Thread-33::DEBUG::2014-10-29 11:06:29,991::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-33::INFO::2014-10-29 11:06:29,992::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:06:29,992::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-33::INFO::2014-10-29 11:06:29,992::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:06:29,994::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-135289::INFO::2014-10-29 11:06:29,995::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:06:29,996::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:29,998::__init__::232::IOProcess::(_processLogs) (199397) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:29,999::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199397) Queuing response >Thread-179::DEBUG::2014-10-29 11:06:30,001::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:06:30,002::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:30,020::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:30,020::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:30,021::__init__::232::IOProcess::(_processLogs) (199398) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:30,022::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199398) Queuing response >Thread-33::DEBUG::2014-10-29 11:06:30,025::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:06:30,026::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:30,054::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-17::DEBUG::2014-10-29 11:06:30,054::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-179::DEBUG::2014-10-29 11:06:30,057::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000453551 s, 820 kB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-10-29 11:06:30,056::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00072406 s, 673 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:06:30,062::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:30,065::__init__::232::IOProcess::(_processLogs) (199399) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:06:30,066::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199399) Queuing response >JsonRpcServer::DEBUG::2014-10-29 11:06:30,067::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135289::DEBUG::2014-10-29 11:06:30,068::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:06:30,074::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:30,077::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:30,080::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:30,083::__init__::232::IOProcess::(_processLogs) (199400) Got request for method 'statvfs' >Thread-135290::DEBUG::2014-10-29 11:06:30,089::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135289::DEBUG::2014-10-29 11:06:30,089::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`8950c864-7372-4fa8-bda9-86791ac18b76`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135289::DEBUG::2014-10-29 11:06:30,091::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-17::DEBUG::2014-10-29 11:06:30,093::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199400) Queuing response >Thread-135289::DEBUG::2014-10-29 11:06:30,095::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135289::DEBUG::2014-10-29 11:06:30,098::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`8950c864-7372-4fa8-bda9-86791ac18b76`::Granted request >Thread-17::DEBUG::2014-10-29 11:06:30,100::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-135289::DEBUG::2014-10-29 11:06:30,102::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a6398097-452c-4ba3-94d8-1c1df80fd801`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-17::DEBUG::2014-10-29 11:06:30,103::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-135289::DEBUG::2014-10-29 11:06:30,104::task::993::Storage.TaskManager.Task::(_decref) Task=`a6398097-452c-4ba3-94d8-1c1df80fd801`::ref 1 aborting False >Thread-17::DEBUG::2014-10-29 11:06:30,107::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:30,109::__init__::232::IOProcess::(_processLogs) (199401) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:30,117::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199401) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:30,126::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-135289::INFO::2014-10-29 11:06:30,128::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135290::DEBUG::2014-10-29 11:06:30,130::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:06:30,130::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-135289::DEBUG::2014-10-29 11:06:30,132::task::1191::Storage.TaskManager.Task::(prepare) Task=`a6398097-452c-4ba3-94d8-1c1df80fd801`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-17::DEBUG::2014-10-29 11:06:30,134::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:30,136::__init__::232::IOProcess::(_processLogs) (199402) Got request for method 'access' >Thread-135289::DEBUG::2014-10-29 11:06:30,136::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6398097-452c-4ba3-94d8-1c1df80fd801`::moving from state preparing -> state finished >Thread-17::DEBUG::2014-10-29 11:06:30,138::__init__::232::IOProcess::(_processLogs) (199402) Queuing response >Thread-135289::DEBUG::2014-10-29 11:06:30,138::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135289::DEBUG::2014-10-29 11:06:30,141::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135289::DEBUG::2014-10-29 11:06:30,142::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135289::DEBUG::2014-10-29 11:06:30,142::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135289::DEBUG::2014-10-29 11:06:30,142::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135289::DEBUG::2014-10-29 11:06:30,142::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135289::DEBUG::2014-10-29 11:06:30,143::task::993::Storage.TaskManager.Task::(_decref) Task=`a6398097-452c-4ba3-94d8-1c1df80fd801`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:06:30,145::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:30,145::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:30,145::__init__::232::IOProcess::(_processLogs) Extracting request information... >Detector thread::DEBUG::2014-10-29 11:06:30,146::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53854 >Thread-17::DEBUG::2014-10-29 11:06:30,147::__init__::232::IOProcess::(_processLogs) (199403) Got request for method 'access' >Detector thread::DEBUG::2014-10-29 11:06:30,149::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53854 >Thread-17::DEBUG::2014-10-29 11:06:30,150::__init__::232::IOProcess::(_processLogs) (199403) Queuing response >Detector thread::DEBUG::2014-10-29 11:06:30,150::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53854 >Detector thread::DEBUG::2014-10-29 11:06:30,153::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53854) >Thread-17::DEBUG::2014-10-29 11:06:30,158::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:30,161::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:30,161::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:30,162::__init__::232::IOProcess::(_processLogs) (199404) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:30,163::__init__::232::IOProcess::(_processLogs) (199404) Queuing response >Detector thread::DEBUG::2014-10-29 11:06:30,170::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53855 >Detector thread::DEBUG::2014-10-29 11:06:30,171::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53855 >Detector thread::DEBUG::2014-10-29 11:06:30,171::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53855 >Detector thread::DEBUG::2014-10-29 11:06:30,172::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53855) >Thread-135291::DEBUG::2014-10-29 11:06:30,185::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135291::DEBUG::2014-10-29 11:06:30,186::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135291::DEBUG::2014-10-29 11:06:30,187::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.06', 'elapsedTime': '513422', 'displayType': 'vnc', 'cpuSys': '0.80', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '297907754', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '212460', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '44842.84'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.14', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-135292::DEBUG::2014-10-29 11:06:30,211::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135292::DEBUG::2014-10-29 11:06:30,212::task::595::Storage.TaskManager.Task::(_updateState) Task=`c11df5c6-2309-4432-a97e-bf0247c8a979`::moving from state init -> state preparing >Thread-135292::INFO::2014-10-29 11:06:30,212::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135292::INFO::2014-10-29 11:06:30,213::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481417', 'lastCheck': '2.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072406', 'lastCheck': '0.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000453551', 'lastCheck': '0.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000717015', 'lastCheck': '0.3', 'valid': True}} >Thread-135292::DEBUG::2014-10-29 11:06:30,213::task::1191::Storage.TaskManager.Task::(prepare) Task=`c11df5c6-2309-4432-a97e-bf0247c8a979`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481417', 'lastCheck': '2.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072406', 'lastCheck': '0.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000453551', 'lastCheck': '0.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000717015', 'lastCheck': '0.3', 'valid': True}} >Thread-135292::DEBUG::2014-10-29 11:06:30,213::task::595::Storage.TaskManager.Task::(_updateState) Task=`c11df5c6-2309-4432-a97e-bf0247c8a979`::moving from state preparing -> state finished >Thread-135292::DEBUG::2014-10-29 11:06:30,214::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135292::DEBUG::2014-10-29 11:06:30,214::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135292::DEBUG::2014-10-29 11:06:30,214::task::993::Storage.TaskManager.Task::(_decref) Task=`c11df5c6-2309-4432-a97e-bf0247c8a979`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:06:30,776::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53857 >Detector thread::DEBUG::2014-10-29 11:06:30,776::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53857 >Detector thread::DEBUG::2014-10-29 11:06:30,777::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53857 >Detector thread::DEBUG::2014-10-29 11:06:30,777::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53857) >Thread-135293::DEBUG::2014-10-29 11:06:30,817::task::595::Storage.TaskManager.Task::(_updateState) Task=`86af561a-c6b6-4325-aff0-1fbce2690860`::moving from state init -> state preparing >Thread-135293::INFO::2014-10-29 11:06:30,817::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135293::INFO::2014-10-29 11:06:30,818::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481417', 'lastCheck': '3.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072406', 'lastCheck': '0.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000453551', 'lastCheck': '0.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000717015', 'lastCheck': '0.9', 'valid': True}} >Thread-135293::DEBUG::2014-10-29 11:06:30,818::task::1191::Storage.TaskManager.Task::(prepare) Task=`86af561a-c6b6-4325-aff0-1fbce2690860`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481417', 'lastCheck': '3.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072406', 'lastCheck': '0.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000453551', 'lastCheck': '0.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000717015', 'lastCheck': '0.9', 'valid': True}} >Thread-135293::DEBUG::2014-10-29 11:06:30,818::task::595::Storage.TaskManager.Task::(_updateState) Task=`86af561a-c6b6-4325-aff0-1fbce2690860`::moving from state preparing -> state finished >Thread-135293::DEBUG::2014-10-29 11:06:30,818::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135293::DEBUG::2014-10-29 11:06:30,819::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135293::DEBUG::2014-10-29 11:06:30,819::task::993::Storage.TaskManager.Task::(_decref) Task=`86af561a-c6b6-4325-aff0-1fbce2690860`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:06:31,083::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >VM Channels Listener::DEBUG::2014-10-29 11:06:33,110::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:33,208::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:33,210::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135294::DEBUG::2014-10-29 11:06:33,214::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:33,216::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:33,218::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135295::DEBUG::2014-10-29 11:06:33,221::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135295::DEBUG::2014-10-29 11:06:33,224::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:33,645::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:33,647::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:33,648::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:36,245::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:36,247::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135296::DEBUG::2014-10-29 11:06:36,250::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:36,251::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:36,253::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135297::DEBUG::2014-10-29 11:06:36,256::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135297::DEBUG::2014-10-29 11:06:36,258::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:06:37,614::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:37,615::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:37,616::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:37,616::__init__::232::IOProcess::(_processLogs) (199405) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:37,616::__init__::232::IOProcess::(_processLogs) (199405) Queuing response >Thread-178::DEBUG::2014-10-29 11:06:37,617::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:06:37,635::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000599288 s, 848 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:06:37,637::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:37,637::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:37,637::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:37,638::__init__::232::IOProcess::(_processLogs) (199406) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:37,639::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199406) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:37,641::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:37,642::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:37,643::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:37,643::__init__::232::IOProcess::(_processLogs) (199407) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:37,643::__init__::232::IOProcess::(_processLogs) (199407) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:37,644::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:37,644::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:37,645::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:37,645::__init__::232::IOProcess::(_processLogs) (199408) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:37,646::__init__::232::IOProcess::(_processLogs) (199408) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:37,646::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:37,647::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:37,647::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:37,649::__init__::232::IOProcess::(_processLogs) (199409) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:37,649::__init__::232::IOProcess::(_processLogs) (199409) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:38,655::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:38,656::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:38,658::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:06:38,890::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53858 >Detector thread::DEBUG::2014-10-29 11:06:38,891::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53858 >Detector thread::DEBUG::2014-10-29 11:06:38,891::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53858 >Detector thread::DEBUG::2014-10-29 11:06:38,892::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53858) >Thread-135298::DEBUG::2014-10-29 11:06:38,930::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135298::DEBUG::2014-10-29 11:06:38,932::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135298::DEBUG::2014-10-29 11:06:38,949::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135298::DEBUG::2014-10-29 11:06:38,998::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '41', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '41', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:39,274::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:39,277::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135299::DEBUG::2014-10-29 11:06:39,281::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:39,283::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:39,285::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135300::DEBUG::2014-10-29 11:06:39,288::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135300::DEBUG::2014-10-29 11:06:39,291::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:06:39,338::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53859 >Detector thread::DEBUG::2014-10-29 11:06:39,338::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53859 >Detector thread::DEBUG::2014-10-29 11:06:39,338::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53859 >Detector thread::DEBUG::2014-10-29 11:06:39,339::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53859) >Thread-135301::DEBUG::2014-10-29 11:06:39,378::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135301::DEBUG::2014-10-29 11:06:39,379::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135301::DEBUG::2014-10-29 11:06:39,379::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.31', 'elapsedTime': '513431', 'displayType': 'vnc', 'cpuSys': '1.06', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '297907754', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '212460', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '44842.84'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.29', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-17::DEBUG::2014-10-29 11:06:39,935::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:39,936::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:39,936::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:39,936::__init__::232::IOProcess::(_processLogs) (199410) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:39,938::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199410) Queuing response >Thread-10269::DEBUG::2014-10-29 11:06:39,939::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:06:39,958::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000485755 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:06:39,960::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:39,960::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:39,961::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:39,961::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199411) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:39,963::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199411) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:40,098::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:40,098::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:40,100::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-179::DEBUG::2014-10-29 11:06:40,101::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:06:40,101::__init__::232::IOProcess::(_processLogs) (199412) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:40,121::__init__::232::IOProcess::(_processLogs) (199412) Queuing response >Thread-179::DEBUG::2014-10-29 11:06:40,122::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00171049 s, 217 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:06:40,124::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:40,124::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:40,126::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:40,127::__init__::232::IOProcess::(_processLogs) (199413) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:40,127::__init__::232::IOProcess::(_processLogs) (199413) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:40,164::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:40,164::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:40,165::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:40,165::__init__::232::IOProcess::(_processLogs) (199414) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:40,166::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199414) Queuing response >Thread-33::DEBUG::2014-10-29 11:06:40,168::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:06:40,184::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000542405 s, 898 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:06:40,186::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:40,186::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:40,186::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:40,187::__init__::232::IOProcess::(_processLogs) (199415) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:40,189::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199415) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:40,190::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:40,191::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:40,191::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:40,192::__init__::232::IOProcess::(_processLogs) (199416) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:40,192::__init__::232::IOProcess::(_processLogs) (199416) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:40,193::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:40,193::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:40,194::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:40,195::__init__::232::IOProcess::(_processLogs) (199417) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:40,195::__init__::232::IOProcess::(_processLogs) (199417) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:40,196::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:40,197::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:40,197::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:40,198::__init__::232::IOProcess::(_processLogs) (199418) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:40,199::__init__::232::IOProcess::(_processLogs) (199418) Queuing response >Detector thread::DEBUG::2014-10-29 11:06:40,686::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53862 >Detector thread::DEBUG::2014-10-29 11:06:40,686::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53862 >Detector thread::DEBUG::2014-10-29 11:06:40,687::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53862 >Detector thread::DEBUG::2014-10-29 11:06:40,688::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53862) >Thread-135302::DEBUG::2014-10-29 11:06:40,727::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135302::DEBUG::2014-10-29 11:06:40,728::task::595::Storage.TaskManager.Task::(_updateState) Task=`77eab601-089e-46ca-84c7-b29651675381`::moving from state init -> state preparing >Thread-135302::INFO::2014-10-29 11:06:40,728::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135302::DEBUG::2014-10-29 11:06:40,731::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:06:40,732::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:40,733::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-135302::DEBUG::2014-10-29 11:06:40,734::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:06:40,734::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-135302::DEBUG::2014-10-29 11:06:40,736::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-17::DEBUG::2014-10-29 11:06:40,736::__init__::232::IOProcess::(_processLogs) (199419) Got request for method 'glob' >Thread-135302::INFO::2014-10-29 11:06:40,738::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-17::DEBUG::2014-10-29 11:06:40,739::__init__::232::IOProcess::(_processLogs) (199419) Queuing response >Thread-135302::DEBUG::2014-10-29 11:06:40,740::task::1191::Storage.TaskManager.Task::(prepare) Task=`77eab601-089e-46ca-84c7-b29651675381`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135302::DEBUG::2014-10-29 11:06:40,741::task::595::Storage.TaskManager.Task::(_updateState) Task=`77eab601-089e-46ca-84c7-b29651675381`::moving from state preparing -> state finished >Thread-135302::DEBUG::2014-10-29 11:06:40,741::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135302::DEBUG::2014-10-29 11:06:40,741::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135302::DEBUG::2014-10-29 11:06:40,741::task::993::Storage.TaskManager.Task::(_decref) Task=`77eab601-089e-46ca-84c7-b29651675381`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:06:40,785::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53863 >Detector thread::DEBUG::2014-10-29 11:06:40,786::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53863 >Detector thread::DEBUG::2014-10-29 11:06:40,786::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53863 >Detector thread::DEBUG::2014-10-29 11:06:40,786::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53863) >Thread-135303::DEBUG::2014-10-29 11:06:40,825::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135303::DEBUG::2014-10-29 11:06:40,825::task::595::Storage.TaskManager.Task::(_updateState) Task=`69c84f00-76b1-4408-94f1-1cb7801126c2`::moving from state init -> state preparing >Thread-135303::INFO::2014-10-29 11:06:40,826::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135303::DEBUG::2014-10-29 11:06:40,826::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135303::DEBUG::2014-10-29 11:06:40,827::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135303::DEBUG::2014-10-29 11:06:40,827::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135303::DEBUG::2014-10-29 11:06:40,827::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135303::DEBUG::2014-10-29 11:06:40,828::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135303::DEBUG::2014-10-29 11:06:40,828::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Detector thread::DEBUG::2014-10-29 11:06:40,885::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53864 >Detector thread::DEBUG::2014-10-29 11:06:40,886::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53864 >Detector thread::DEBUG::2014-10-29 11:06:40,886::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53864 >Detector thread::DEBUG::2014-10-29 11:06:40,887::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53864) >Thread-135303::DEBUG::2014-10-29 11:06:40,908::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135303::DEBUG::2014-10-29 11:06:40,909::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135304::DEBUG::2014-10-29 11:06:40,928::task::595::Storage.TaskManager.Task::(_updateState) Task=`a67c3657-bd69-41df-b0f1-06bd4f8f2466`::moving from state init -> state preparing >Thread-135304::INFO::2014-10-29 11:06:40,929::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135304::INFO::2014-10-29 11:06:40,930::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599288', 'lastCheck': '3.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000542405', 'lastCheck': '0.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00171049', 'lastCheck': '0.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000485755', 'lastCheck': '1.0', 'valid': True}} >Thread-135304::DEBUG::2014-10-29 11:06:40,930::task::1191::Storage.TaskManager.Task::(prepare) Task=`a67c3657-bd69-41df-b0f1-06bd4f8f2466`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599288', 'lastCheck': '3.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000542405', 'lastCheck': '0.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00171049', 'lastCheck': '0.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000485755', 'lastCheck': '1.0', 'valid': True}} >Thread-135304::DEBUG::2014-10-29 11:06:40,930::task::595::Storage.TaskManager.Task::(_updateState) Task=`a67c3657-bd69-41df-b0f1-06bd4f8f2466`::moving from state preparing -> state finished >Thread-135304::DEBUG::2014-10-29 11:06:40,931::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135304::DEBUG::2014-10-29 11:06:40,931::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135304::DEBUG::2014-10-29 11:06:40,931::task::993::Storage.TaskManager.Task::(_decref) Task=`a67c3657-bd69-41df-b0f1-06bd4f8f2466`::ref 0 aborting False >Thread-135303::DEBUG::2014-10-29 11:06:41,093::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135303::DEBUG::2014-10-29 11:06:41,094::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135303::DEBUG::2014-10-29 11:06:41,094::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135303::DEBUG::2014-10-29 11:06:41,095::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135303::DEBUG::2014-10-29 11:06:41,095::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135303::DEBUG::2014-10-29 11:06:41,095::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135303::DEBUG::2014-10-29 11:06:41,096::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135303::DEBUG::2014-10-29 11:06:41,096::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:06:41,102::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:41,105::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:41,106::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:41,106::__init__::232::IOProcess::(_processLogs) (199420) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:06:41,107::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199420) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:41,108::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:41,108::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:41,109::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:41,110::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:41,111::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:41,113::__init__::232::IOProcess::(_processLogs) (199421) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:06:41,116::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:41,117::__init__::232::IOProcess::(_processLogs) (199422) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:06:41,119::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:41,121::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-135303::DEBUG::2014-10-29 11:06:41,123::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:06:41,123::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:41,125::__init__::232::IOProcess::(_processLogs) (199423) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:06:41,125::__init__::232::IOProcess::(_processLogs) (199421) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:41,125::__init__::232::IOProcess::(_processLogs) (199422) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:41,125::__init__::232::IOProcess::(_processLogs) (199423) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:41,128::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:41,128::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:41,128::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:41,129::__init__::232::IOProcess::(_processLogs) (199424) Got request for method 'touch' >Thread-135303::DEBUG::2014-10-29 11:06:41,131::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:06:41,131::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199424) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:41,133::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:41,133::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:41,134::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:41,134::__init__::232::IOProcess::(_processLogs) (199425) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:06:41,135::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199425) Queuing response >Thread-135303::DEBUG::2014-10-29 11:06:41,135::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:06:41,137::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:41,138::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:41,139::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:41,139::__init__::232::IOProcess::(_processLogs) (199426) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:41,139::__init__::232::IOProcess::(_processLogs) (199426) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:41,140::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:41,140::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:41,140::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:41,141::__init__::232::IOProcess::(_processLogs) (199427) Got request for method 'glob' >Thread-135303::DEBUG::2014-10-29 11:06:41,141::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:06:41,142::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199427) Queuing response >Thread-135303::INFO::2014-10-29 11:06:41,143::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135303::INFO::2014-10-29 11:06:41,143::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135303::INFO::2014-10-29 11:06:41,144::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:06:41,145::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:41,145::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:41,145::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:41,145::__init__::232::IOProcess::(_processLogs) (199428) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:06:41,146::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199428) Queuing response >Thread-135303::DEBUG::2014-10-29 11:06:41,147::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135303::DEBUG::2014-10-29 11:06:41,149::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`876f1513-5883-4cd6-99be-66178f90f107`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135303::DEBUG::2014-10-29 11:06:41,149::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135303::DEBUG::2014-10-29 11:06:41,149::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135303::DEBUG::2014-10-29 11:06:41,150::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`876f1513-5883-4cd6-99be-66178f90f107`::Granted request >Thread-135303::DEBUG::2014-10-29 11:06:41,150::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`69c84f00-76b1-4408-94f1-1cb7801126c2`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135303::DEBUG::2014-10-29 11:06:41,151::task::993::Storage.TaskManager.Task::(_decref) Task=`69c84f00-76b1-4408-94f1-1cb7801126c2`::ref 1 aborting False >Thread-135303::INFO::2014-10-29 11:06:41,153::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135303::DEBUG::2014-10-29 11:06:41,154::task::1191::Storage.TaskManager.Task::(prepare) Task=`69c84f00-76b1-4408-94f1-1cb7801126c2`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135303::DEBUG::2014-10-29 11:06:41,154::task::595::Storage.TaskManager.Task::(_updateState) Task=`69c84f00-76b1-4408-94f1-1cb7801126c2`::moving from state preparing -> state finished >Thread-135303::DEBUG::2014-10-29 11:06:41,154::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135303::DEBUG::2014-10-29 11:06:41,154::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135303::DEBUG::2014-10-29 11:06:41,155::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135303::DEBUG::2014-10-29 11:06:41,155::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135303::DEBUG::2014-10-29 11:06:41,155::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135303::DEBUG::2014-10-29 11:06:41,156::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135303::DEBUG::2014-10-29 11:06:41,156::task::993::Storage.TaskManager.Task::(_decref) Task=`69c84f00-76b1-4408-94f1-1cb7801126c2`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:06:41,178::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53865 >Detector thread::DEBUG::2014-10-29 11:06:41,179::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53865 >Detector thread::DEBUG::2014-10-29 11:06:41,179::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53865 >Detector thread::DEBUG::2014-10-29 11:06:41,179::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53865) >Thread-135309::DEBUG::2014-10-29 11:06:41,218::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135309::DEBUG::2014-10-29 11:06:41,218::task::595::Storage.TaskManager.Task::(_updateState) Task=`f37dd4b8-b05a-4e37-919a-e8e81868247a`::moving from state init -> state preparing >Thread-135309::INFO::2014-10-29 11:06:41,219::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135309::INFO::2014-10-29 11:06:41,219::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599288', 'lastCheck': '3.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000542405', 'lastCheck': '1.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00171049', 'lastCheck': '1.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000485755', 'lastCheck': '1.3', 'valid': True}} >Thread-135309::DEBUG::2014-10-29 11:06:41,219::task::1191::Storage.TaskManager.Task::(prepare) Task=`f37dd4b8-b05a-4e37-919a-e8e81868247a`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599288', 'lastCheck': '3.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000542405', 'lastCheck': '1.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00171049', 'lastCheck': '1.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000485755', 'lastCheck': '1.3', 'valid': True}} >Thread-135309::DEBUG::2014-10-29 11:06:41,220::task::595::Storage.TaskManager.Task::(_updateState) Task=`f37dd4b8-b05a-4e37-919a-e8e81868247a`::moving from state preparing -> state finished >Thread-135309::DEBUG::2014-10-29 11:06:41,220::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135309::DEBUG::2014-10-29 11:06:41,220::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135309::DEBUG::2014-10-29 11:06:41,220::task::993::Storage.TaskManager.Task::(_decref) Task=`f37dd4b8-b05a-4e37-919a-e8e81868247a`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:42,303::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:42,306::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135310::DEBUG::2014-10-29 11:06:42,309::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:42,311::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:42,313::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135311::DEBUG::2014-10-29 11:06:42,316::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135311::DEBUG::2014-10-29 11:06:42,318::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:43,660::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:43,662::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:43,664::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:45,331::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:45,336::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135312::DEBUG::2014-10-29 11:06:45,341::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a8673bb-20bb-4114-acc7-d10d3258f18f`::moving from state init -> state preparing >Thread-135312::INFO::2014-10-29 11:06:45,342::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135312::INFO::2014-10-29 11:06:45,342::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599288', 'lastCheck': '7.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000542405', 'lastCheck': '5.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00171049', 'lastCheck': '5.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000485755', 'lastCheck': '5.4', 'valid': True}} >Thread-135312::DEBUG::2014-10-29 11:06:45,343::task::1191::Storage.TaskManager.Task::(prepare) Task=`2a8673bb-20bb-4114-acc7-d10d3258f18f`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000599288', 'lastCheck': '7.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000542405', 'lastCheck': '5.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00171049', 'lastCheck': '5.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000485755', 'lastCheck': '5.4', 'valid': True}} >Thread-135312::DEBUG::2014-10-29 11:06:45,343::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a8673bb-20bb-4114-acc7-d10d3258f18f`::moving from state preparing -> state finished >Thread-135312::DEBUG::2014-10-29 11:06:45,343::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135312::DEBUG::2014-10-29 11:06:45,343::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135312::DEBUG::2014-10-29 11:06:45,344::task::993::Storage.TaskManager.Task::(_decref) Task=`2a8673bb-20bb-4114-acc7-d10d3258f18f`::ref 0 aborting False >Thread-135312::DEBUG::2014-10-29 11:06:45,367::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:45,390::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:45,392::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135313::DEBUG::2014-10-29 11:06:45,395::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135313::DEBUG::2014-10-29 11:06:45,398::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:06:46,088::task::595::Storage.TaskManager.Task::(_updateState) Task=`d65d24a8-a907-42f0-bcc2-2ff23941239d`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:06:46,090::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:06:46,094::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:46,096::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:46,097::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:46,099::__init__::232::IOProcess::(_processLogs) (199429) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:06:46,105::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199429) Queuing response >Thread-22::INFO::2014-10-29 11:06:46,112::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010855424', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:06:46,112::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-22::DEBUG::2014-10-29 11:06:46,113::task::1191::Storage.TaskManager.Task::(prepare) Task=`d65d24a8-a907-42f0-bcc2-2ff23941239d`::finished: {'truesize': '6010855424', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:06:46,115::task::595::Storage.TaskManager.Task::(_updateState) Task=`d65d24a8-a907-42f0-bcc2-2ff23941239d`::moving from state preparing -> state finished >Thread-17::DEBUG::2014-10-29 11:06:46,116::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-22::DEBUG::2014-10-29 11:06:46,116::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-10-29 11:06:46,118::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17::DEBUG::2014-10-29 11:06:46,119::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-22::DEBUG::2014-10-29 11:06:46,120::task::993::Storage.TaskManager.Task::(_decref) Task=`d65d24a8-a907-42f0-bcc2-2ff23941239d`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:06:46,121::__init__::232::IOProcess::(_processLogs) (199430) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:06:46,122::__init__::232::IOProcess::(_processLogs) (199430) Queuing response >Thread-22::DEBUG::2014-10-29 11:06:46,196::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-17::DEBUG::2014-10-29 11:06:47,650::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:47,652::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:47,654::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-178::DEBUG::2014-10-29 11:06:47,654::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:06:47,655::__init__::232::IOProcess::(_processLogs) (199431) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:47,672::__init__::232::IOProcess::(_processLogs) (199431) Queuing response >Thread-178::DEBUG::2014-10-29 11:06:47,674::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000546951 s, 929 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:06:47,676::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:47,676::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:47,676::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:47,676::__init__::232::IOProcess::(_processLogs) (199432) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:47,678::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199432) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:47,680::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:47,680::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:47,681::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:47,682::__init__::232::IOProcess::(_processLogs) (199433) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:47,682::__init__::232::IOProcess::(_processLogs) (199433) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:47,682::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:47,683::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:47,684::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:47,684::__init__::232::IOProcess::(_processLogs) (199434) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:47,685::__init__::232::IOProcess::(_processLogs) (199434) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:47,685::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:47,685::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:47,686::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:47,686::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199435) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:47,687::__init__::232::IOProcess::(_processLogs) (199435) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:48,443::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:48,445::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135314::DEBUG::2014-10-29 11:06:48,449::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:48,451::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:48,453::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135315::DEBUG::2014-10-29 11:06:48,456::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135315::DEBUG::2014-10-29 11:06:48,458::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:48,669::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:48,670::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:48,672::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:06:49,071::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53866 >Detector thread::DEBUG::2014-10-29 11:06:49,071::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53866 >Detector thread::DEBUG::2014-10-29 11:06:49,072::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53866 >Detector thread::DEBUG::2014-10-29 11:06:49,073::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53866) >Thread-135316::DEBUG::2014-10-29 11:06:49,111::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135316::DEBUG::2014-10-29 11:06:49,112::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135316::DEBUG::2014-10-29 11:06:49,130::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135316::DEBUG::2014-10-29 11:06:49,177::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '23', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '23', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:06:49,531::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53867 >Detector thread::DEBUG::2014-10-29 11:06:49,532::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53867 >Detector thread::DEBUG::2014-10-29 11:06:49,532::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53867 >Detector thread::DEBUG::2014-10-29 11:06:49,532::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53867) >Thread-135317::DEBUG::2014-10-29 11:06:49,571::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135317::DEBUG::2014-10-29 11:06:49,572::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135317::DEBUG::2014-10-29 11:06:49,573::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.06', 'elapsedTime': '513442', 'displayType': 'vnc', 'cpuSys': '0.46', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '8933396', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '74122', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '33330.98'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.37', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-17::DEBUG::2014-10-29 11:06:49,966::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:49,967::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:49,967::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:49,967::__init__::232::IOProcess::(_processLogs) (199436) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:49,969::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199436) Queuing response >Thread-10269::DEBUG::2014-10-29 11:06:49,970::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:06:49,990::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000875699 s, 573 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:06:49,992::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:49,993::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:49,993::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:49,993::__init__::232::IOProcess::(_processLogs) (199437) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:49,995::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199437) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:50,129::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:50,130::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:50,130::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:50,131::__init__::232::IOProcess::(_processLogs) (199438) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:50,132::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199438) Queuing response >Thread-179::DEBUG::2014-10-29 11:06:50,134::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:06:50,150::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00043364 s, 858 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:06:50,152::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:50,153::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:50,153::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:50,153::__init__::232::IOProcess::(_processLogs) (199439) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:50,155::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199439) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:50,200::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:50,200::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:50,200::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:50,201::__init__::232::IOProcess::(_processLogs) (199440) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:50,202::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199440) Queuing response >Thread-33::DEBUG::2014-10-29 11:06:50,203::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:06:50,221::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000502102 s, 970 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:06:50,223::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:50,223::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:50,224::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:50,224::__init__::232::IOProcess::(_processLogs) (199441) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:50,226::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199441) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:50,227::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:50,227::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:50,228::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:50,229::__init__::232::IOProcess::(_processLogs) (199442) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:50,229::__init__::232::IOProcess::(_processLogs) (199442) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:50,229::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:50,230::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:50,231::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:50,231::__init__::232::IOProcess::(_processLogs) (199443) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:50,231::__init__::232::IOProcess::(_processLogs) (199443) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:50,232::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:50,232::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:50,233::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:50,233::__init__::232::IOProcess::(_processLogs) (199444) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:50,234::__init__::232::IOProcess::(_processLogs) (199444) Queuing response >Detector thread::DEBUG::2014-10-29 11:06:50,990::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53869 >Detector thread::DEBUG::2014-10-29 11:06:50,991::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53869 >Detector thread::DEBUG::2014-10-29 11:06:50,991::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53869 >Detector thread::DEBUG::2014-10-29 11:06:50,992::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53869) >Thread-135318::DEBUG::2014-10-29 11:06:51,031::task::595::Storage.TaskManager.Task::(_updateState) Task=`7de66095-30d9-4301-a9fc-8823b5e30269`::moving from state init -> state preparing >Thread-135318::INFO::2014-10-29 11:06:51,032::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135318::INFO::2014-10-29 11:06:51,032::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000546951', 'lastCheck': '3.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502102', 'lastCheck': '0.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043364', 'lastCheck': '0.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000875699', 'lastCheck': '1.0', 'valid': True}} >Thread-135318::DEBUG::2014-10-29 11:06:51,033::task::1191::Storage.TaskManager.Task::(prepare) Task=`7de66095-30d9-4301-a9fc-8823b5e30269`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000546951', 'lastCheck': '3.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502102', 'lastCheck': '0.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043364', 'lastCheck': '0.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000875699', 'lastCheck': '1.0', 'valid': True}} >Thread-135318::DEBUG::2014-10-29 11:06:51,033::task::595::Storage.TaskManager.Task::(_updateState) Task=`7de66095-30d9-4301-a9fc-8823b5e30269`::moving from state preparing -> state finished >Thread-135318::DEBUG::2014-10-29 11:06:51,033::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135318::DEBUG::2014-10-29 11:06:51,033::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135318::DEBUG::2014-10-29 11:06:51,034::task::993::Storage.TaskManager.Task::(_decref) Task=`7de66095-30d9-4301-a9fc-8823b5e30269`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:51,478::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:51,481::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135319::DEBUG::2014-10-29 11:06:51,484::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:51,486::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:51,488::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135320::DEBUG::2014-10-29 11:06:51,492::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135320::DEBUG::2014-10-29 11:06:51,495::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:06:51,828::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53871 >Detector thread::DEBUG::2014-10-29 11:06:51,828::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53871 >Detector thread::DEBUG::2014-10-29 11:06:51,829::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53871 >Detector thread::DEBUG::2014-10-29 11:06:51,830::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53871) >Thread-135321::DEBUG::2014-10-29 11:06:51,869::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135321::DEBUG::2014-10-29 11:06:51,869::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d380cab-788c-4bdb-b9f1-29b02277f101`::moving from state init -> state preparing >Thread-135321::INFO::2014-10-29 11:06:51,870::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135321::DEBUG::2014-10-29 11:06:51,872::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:06:51,873::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:51,874::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:51,874::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:51,874::__init__::232::IOProcess::(_processLogs) (199445) Got request for method 'glob' >Thread-135321::DEBUG::2014-10-29 11:06:51,875::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:06:51,875::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199445) Queuing response >Thread-135321::DEBUG::2014-10-29 11:06:51,876::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135321::INFO::2014-10-29 11:06:51,877::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135321::DEBUG::2014-10-29 11:06:51,877::task::1191::Storage.TaskManager.Task::(prepare) Task=`2d380cab-788c-4bdb-b9f1-29b02277f101`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135321::DEBUG::2014-10-29 11:06:51,878::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d380cab-788c-4bdb-b9f1-29b02277f101`::moving from state preparing -> state finished >Thread-135321::DEBUG::2014-10-29 11:06:51,878::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135321::DEBUG::2014-10-29 11:06:51,878::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135321::DEBUG::2014-10-29 11:06:51,878::task::993::Storage.TaskManager.Task::(_decref) Task=`2d380cab-788c-4bdb-b9f1-29b02277f101`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:06:51,922::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53872 >Detector thread::DEBUG::2014-10-29 11:06:51,922::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53872 >Detector thread::DEBUG::2014-10-29 11:06:51,923::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53872 >Detector thread::DEBUG::2014-10-29 11:06:51,923::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53872) >Thread-135322::DEBUG::2014-10-29 11:06:51,962::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135322::DEBUG::2014-10-29 11:06:51,963::task::595::Storage.TaskManager.Task::(_updateState) Task=`263d81f4-481f-4a52-b13d-3b305cfab640`::moving from state init -> state preparing >Thread-135322::INFO::2014-10-29 11:06:51,963::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135322::DEBUG::2014-10-29 11:06:51,963::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135322::DEBUG::2014-10-29 11:06:51,964::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135322::DEBUG::2014-10-29 11:06:51,964::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135322::DEBUG::2014-10-29 11:06:51,964::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135322::DEBUG::2014-10-29 11:06:51,964::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135322::DEBUG::2014-10-29 11:06:51,965::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135322::DEBUG::2014-10-29 11:06:52,057::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135322::DEBUG::2014-10-29 11:06:52,058::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135322::DEBUG::2014-10-29 11:06:52,227::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135322::DEBUG::2014-10-29 11:06:52,229::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135322::DEBUG::2014-10-29 11:06:52,230::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135322::DEBUG::2014-10-29 11:06:52,230::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135322::DEBUG::2014-10-29 11:06:52,230::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135322::DEBUG::2014-10-29 11:06:52,231::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135322::DEBUG::2014-10-29 11:06:52,231::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135322::DEBUG::2014-10-29 11:06:52,231::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:06:52,239::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:52,241::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:52,242::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:52,242::__init__::232::IOProcess::(_processLogs) (199446) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:06:52,243::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199446) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:52,244::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:52,245::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:52,245::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:52,245::__init__::232::IOProcess::(_processLogs) (199447) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:06:52,246::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199447) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:52,249::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:52,250::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:52,253::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:52,255::__init__::232::IOProcess::(_processLogs) (199448) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:06:52,257::__init__::232::IOProcess::(_processLogs) (199448) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:52,260::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-135322::DEBUG::2014-10-29 11:06:52,261::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:06:52,261::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:52,264::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:52,265::__init__::232::IOProcess::(_processLogs) (199449) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:06:52,265::__init__::232::IOProcess::(_processLogs) (199449) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:52,266::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:52,266::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:52,266::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:52,266::__init__::232::IOProcess::(_processLogs) (199450) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:06:52,268::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199450) Queuing response >Thread-135322::DEBUG::2014-10-29 11:06:52,269::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:06:52,270::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:52,270::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:52,271::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:52,271::__init__::232::IOProcess::(_processLogs) (199451) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:06:52,272::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199451) Queuing response >Thread-135322::DEBUG::2014-10-29 11:06:52,272::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:06:52,274::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:52,275::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:52,276::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:52,276::__init__::232::IOProcess::(_processLogs) (199452) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:52,276::__init__::232::IOProcess::(_processLogs) (199452) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:52,277::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:52,277::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:52,277::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:52,278::__init__::232::IOProcess::(_processLogs) (199453) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:06:52,278::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199453) Queuing response >Thread-135322::DEBUG::2014-10-29 11:06:52,278::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-135322::INFO::2014-10-29 11:06:52,280::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135322::INFO::2014-10-29 11:06:52,280::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135322::INFO::2014-10-29 11:06:52,280::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:06:52,281::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:52,281::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:52,282::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:52,282::__init__::232::IOProcess::(_processLogs) (199454) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:06:52,284::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199454) Queuing response >Thread-135322::DEBUG::2014-10-29 11:06:52,285::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135322::DEBUG::2014-10-29 11:06:52,286::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`c31813a7-ce25-4b20-8dd1-cf0251c1b791`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135322::DEBUG::2014-10-29 11:06:52,286::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135322::DEBUG::2014-10-29 11:06:52,287::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135322::DEBUG::2014-10-29 11:06:52,287::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`c31813a7-ce25-4b20-8dd1-cf0251c1b791`::Granted request >Thread-135322::DEBUG::2014-10-29 11:06:52,288::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`263d81f4-481f-4a52-b13d-3b305cfab640`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135322::DEBUG::2014-10-29 11:06:52,288::task::993::Storage.TaskManager.Task::(_decref) Task=`263d81f4-481f-4a52-b13d-3b305cfab640`::ref 1 aborting False >Thread-135322::INFO::2014-10-29 11:06:52,291::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135322::DEBUG::2014-10-29 11:06:52,291::task::1191::Storage.TaskManager.Task::(prepare) Task=`263d81f4-481f-4a52-b13d-3b305cfab640`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135322::DEBUG::2014-10-29 11:06:52,291::task::595::Storage.TaskManager.Task::(_updateState) Task=`263d81f4-481f-4a52-b13d-3b305cfab640`::moving from state preparing -> state finished >Thread-135322::DEBUG::2014-10-29 11:06:52,291::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135322::DEBUG::2014-10-29 11:06:52,292::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135322::DEBUG::2014-10-29 11:06:52,292::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135322::DEBUG::2014-10-29 11:06:52,292::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135322::DEBUG::2014-10-29 11:06:52,293::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135322::DEBUG::2014-10-29 11:06:52,293::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135322::DEBUG::2014-10-29 11:06:52,293::task::993::Storage.TaskManager.Task::(_decref) Task=`263d81f4-481f-4a52-b13d-3b305cfab640`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:06:52,326::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53873 >Detector thread::DEBUG::2014-10-29 11:06:52,326::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53873 >Detector thread::DEBUG::2014-10-29 11:06:52,327::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53873 >Detector thread::DEBUG::2014-10-29 11:06:52,327::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53873) >Thread-135327::DEBUG::2014-10-29 11:06:52,366::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135327::DEBUG::2014-10-29 11:06:52,366::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e618554-25d5-40bc-96c8-099dbdd92ef6`::moving from state init -> state preparing >Thread-135327::INFO::2014-10-29 11:06:52,367::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135327::INFO::2014-10-29 11:06:52,367::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000546951', 'lastCheck': '4.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502102', 'lastCheck': '2.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043364', 'lastCheck': '2.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000875699', 'lastCheck': '2.4', 'valid': True}} >Thread-135327::DEBUG::2014-10-29 11:06:52,368::task::1191::Storage.TaskManager.Task::(prepare) Task=`2e618554-25d5-40bc-96c8-099dbdd92ef6`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000546951', 'lastCheck': '4.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502102', 'lastCheck': '2.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043364', 'lastCheck': '2.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000875699', 'lastCheck': '2.4', 'valid': True}} >Thread-135327::DEBUG::2014-10-29 11:06:52,368::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e618554-25d5-40bc-96c8-099dbdd92ef6`::moving from state preparing -> state finished >Thread-135327::DEBUG::2014-10-29 11:06:52,368::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135327::DEBUG::2014-10-29 11:06:52,368::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135327::DEBUG::2014-10-29 11:06:52,369::task::993::Storage.TaskManager.Task::(_decref) Task=`2e618554-25d5-40bc-96c8-099dbdd92ef6`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:53,679::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:53,681::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:53,683::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:54,508::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:54,512::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135328::DEBUG::2014-10-29 11:06:54,515::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:54,517::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:54,519::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135329::DEBUG::2014-10-29 11:06:54,522::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135329::DEBUG::2014-10-29 11:06:54,524::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:57,537::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:57,540::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135330::DEBUG::2014-10-29 11:06:57,542::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:06:57,545::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:06:57,547::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135331::DEBUG::2014-10-29 11:06:57,549::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135331::DEBUG::2014-10-29 11:06:57,552::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:06:57,690::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:57,690::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:57,690::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:57,691::__init__::232::IOProcess::(_processLogs) (199455) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:57,691::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199455) Queuing response >Thread-178::DEBUG::2014-10-29 11:06:57,693::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:06:57,711::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000543221 s, 935 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:06:57,712::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:57,713::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:57,713::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:57,713::__init__::232::IOProcess::(_processLogs) (199456) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:06:57,715::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199456) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:57,717::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:57,717::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:57,717::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:57,717::__init__::232::IOProcess::(_processLogs) (199457) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:57,718::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199457) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:57,720::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:57,720::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:57,720::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:57,720::__init__::232::IOProcess::(_processLogs) (199458) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:57,721::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199458) Queuing response >Thread-17::DEBUG::2014-10-29 11:06:57,722::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:57,722::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:06:57,723::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:06:57,723::__init__::232::IOProcess::(_processLogs) (199459) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:06:57,724::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199459) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:58,689::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:58,691::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:06:58,692::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:06:59,226::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53874 >Detector thread::DEBUG::2014-10-29 11:06:59,227::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53874 >Detector thread::DEBUG::2014-10-29 11:06:59,227::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53874 >Detector thread::DEBUG::2014-10-29 11:06:59,228::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53874) >Thread-135332::DEBUG::2014-10-29 11:06:59,266::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135332::DEBUG::2014-10-29 11:06:59,268::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135332::DEBUG::2014-10-29 11:06:59,288::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135332::DEBUG::2014-10-29 11:06:59,333::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '7', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '7', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:06:59,726::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53875 >Detector thread::DEBUG::2014-10-29 11:06:59,726::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53875 >Detector thread::DEBUG::2014-10-29 11:06:59,726::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53875 >Detector thread::DEBUG::2014-10-29 11:06:59,727::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53875) >Thread-135333::DEBUG::2014-10-29 11:06:59,766::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135333::DEBUG::2014-10-29 11:06:59,767::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135333::DEBUG::2014-10-29 11:06:59,768::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.06', 'elapsedTime': '513452', 'displayType': 'vnc', 'cpuSys': '0.46', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '8933396', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '74122', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '33330.98'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.57', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-17::DEBUG::2014-10-29 11:06:59,998::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:06:59,998::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:00,000::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-10269::DEBUG::2014-10-29 11:07:00,002::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:07:00,002::__init__::232::IOProcess::(_processLogs) (199460) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:00,018::__init__::232::IOProcess::(_processLogs) (199460) Queuing response >Thread-10269::DEBUG::2014-10-29 11:07:00,021::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000548781 s, 915 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:07:00,023::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:00,023::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:00,023::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:00,023::__init__::232::IOProcess::(_processLogs) (199461) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:00,024::__init__::232::IOProcess::(_processLogs) (199461) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:00,157::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:00,158::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:00,158::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:00,158::__init__::232::IOProcess::(_processLogs) (199462) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:00,159::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199462) Queuing response >Thread-179::DEBUG::2014-10-29 11:07:00,161::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:07:00,179::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000509666 s, 730 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:07:00,181::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:00,181::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:00,181::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:00,181::__init__::232::IOProcess::(_processLogs) (199463) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:00,183::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199463) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:00,235::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:00,235::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:00,236::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:00,236::__init__::232::IOProcess::(_processLogs) (199464) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:00,237::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199464) Queuing response >Thread-33::DEBUG::2014-10-29 11:07:00,239::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:07:00,255::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00050822 s, 958 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:07:00,257::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:00,258::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:00,258::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:00,258::__init__::232::IOProcess::(_processLogs) (199465) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:00,258::__init__::232::IOProcess::(_processLogs) (199465) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:00,261::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:00,261::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:00,261::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:00,261::__init__::232::IOProcess::(_processLogs) (199466) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:00,262::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199466) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:00,263::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:00,263::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:00,264::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:00,264::__init__::232::IOProcess::(_processLogs) (199467) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:00,265::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199467) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:00,266::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:00,266::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:00,267::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:00,267::__init__::232::IOProcess::(_processLogs) (199468) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:00,269::__init__::232::IOProcess::(_processLogs) (199468) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:00,564::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:00,567::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135334::DEBUG::2014-10-29 11:07:00,572::task::595::Storage.TaskManager.Task::(_updateState) Task=`59c9d547-77d2-44c1-a16c-ef6f7eb38f99`::moving from state init -> state preparing >Thread-135334::INFO::2014-10-29 11:07:00,572::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135334::INFO::2014-10-29 11:07:00,573::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543221', 'lastCheck': '2.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050822', 'lastCheck': '0.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000509666', 'lastCheck': '0.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000548781', 'lastCheck': '0.5', 'valid': True}} >Thread-135334::DEBUG::2014-10-29 11:07:00,573::task::1191::Storage.TaskManager.Task::(prepare) Task=`59c9d547-77d2-44c1-a16c-ef6f7eb38f99`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543221', 'lastCheck': '2.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050822', 'lastCheck': '0.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000509666', 'lastCheck': '0.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000548781', 'lastCheck': '0.5', 'valid': True}} >Thread-135334::DEBUG::2014-10-29 11:07:00,573::task::595::Storage.TaskManager.Task::(_updateState) Task=`59c9d547-77d2-44c1-a16c-ef6f7eb38f99`::moving from state preparing -> state finished >Thread-135334::DEBUG::2014-10-29 11:07:00,574::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135334::DEBUG::2014-10-29 11:07:00,574::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135334::DEBUG::2014-10-29 11:07:00,574::task::993::Storage.TaskManager.Task::(_decref) Task=`59c9d547-77d2-44c1-a16c-ef6f7eb38f99`::ref 0 aborting False >Thread-135334::DEBUG::2014-10-29 11:07:00,619::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:00,642::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:00,644::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135335::DEBUG::2014-10-29 11:07:00,647::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135335::DEBUG::2014-10-29 11:07:00,650::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:07:01,095::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53877 >Detector thread::DEBUG::2014-10-29 11:07:01,095::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53877 >Detector thread::DEBUG::2014-10-29 11:07:01,096::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53877 >Detector thread::DEBUG::2014-10-29 11:07:01,096::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53877) >Thread-135336::DEBUG::2014-10-29 11:07:01,136::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd034b3c-0fde-4364-80ee-4f1e0a2ac21b`::moving from state init -> state preparing >Thread-135336::INFO::2014-10-29 11:07:01,136::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135336::INFO::2014-10-29 11:07:01,137::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543221', 'lastCheck': '3.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050822', 'lastCheck': '0.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000509666', 'lastCheck': '1.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000548781', 'lastCheck': '1.1', 'valid': True}} >Thread-135336::DEBUG::2014-10-29 11:07:01,137::task::1191::Storage.TaskManager.Task::(prepare) Task=`cd034b3c-0fde-4364-80ee-4f1e0a2ac21b`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543221', 'lastCheck': '3.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050822', 'lastCheck': '0.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000509666', 'lastCheck': '1.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000548781', 'lastCheck': '1.1', 'valid': True}} >Thread-135336::DEBUG::2014-10-29 11:07:01,137::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd034b3c-0fde-4364-80ee-4f1e0a2ac21b`::moving from state preparing -> state finished >Thread-135336::DEBUG::2014-10-29 11:07:01,137::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135336::DEBUG::2014-10-29 11:07:01,138::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135336::DEBUG::2014-10-29 11:07:01,138::task::993::Storage.TaskManager.Task::(_decref) Task=`cd034b3c-0fde-4364-80ee-4f1e0a2ac21b`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:07:01,231::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Detector thread::DEBUG::2014-10-29 11:07:02,931::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53879 >Detector thread::DEBUG::2014-10-29 11:07:02,932::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53879 >Detector thread::DEBUG::2014-10-29 11:07:02,932::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53879 >Detector thread::DEBUG::2014-10-29 11:07:02,933::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53879) >Thread-135337::DEBUG::2014-10-29 11:07:02,972::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135337::DEBUG::2014-10-29 11:07:02,973::task::595::Storage.TaskManager.Task::(_updateState) Task=`b38b920d-fac7-4f45-88b8-2057584b83aa`::moving from state init -> state preparing >Thread-135337::INFO::2014-10-29 11:07:02,973::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135337::DEBUG::2014-10-29 11:07:02,977::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:07:02,978::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:02,978::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:02,979::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:02,979::__init__::232::IOProcess::(_processLogs) (199469) Got request for method 'glob' >VM Channels Listener::DEBUG::2014-10-29 11:07:03,145::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:03,692::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:03,694::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135338::DEBUG::2014-10-29 11:07:03,701::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:03,702::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:03,707::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:03,708::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:03,714::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpcServer::DEBUG::2014-10-29 11:07:03,714::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135339::DEBUG::2014-10-29 11:07:03,720::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135339::DEBUG::2014-10-29 11:07:03,723::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:07:03,788::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199469) Queuing response >Thread-135337::DEBUG::2014-10-29 11:07:03,789::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135337::DEBUG::2014-10-29 11:07:03,790::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135337::INFO::2014-10-29 11:07:03,790::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135337::DEBUG::2014-10-29 11:07:03,791::task::1191::Storage.TaskManager.Task::(prepare) Task=`b38b920d-fac7-4f45-88b8-2057584b83aa`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135337::DEBUG::2014-10-29 11:07:03,791::task::595::Storage.TaskManager.Task::(_updateState) Task=`b38b920d-fac7-4f45-88b8-2057584b83aa`::moving from state preparing -> state finished >Thread-135337::DEBUG::2014-10-29 11:07:03,791::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135337::DEBUG::2014-10-29 11:07:03,792::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135337::DEBUG::2014-10-29 11:07:03,792::task::993::Storage.TaskManager.Task::(_decref) Task=`b38b920d-fac7-4f45-88b8-2057584b83aa`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:07:03,836::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53880 >Detector thread::DEBUG::2014-10-29 11:07:03,837::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53880 >Detector thread::DEBUG::2014-10-29 11:07:03,837::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53880 >Detector thread::DEBUG::2014-10-29 11:07:03,838::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53880) >Thread-135340::DEBUG::2014-10-29 11:07:03,878::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135340::DEBUG::2014-10-29 11:07:03,879::task::595::Storage.TaskManager.Task::(_updateState) Task=`08fa5880-dbc1-4fba-8dec-b8672568ada5`::moving from state init -> state preparing >Thread-135340::INFO::2014-10-29 11:07:03,879::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135340::DEBUG::2014-10-29 11:07:03,880::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135340::DEBUG::2014-10-29 11:07:03,880::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135340::DEBUG::2014-10-29 11:07:03,880::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135340::DEBUG::2014-10-29 11:07:03,880::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135340::DEBUG::2014-10-29 11:07:03,881::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135340::DEBUG::2014-10-29 11:07:03,881::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135340::DEBUG::2014-10-29 11:07:03,959::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135340::DEBUG::2014-10-29 11:07:03,960::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135340::DEBUG::2014-10-29 11:07:04,146::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135340::DEBUG::2014-10-29 11:07:04,147::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135340::DEBUG::2014-10-29 11:07:04,148::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135340::DEBUG::2014-10-29 11:07:04,148::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135340::DEBUG::2014-10-29 11:07:04,148::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135340::DEBUG::2014-10-29 11:07:04,149::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135340::DEBUG::2014-10-29 11:07:04,149::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135340::DEBUG::2014-10-29 11:07:04,150::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:07:04,157::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:04,158::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:04,158::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:04,158::__init__::232::IOProcess::(_processLogs) (199470) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:07:04,160::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199470) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:04,162::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:04,162::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:04,162::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:04,163::__init__::232::IOProcess::(_processLogs) (199471) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:07:04,163::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199471) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:04,165::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:04,168::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:04,169::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:04,171::__init__::232::IOProcess::(_processLogs) (199472) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:07:04,176::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199472) Queuing response >Thread-135340::DEBUG::2014-10-29 11:07:04,178::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:07:04,180::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:04,181::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:04,181::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:04,181::__init__::232::IOProcess::(_processLogs) (199473) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:07:04,182::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199473) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:04,183::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:04,183::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:04,184::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:04,184::__init__::232::IOProcess::(_processLogs) (199474) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:07:04,186::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199474) Queuing response >Thread-135340::DEBUG::2014-10-29 11:07:04,186::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:07:04,187::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:04,188::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:04,188::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:04,188::__init__::232::IOProcess::(_processLogs) (199475) Got request for method 'readfile' >Thread-135340::DEBUG::2014-10-29 11:07:04,189::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:07:04,189::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199475) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:04,191::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:04,191::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:04,192::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:04,192::__init__::232::IOProcess::(_processLogs) (199476) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:04,192::__init__::232::IOProcess::(_processLogs) (199476) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:04,193::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:04,193::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-135340::DEBUG::2014-10-29 11:07:04,194::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-135340::INFO::2014-10-29 11:07:04,194::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135340::INFO::2014-10-29 11:07:04,194::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:07:04,195::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-135340::INFO::2014-10-29 11:07:04,196::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:07:04,197::__init__::232::IOProcess::(_processLogs) (199477) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:07:04,198::__init__::232::IOProcess::(_processLogs) (199477) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:04,199::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:04,199::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:04,199::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:04,199::__init__::232::IOProcess::(_processLogs) (199478) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:07:04,200::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199478) Queuing response >Thread-135340::DEBUG::2014-10-29 11:07:04,201::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135340::DEBUG::2014-10-29 11:07:04,203::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`7a26363e-e200-412e-9538-9cd14ef2ded1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135340::DEBUG::2014-10-29 11:07:04,203::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135340::DEBUG::2014-10-29 11:07:04,204::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135340::DEBUG::2014-10-29 11:07:04,204::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`7a26363e-e200-412e-9538-9cd14ef2ded1`::Granted request >Thread-135340::DEBUG::2014-10-29 11:07:04,205::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`08fa5880-dbc1-4fba-8dec-b8672568ada5`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135340::DEBUG::2014-10-29 11:07:04,205::task::993::Storage.TaskManager.Task::(_decref) Task=`08fa5880-dbc1-4fba-8dec-b8672568ada5`::ref 1 aborting False >Thread-135340::INFO::2014-10-29 11:07:04,208::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135340::DEBUG::2014-10-29 11:07:04,208::task::1191::Storage.TaskManager.Task::(prepare) Task=`08fa5880-dbc1-4fba-8dec-b8672568ada5`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135340::DEBUG::2014-10-29 11:07:04,208::task::595::Storage.TaskManager.Task::(_updateState) Task=`08fa5880-dbc1-4fba-8dec-b8672568ada5`::moving from state preparing -> state finished >Thread-135340::DEBUG::2014-10-29 11:07:04,209::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135340::DEBUG::2014-10-29 11:07:04,209::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135340::DEBUG::2014-10-29 11:07:04,209::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135340::DEBUG::2014-10-29 11:07:04,210::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135340::DEBUG::2014-10-29 11:07:04,210::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135340::DEBUG::2014-10-29 11:07:04,210::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135340::DEBUG::2014-10-29 11:07:04,211::task::993::Storage.TaskManager.Task::(_decref) Task=`08fa5880-dbc1-4fba-8dec-b8672568ada5`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:07:04,234::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53881 >Detector thread::DEBUG::2014-10-29 11:07:04,235::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53881 >Detector thread::DEBUG::2014-10-29 11:07:04,235::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53881 >Detector thread::DEBUG::2014-10-29 11:07:04,236::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53881) >Thread-135345::DEBUG::2014-10-29 11:07:04,274::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135345::DEBUG::2014-10-29 11:07:04,275::task::595::Storage.TaskManager.Task::(_updateState) Task=`16974dfe-b242-4bed-af0d-23e6c3511a82`::moving from state init -> state preparing >Thread-135345::INFO::2014-10-29 11:07:04,275::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135345::INFO::2014-10-29 11:07:04,276::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543221', 'lastCheck': '6.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050822', 'lastCheck': '4.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000509666', 'lastCheck': '4.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000548781', 'lastCheck': '4.2', 'valid': True}} >Thread-135345::DEBUG::2014-10-29 11:07:04,276::task::1191::Storage.TaskManager.Task::(prepare) Task=`16974dfe-b242-4bed-af0d-23e6c3511a82`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543221', 'lastCheck': '6.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050822', 'lastCheck': '4.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000509666', 'lastCheck': '4.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000548781', 'lastCheck': '4.2', 'valid': True}} >Thread-135345::DEBUG::2014-10-29 11:07:04,276::task::595::Storage.TaskManager.Task::(_updateState) Task=`16974dfe-b242-4bed-af0d-23e6c3511a82`::moving from state preparing -> state finished >Thread-135345::DEBUG::2014-10-29 11:07:04,277::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135345::DEBUG::2014-10-29 11:07:04,277::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135345::DEBUG::2014-10-29 11:07:04,277::task::993::Storage.TaskManager.Task::(_decref) Task=`16974dfe-b242-4bed-af0d-23e6c3511a82`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:06,816::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:06,819::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135346::DEBUG::2014-10-29 11:07:06,822::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:06,825::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:06,827::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135347::DEBUG::2014-10-29 11:07:06,830::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135347::DEBUG::2014-10-29 11:07:06,832::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:07:07,726::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:07,727::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:07,727::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:07,727::__init__::232::IOProcess::(_processLogs) (199479) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:07,728::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199479) Queuing response >Thread-178::DEBUG::2014-10-29 11:07:07,730::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:07:07,749::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00160747 s, 316 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:07:07,751::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:07,751::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:07,751::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:07,752::__init__::232::IOProcess::(_processLogs) (199480) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:07,753::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199480) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:07,755::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:07,756::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:07,757::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:07,757::__init__::232::IOProcess::(_processLogs) (199481) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:07,757::__init__::232::IOProcess::(_processLogs) (199481) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:07,758::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:07,758::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:07,759::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:07,760::__init__::232::IOProcess::(_processLogs) (199482) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:07,760::__init__::232::IOProcess::(_processLogs) (199482) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:07,760::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:07,761::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:07,762::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:07,762::__init__::232::IOProcess::(_processLogs) (199483) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:07,762::__init__::232::IOProcess::(_processLogs) (199483) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:08,726::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:08,728::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:08,730::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:07:09,376::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53882 >Detector thread::DEBUG::2014-10-29 11:07:09,377::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53882 >Detector thread::DEBUG::2014-10-29 11:07:09,377::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53882 >Detector thread::DEBUG::2014-10-29 11:07:09,377::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53882) >Thread-135348::DEBUG::2014-10-29 11:07:09,416::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135348::DEBUG::2014-10-29 11:07:09,418::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135348::DEBUG::2014-10-29 11:07:09,436::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135348::DEBUG::2014-10-29 11:07:09,484::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '192', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '92', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:09,848::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:09,851::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135349::DEBUG::2014-10-29 11:07:09,854::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:09,856::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:09,858::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135350::DEBUG::2014-10-29 11:07:09,861::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135350::DEBUG::2014-10-29 11:07:09,863::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:07:09,921::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53883 >Detector thread::DEBUG::2014-10-29 11:07:09,925::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53883 >Detector thread::DEBUG::2014-10-29 11:07:09,925::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53883 >Detector thread::DEBUG::2014-10-29 11:07:09,926::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53883) >Thread-135351::DEBUG::2014-10-29 11:07:09,965::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135351::DEBUG::2014-10-29 11:07:09,966::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135351::DEBUG::2014-10-29 11:07:09,967::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.53', 'elapsedTime': '513462', 'displayType': 'vnc', 'cpuSys': '0.40', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '8933396', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '74122', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '33330.98'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.73', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-17::DEBUG::2014-10-29 11:07:10,027::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:10,027::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:10,027::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:10,028::__init__::232::IOProcess::(_processLogs) (199484) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:10,029::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199484) Queuing response >Thread-10269::DEBUG::2014-10-29 11:07:10,031::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:07:10,051::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000445269 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:07:10,053::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:10,053::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:10,053::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:10,054::__init__::232::IOProcess::(_processLogs) (199485) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:10,055::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199485) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:10,186::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:10,187::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:10,187::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:10,187::__init__::232::IOProcess::(_processLogs) (199486) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:10,189::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199486) Queuing response >Thread-179::DEBUG::2014-10-29 11:07:10,190::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:07:10,210::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00160125 s, 232 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:07:10,212::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:10,212::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:10,212::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:10,213::__init__::232::IOProcess::(_processLogs) (199487) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:10,213::__init__::232::IOProcess::(_processLogs) (199487) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:10,270::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:10,270::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:10,270::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:10,270::__init__::232::IOProcess::(_processLogs) (199488) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:10,272::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199488) Queuing response >Thread-33::DEBUG::2014-10-29 11:07:10,273::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:07:10,291::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00133763 s, 364 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:07:10,293::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:10,294::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:10,294::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:10,294::__init__::232::IOProcess::(_processLogs) (199489) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:10,295::__init__::232::IOProcess::(_processLogs) (199489) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:10,297::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:10,298::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:10,298::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:10,299::__init__::232::IOProcess::(_processLogs) (199490) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:10,299::__init__::232::IOProcess::(_processLogs) (199490) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:10,300::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:10,301::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:10,301::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:10,302::__init__::232::IOProcess::(_processLogs) (199491) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:10,302::__init__::232::IOProcess::(_processLogs) (199491) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:10,302::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:10,303::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:10,304::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:10,305::__init__::232::IOProcess::(_processLogs) (199492) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:10,305::__init__::232::IOProcess::(_processLogs) (199492) Queuing response >Detector thread::DEBUG::2014-10-29 11:07:10,341::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53885 >Detector thread::DEBUG::2014-10-29 11:07:10,341::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53885 >Detector thread::DEBUG::2014-10-29 11:07:10,341::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53885 >Detector thread::DEBUG::2014-10-29 11:07:10,342::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53885) >Thread-135352::DEBUG::2014-10-29 11:07:10,382::task::595::Storage.TaskManager.Task::(_updateState) Task=`e22e2a1b-75c2-4fd0-8794-653745045a05`::moving from state init -> state preparing >Thread-135352::INFO::2014-10-29 11:07:10,383::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135352::INFO::2014-10-29 11:07:10,383::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00160747', 'lastCheck': '2.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00133763', 'lastCheck': '0.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00160125', 'lastCheck': '0.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000445269', 'lastCheck': '0.3', 'valid': True}} >Thread-135352::DEBUG::2014-10-29 11:07:10,384::task::1191::Storage.TaskManager.Task::(prepare) Task=`e22e2a1b-75c2-4fd0-8794-653745045a05`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00160747', 'lastCheck': '2.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00133763', 'lastCheck': '0.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00160125', 'lastCheck': '0.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000445269', 'lastCheck': '0.3', 'valid': True}} >Thread-135352::DEBUG::2014-10-29 11:07:10,384::task::595::Storage.TaskManager.Task::(_updateState) Task=`e22e2a1b-75c2-4fd0-8794-653745045a05`::moving from state preparing -> state finished >Thread-135352::DEBUG::2014-10-29 11:07:10,384::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135352::DEBUG::2014-10-29 11:07:10,384::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135352::DEBUG::2014-10-29 11:07:10,385::task::993::Storage.TaskManager.Task::(_decref) Task=`e22e2a1b-75c2-4fd0-8794-653745045a05`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:12,880::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:12,882::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135353::DEBUG::2014-10-29 11:07:12,886::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:12,888::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:12,890::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135354::DEBUG::2014-10-29 11:07:12,893::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135354::DEBUG::2014-10-29 11:07:12,895::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:13,737::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:13,739::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:13,740::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:15,908::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:15,911::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135355::DEBUG::2014-10-29 11:07:15,915::task::595::Storage.TaskManager.Task::(_updateState) Task=`649752a3-c1fe-458b-8b8d-e080c639b072`::moving from state init -> state preparing >Thread-135355::INFO::2014-10-29 11:07:15,915::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135355::INFO::2014-10-29 11:07:15,916::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00160747', 'lastCheck': '8.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00133763', 'lastCheck': '5.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00160125', 'lastCheck': '5.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000445269', 'lastCheck': '5.9', 'valid': True}} >Thread-135355::DEBUG::2014-10-29 11:07:15,916::task::1191::Storage.TaskManager.Task::(prepare) Task=`649752a3-c1fe-458b-8b8d-e080c639b072`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00160747', 'lastCheck': '8.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00133763', 'lastCheck': '5.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00160125', 'lastCheck': '5.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000445269', 'lastCheck': '5.9', 'valid': True}} >Thread-135355::DEBUG::2014-10-29 11:07:15,917::task::595::Storage.TaskManager.Task::(_updateState) Task=`649752a3-c1fe-458b-8b8d-e080c639b072`::moving from state preparing -> state finished >Thread-135355::DEBUG::2014-10-29 11:07:15,917::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135355::DEBUG::2014-10-29 11:07:15,917::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135355::DEBUG::2014-10-29 11:07:15,918::task::993::Storage.TaskManager.Task::(_decref) Task=`649752a3-c1fe-458b-8b8d-e080c639b072`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:07:16,256::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-135355::DEBUG::2014-10-29 11:07:16,401::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:16,436::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:16,560::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135356::DEBUG::2014-10-29 11:07:16,570::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135356::DEBUG::2014-10-29 11:07:16,587::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:07:16,682::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53887 >Detector thread::DEBUG::2014-10-29 11:07:16,682::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53887 >Detector thread::DEBUG::2014-10-29 11:07:16,683::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53887 >Detector thread::DEBUG::2014-10-29 11:07:16,683::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53887) >Thread-135357::DEBUG::2014-10-29 11:07:16,726::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135357::DEBUG::2014-10-29 11:07:16,728::task::595::Storage.TaskManager.Task::(_updateState) Task=`8aae87cc-5992-4cc3-8733-3cda385e1bbc`::moving from state init -> state preparing >Thread-135357::INFO::2014-10-29 11:07:16,730::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135357::DEBUG::2014-10-29 11:07:16,743::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:07:16,746::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:16,746::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:16,747::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:16,747::__init__::232::IOProcess::(_processLogs) (199493) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:07:16,748::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199493) Queuing response >Thread-135357::DEBUG::2014-10-29 11:07:16,748::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135357::DEBUG::2014-10-29 11:07:16,751::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135357::INFO::2014-10-29 11:07:16,752::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135357::DEBUG::2014-10-29 11:07:16,754::task::1191::Storage.TaskManager.Task::(prepare) Task=`8aae87cc-5992-4cc3-8733-3cda385e1bbc`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135357::DEBUG::2014-10-29 11:07:16,755::task::595::Storage.TaskManager.Task::(_updateState) Task=`8aae87cc-5992-4cc3-8733-3cda385e1bbc`::moving from state preparing -> state finished >Thread-135357::DEBUG::2014-10-29 11:07:16,756::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135357::DEBUG::2014-10-29 11:07:16,757::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135357::DEBUG::2014-10-29 11:07:16,758::task::993::Storage.TaskManager.Task::(_decref) Task=`8aae87cc-5992-4cc3-8733-3cda385e1bbc`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:07:16,865::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53888 >Detector thread::DEBUG::2014-10-29 11:07:16,866::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53888 >Detector thread::DEBUG::2014-10-29 11:07:16,866::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53888 >Detector thread::DEBUG::2014-10-29 11:07:16,866::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53888) >Thread-135358::DEBUG::2014-10-29 11:07:16,926::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135358::DEBUG::2014-10-29 11:07:16,929::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1091ac4-c9e8-428f-bebc-bc88992509b1`::moving from state init -> state preparing >Thread-135358::INFO::2014-10-29 11:07:16,930::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135358::DEBUG::2014-10-29 11:07:16,931::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135358::DEBUG::2014-10-29 11:07:16,933::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135358::DEBUG::2014-10-29 11:07:16,934::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135358::DEBUG::2014-10-29 11:07:16,935::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135358::DEBUG::2014-10-29 11:07:16,936::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135358::DEBUG::2014-10-29 11:07:16,938::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135358::DEBUG::2014-10-29 11:07:17,020::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135358::DEBUG::2014-10-29 11:07:17,023::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135358::DEBUG::2014-10-29 11:07:17,184::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135358::DEBUG::2014-10-29 11:07:17,187::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135358::DEBUG::2014-10-29 11:07:17,187::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135358::DEBUG::2014-10-29 11:07:17,187::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135358::DEBUG::2014-10-29 11:07:17,188::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135358::DEBUG::2014-10-29 11:07:17,188::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135358::DEBUG::2014-10-29 11:07:17,188::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135358::DEBUG::2014-10-29 11:07:17,189::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:07:17,197::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:17,199::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:17,199::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:17,199::__init__::232::IOProcess::(_processLogs) (199494) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:07:17,200::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199494) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:17,202::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:17,203::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:17,205::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:17,207::__init__::232::IOProcess::(_processLogs) (199495) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:07:17,211::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199495) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:17,214::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:17,218::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:17,221::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:17,224::__init__::232::IOProcess::(_processLogs) (199496) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:07:17,225::__init__::232::IOProcess::(_processLogs) (199496) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:17,234::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-135358::DEBUG::2014-10-29 11:07:17,236::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:07:17,236::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:17,238::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:17,239::__init__::232::IOProcess::(_processLogs) (199497) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:07:17,240::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199497) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:17,241::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:17,241::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:17,241::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:17,242::__init__::232::IOProcess::(_processLogs) (199498) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:07:17,242::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199498) Queuing response >Thread-135358::DEBUG::2014-10-29 11:07:17,243::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:07:17,244::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:17,244::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:17,244::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:17,245::__init__::232::IOProcess::(_processLogs) (199499) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:07:17,246::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199499) Queuing response >Thread-135358::DEBUG::2014-10-29 11:07:17,246::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:07:17,248::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:17,249::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:17,249::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:17,250::__init__::232::IOProcess::(_processLogs) (199500) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:17,250::__init__::232::IOProcess::(_processLogs) (199500) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:17,250::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:17,251::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:17,251::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:17,251::__init__::232::IOProcess::(_processLogs) (199501) Got request for method 'glob' >Thread-135358::DEBUG::2014-10-29 11:07:17,252::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:07:17,252::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199501) Queuing response >Thread-135358::INFO::2014-10-29 11:07:17,253::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135358::INFO::2014-10-29 11:07:17,254::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135358::INFO::2014-10-29 11:07:17,254::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:07:17,255::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:17,255::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:17,256::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:17,256::__init__::232::IOProcess::(_processLogs) (199502) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:07:17,257::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199502) Queuing response >Thread-135358::DEBUG::2014-10-29 11:07:17,257::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135358::DEBUG::2014-10-29 11:07:17,259::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`fc0c8f88-3e8c-4267-961b-bd1ba1724788`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135358::DEBUG::2014-10-29 11:07:17,259::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135358::DEBUG::2014-10-29 11:07:17,260::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135358::DEBUG::2014-10-29 11:07:17,260::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`fc0c8f88-3e8c-4267-961b-bd1ba1724788`::Granted request >Thread-135358::DEBUG::2014-10-29 11:07:17,261::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e1091ac4-c9e8-428f-bebc-bc88992509b1`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135358::DEBUG::2014-10-29 11:07:17,261::task::993::Storage.TaskManager.Task::(_decref) Task=`e1091ac4-c9e8-428f-bebc-bc88992509b1`::ref 1 aborting False >Thread-135358::INFO::2014-10-29 11:07:17,264::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135358::DEBUG::2014-10-29 11:07:17,264::task::1191::Storage.TaskManager.Task::(prepare) Task=`e1091ac4-c9e8-428f-bebc-bc88992509b1`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135358::DEBUG::2014-10-29 11:07:17,264::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1091ac4-c9e8-428f-bebc-bc88992509b1`::moving from state preparing -> state finished >Thread-135358::DEBUG::2014-10-29 11:07:17,264::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135358::DEBUG::2014-10-29 11:07:17,265::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135358::DEBUG::2014-10-29 11:07:17,265::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135358::DEBUG::2014-10-29 11:07:17,265::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135358::DEBUG::2014-10-29 11:07:17,266::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135358::DEBUG::2014-10-29 11:07:17,266::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135358::DEBUG::2014-10-29 11:07:17,266::task::993::Storage.TaskManager.Task::(_decref) Task=`e1091ac4-c9e8-428f-bebc-bc88992509b1`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:07:17,297::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53889 >Detector thread::DEBUG::2014-10-29 11:07:17,298::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53889 >Detector thread::DEBUG::2014-10-29 11:07:17,298::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53889 >Detector thread::DEBUG::2014-10-29 11:07:17,299::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53889) >Thread-135363::DEBUG::2014-10-29 11:07:17,337::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135363::DEBUG::2014-10-29 11:07:17,337::task::595::Storage.TaskManager.Task::(_updateState) Task=`c3d426cf-803a-437a-b59a-f036d3e0cdd5`::moving from state init -> state preparing >Thread-135363::INFO::2014-10-29 11:07:17,338::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135363::INFO::2014-10-29 11:07:17,338::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00160747', 'lastCheck': '9.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00133763', 'lastCheck': '7.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00160125', 'lastCheck': '7.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000445269', 'lastCheck': '7.3', 'valid': True}} >Thread-135363::DEBUG::2014-10-29 11:07:17,339::task::1191::Storage.TaskManager.Task::(prepare) Task=`c3d426cf-803a-437a-b59a-f036d3e0cdd5`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00160747', 'lastCheck': '9.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00133763', 'lastCheck': '7.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00160125', 'lastCheck': '7.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000445269', 'lastCheck': '7.3', 'valid': True}} >Thread-135363::DEBUG::2014-10-29 11:07:17,339::task::595::Storage.TaskManager.Task::(_updateState) Task=`c3d426cf-803a-437a-b59a-f036d3e0cdd5`::moving from state preparing -> state finished >Thread-135363::DEBUG::2014-10-29 11:07:17,339::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135363::DEBUG::2014-10-29 11:07:17,339::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135363::DEBUG::2014-10-29 11:07:17,340::task::993::Storage.TaskManager.Task::(_decref) Task=`c3d426cf-803a-437a-b59a-f036d3e0cdd5`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:07:17,764::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:17,765::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:17,765::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:17,765::__init__::232::IOProcess::(_processLogs) (199503) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:17,766::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199503) Queuing response >Thread-178::DEBUG::2014-10-29 11:07:17,768::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:07:17,787::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000518449 s, 980 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:07:17,790::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:17,790::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:17,791::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:17,791::__init__::232::IOProcess::(_processLogs) (199504) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:17,793::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199504) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:17,794::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:17,795::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:17,796::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:17,796::__init__::232::IOProcess::(_processLogs) (199505) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:17,797::__init__::232::IOProcess::(_processLogs) (199505) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:17,797::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:17,798::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:17,799::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:17,799::__init__::232::IOProcess::(_processLogs) (199506) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:17,799::__init__::232::IOProcess::(_processLogs) (199506) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:17,800::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:17,801::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:17,801::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:17,801::__init__::232::IOProcess::(_processLogs) (199507) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:17,802::__init__::232::IOProcess::(_processLogs) (199507) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:18,748::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:18,749::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:18,753::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:07:19,524::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53890 >Detector thread::DEBUG::2014-10-29 11:07:19,525::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53890 >Detector thread::DEBUG::2014-10-29 11:07:19,525::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53890 >Detector thread::DEBUG::2014-10-29 11:07:19,526::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53890) >Thread-135364::DEBUG::2014-10-29 11:07:19,564::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135364::DEBUG::2014-10-29 11:07:19,566::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135364::DEBUG::2014-10-29 11:07:19,586::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135364::DEBUG::2014-10-29 11:07:19,634::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '177', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '77', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:19,698::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:19,700::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135365::DEBUG::2014-10-29 11:07:19,704::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:19,706::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:19,708::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135366::DEBUG::2014-10-29 11:07:19,711::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135366::DEBUG::2014-10-29 11:07:19,714::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:07:20,058::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:20,059::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:20,059::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:20,059::__init__::232::IOProcess::(_processLogs) (199508) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:20,059::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199508) Queuing response >Thread-10269::DEBUG::2014-10-29 11:07:20,061::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:07:20,078::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000484636 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:07:20,080::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:20,080::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:20,080::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:20,080::__init__::232::IOProcess::(_processLogs) (199509) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:20,081::__init__::232::IOProcess::(_processLogs) (199509) Queuing response >Detector thread::DEBUG::2014-10-29 11:07:20,128::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53891 >Detector thread::DEBUG::2014-10-29 11:07:20,129::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53891 >Detector thread::DEBUG::2014-10-29 11:07:20,129::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53891 >Detector thread::DEBUG::2014-10-29 11:07:20,130::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53891) >Thread-135367::DEBUG::2014-10-29 11:07:20,168::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135367::DEBUG::2014-10-29 11:07:20,169::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135367::DEBUG::2014-10-29 11:07:20,170::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.69', 'elapsedTime': '513472', 'displayType': 'vnc', 'cpuSys': '0.87', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '8933396', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '74122', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '33330.98'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.91', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-17::DEBUG::2014-10-29 11:07:20,217::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:20,217::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:20,217::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:20,218::__init__::232::IOProcess::(_processLogs) (199510) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:20,221::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199510) Queuing response >Thread-179::DEBUG::2014-10-29 11:07:20,222::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:07:20,244::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00145777 s, 255 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:07:20,246::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:20,248::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:20,249::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:20,250::__init__::232::IOProcess::(_processLogs) (199511) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:20,251::__init__::232::IOProcess::(_processLogs) (199511) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:20,306::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:20,306::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:20,306::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:20,307::__init__::232::IOProcess::(_processLogs) (199512) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:20,308::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199512) Queuing response >Thread-33::DEBUG::2014-10-29 11:07:20,309::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:07:20,327::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000457104 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:07:20,328::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:20,329::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:20,329::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:20,329::__init__::232::IOProcess::(_processLogs) (199513) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:20,331::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199513) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:20,333::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:20,333::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:20,334::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:20,334::__init__::232::IOProcess::(_processLogs) (199514) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:20,335::__init__::232::IOProcess::(_processLogs) (199514) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:20,335::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:20,335::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:20,336::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:20,337::__init__::232::IOProcess::(_processLogs) (199515) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:20,337::__init__::232::IOProcess::(_processLogs) (199515) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:20,338::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:20,338::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:20,339::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:20,339::__init__::232::IOProcess::(_processLogs) (199516) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:20,340::__init__::232::IOProcess::(_processLogs) (199516) Queuing response >Detector thread::DEBUG::2014-10-29 11:07:20,445::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53893 >Detector thread::DEBUG::2014-10-29 11:07:20,446::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53893 >Detector thread::DEBUG::2014-10-29 11:07:20,446::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53893 >Detector thread::DEBUG::2014-10-29 11:07:20,446::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53893) >Thread-135368::DEBUG::2014-10-29 11:07:20,486::task::595::Storage.TaskManager.Task::(_updateState) Task=`d1f4fd6d-6cee-4165-838d-6111b76351ab`::moving from state init -> state preparing >Thread-135368::INFO::2014-10-29 11:07:20,486::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135368::INFO::2014-10-29 11:07:20,487::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518449', 'lastCheck': '2.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457104', 'lastCheck': '0.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00145777', 'lastCheck': '0.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000484636', 'lastCheck': '0.4', 'valid': True}} >Thread-135368::DEBUG::2014-10-29 11:07:20,487::task::1191::Storage.TaskManager.Task::(prepare) Task=`d1f4fd6d-6cee-4165-838d-6111b76351ab`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518449', 'lastCheck': '2.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457104', 'lastCheck': '0.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00145777', 'lastCheck': '0.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000484636', 'lastCheck': '0.4', 'valid': True}} >Thread-135368::DEBUG::2014-10-29 11:07:20,488::task::595::Storage.TaskManager.Task::(_updateState) Task=`d1f4fd6d-6cee-4165-838d-6111b76351ab`::moving from state preparing -> state finished >Thread-135368::DEBUG::2014-10-29 11:07:20,488::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135368::DEBUG::2014-10-29 11:07:20,488::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135368::DEBUG::2014-10-29 11:07:20,488::task::993::Storage.TaskManager.Task::(_decref) Task=`d1f4fd6d-6cee-4165-838d-6111b76351ab`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:22,731::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:22,733::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135369::DEBUG::2014-10-29 11:07:22,736::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:22,738::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:22,740::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135370::DEBUG::2014-10-29 11:07:22,743::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135370::DEBUG::2014-10-29 11:07:22,745::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:23,760::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:23,762::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:23,764::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:25,759::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:25,761::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135371::DEBUG::2014-10-29 11:07:25,765::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:25,767::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:25,768::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135372::DEBUG::2014-10-29 11:07:25,771::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135372::DEBUG::2014-10-29 11:07:25,774::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:07:27,804::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:27,805::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:27,805::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:27,805::__init__::232::IOProcess::(_processLogs) (199517) Got request for method 'statvfs' >Detector thread::DEBUG::2014-10-29 11:07:27,879::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53895 >Detector thread::DEBUG::2014-10-29 11:07:27,880::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53895 >Detector thread::DEBUG::2014-10-29 11:07:27,880::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53895 >Detector thread::DEBUG::2014-10-29 11:07:27,881::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53895) >Thread-135373::DEBUG::2014-10-29 11:07:27,920::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135373::DEBUG::2014-10-29 11:07:27,921::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce7c9d62-7f26-4e4c-a79f-9b6c17328eaa`::moving from state init -> state preparing >Thread-135373::INFO::2014-10-29 11:07:27,921::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135373::DEBUG::2014-10-29 11:07:27,935::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:07:27,936::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:27,937::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:27,937::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:27,937::__init__::232::IOProcess::(_processLogs) (199518) Got request for method 'glob' >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:28,772::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:28,774::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:28,779::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:28,788::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:28,791::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135374::DEBUG::2014-10-29 11:07:28,795::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:28,797::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:28,799::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135375::DEBUG::2014-10-29 11:07:28,802::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135375::DEBUG::2014-10-29 11:07:28,804::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:07:29,326::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53896 >Detector thread::DEBUG::2014-10-29 11:07:29,326::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53896 >Detector thread::DEBUG::2014-10-29 11:07:29,327::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53896 >Detector thread::DEBUG::2014-10-29 11:07:29,327::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53896) >Thread-135376::DEBUG::2014-10-29 11:07:29,366::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135376::DEBUG::2014-10-29 11:07:29,367::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135376::DEBUG::2014-10-29 11:07:29,368::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.69', 'elapsedTime': '513481', 'displayType': 'vnc', 'cpuSys': '0.87', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '8933396', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '74122', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '33330.98'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.11', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:07:29,693::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53898 >Detector thread::DEBUG::2014-10-29 11:07:29,694::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53898 >Detector thread::DEBUG::2014-10-29 11:07:29,694::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53898 >Detector thread::DEBUG::2014-10-29 11:07:29,694::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53898) >Thread-135377::DEBUG::2014-10-29 11:07:29,733::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135377::DEBUG::2014-10-29 11:07:29,735::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135377::DEBUG::2014-10-29 11:07:29,751::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135377::DEBUG::2014-10-29 11:07:29,795::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '161', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '61', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-17::DEBUG::2014-10-29 11:07:30,084::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:30,084::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:30,084::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:30,085::__init__::232::IOProcess::(_processLogs) (199519) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:30,251::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:30,251::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:30,252::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:30,252::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199520) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:30,342::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:30,343::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:30,343::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:30,343::__init__::232::IOProcess::(_processLogs) (199521) Got request for method 'statvfs' >Detector thread::DEBUG::2014-10-29 11:07:30,568::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53899 >Detector thread::DEBUG::2014-10-29 11:07:30,569::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53899 >Detector thread::DEBUG::2014-10-29 11:07:30,569::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53899 >Detector thread::DEBUG::2014-10-29 11:07:30,569::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53899) >Thread-135378::DEBUG::2014-10-29 11:07:30,609::task::595::Storage.TaskManager.Task::(_updateState) Task=`8202e58e-4f69-4440-9c25-0520f79772c5`::moving from state init -> state preparing >Thread-135378::INFO::2014-10-29 11:07:30,609::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135378::INFO::2014-10-29 11:07:30,610::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518449', 'lastCheck': '12.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457104', 'lastCheck': '10.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00145777', 'lastCheck': '10.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000484636', 'lastCheck': '10.5', 'valid': True}} >Thread-135378::DEBUG::2014-10-29 11:07:30,610::task::1191::Storage.TaskManager.Task::(prepare) Task=`8202e58e-4f69-4440-9c25-0520f79772c5`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518449', 'lastCheck': '12.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457104', 'lastCheck': '10.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00145777', 'lastCheck': '10.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000484636', 'lastCheck': '10.5', 'valid': True}} >Thread-135378::DEBUG::2014-10-29 11:07:30,610::task::595::Storage.TaskManager.Task::(_updateState) Task=`8202e58e-4f69-4440-9c25-0520f79772c5`::moving from state preparing -> state finished >Thread-135378::DEBUG::2014-10-29 11:07:30,611::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135378::DEBUG::2014-10-29 11:07:30,611::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135378::DEBUG::2014-10-29 11:07:30,611::task::993::Storage.TaskManager.Task::(_decref) Task=`8202e58e-4f69-4440-9c25-0520f79772c5`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:07:30,788::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199518) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:30,789::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199521) Queuing response >Thread-135373::DEBUG::2014-10-29 11:07:30,790::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135373::DEBUG::2014-10-29 11:07:30,792::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135373::INFO::2014-10-29 11:07:30,794::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135373::DEBUG::2014-10-29 11:07:30,796::task::1191::Storage.TaskManager.Task::(prepare) Task=`ce7c9d62-7f26-4e4c-a79f-9b6c17328eaa`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135373::DEBUG::2014-10-29 11:07:30,799::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce7c9d62-7f26-4e4c-a79f-9b6c17328eaa`::moving from state preparing -> state finished >Thread-33::DEBUG::2014-10-29 11:07:30,799::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-17::DEBUG::2014-10-29 11:07:30,798::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199519) Queuing response >Thread-135373::DEBUG::2014-10-29 11:07:30,800::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-33::DEBUG::2014-10-29 11:07:30,802::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135373::DEBUG::2014-10-29 11:07:30,805::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17::DEBUG::2014-10-29 11:07:30,805::__init__::232::IOProcess::(_processLogs) (199520) Queuing response >Thread-33::DEBUG::2014-10-29 11:07:30,806::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135373::DEBUG::2014-10-29 11:07:30,810::task::993::Storage.TaskManager.Task::(_decref) Task=`ce7c9d62-7f26-4e4c-a79f-9b6c17328eaa`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:07:30,811::__init__::232::IOProcess::(_processLogs) (199517) Queuing response >Thread-33::DEBUG::2014-10-29 11:07:30,811::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-33::DEBUG::2014-10-29 11:07:30,816::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-33::DEBUG::2014-10-29 11:07:30,822::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-10269::DEBUG::2014-10-29 11:07:30,850::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:07:30,879::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:07:30,880::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00048635 s, 1.0 MB/s\n'; <rc> = 0 >Thread-179::DEBUG::2014-10-29 11:07:30,908::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000528104 s, 704 kB/s\n'; <rc> = 0 >Thread-178::DEBUG::2014-10-29 11:07:30,910::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:07:30,931::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-33::DEBUG::2014-10-29 11:07:30,936::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-178::DEBUG::2014-10-29 11:07:30,943::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00706502 s, 71.9 kB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-10-29 11:07:30,947::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-17::DEBUG::2014-10-29 11:07:30,951::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:30,970::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:30,972::__init__::232::IOProcess::(_processLogs) (199522) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:30,975::__init__::232::IOProcess::(_processLogs) (199522) Queuing response >Detector thread::DEBUG::2014-10-29 11:07:30,976::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53900 >Thread-17::DEBUG::2014-10-29 11:07:30,981::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Detector thread::DEBUG::2014-10-29 11:07:30,982::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53900 >Thread-17::DEBUG::2014-10-29 11:07:30,984::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:30,986::__init__::232::IOProcess::(_processLogs) Extracting request information... >Detector thread::DEBUG::2014-10-29 11:07:30,986::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53900 >Thread-17::DEBUG::2014-10-29 11:07:30,989::__init__::232::IOProcess::(_processLogs) (199523) Got request for method 'statvfs' >Detector thread::DEBUG::2014-10-29 11:07:30,991::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53900) >Thread-17::DEBUG::2014-10-29 11:07:31,002::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199523) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:31,008::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:31,009::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:31,009::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:31,009::__init__::232::IOProcess::(_processLogs) (199524) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:31,010::__init__::232::IOProcess::(_processLogs) (199524) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:31,011::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:31,012::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:31,012::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:31,013::__init__::232::IOProcess::(_processLogs) (199525) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:31,013::__init__::232::IOProcess::(_processLogs) (199525) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:31,014::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:31,014::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:31,015::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:31,015::__init__::232::IOProcess::(_processLogs) (199526) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:31,016::__init__::232::IOProcess::(_processLogs) (199526) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:31,016::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-135379::DEBUG::2014-10-29 11:07:31,018::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-17::DEBUG::2014-10-29 11:07:31,021::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-135379::DEBUG::2014-10-29 11:07:31,023::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3c7b0a5-0f37-45e6-85b0-d7e9f56386ff`::moving from state init -> state preparing >Thread-17::DEBUG::2014-10-29 11:07:31,024::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-135379::INFO::2014-10-29 11:07:31,026::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-17::DEBUG::2014-10-29 11:07:31,026::__init__::232::IOProcess::(_processLogs) (199527) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:31,028::__init__::232::IOProcess::(_processLogs) (199527) Queuing response >Thread-33::DEBUG::2014-10-29 11:07:31,131::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-33::DEBUG::2014-10-29 11:07:31,132::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-33::DEBUG::2014-10-29 11:07:31,132::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-33::DEBUG::2014-10-29 11:07:31,133::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-33::DEBUG::2014-10-29 11:07:31,133::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-33::DEBUG::2014-10-29 11:07:31,133::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-33::DEBUG::2014-10-29 11:07:31,134::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-33::DEBUG::2014-10-29 11:07:31,134::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:07:31,139::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:31,142::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:31,142::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:31,142::__init__::232::IOProcess::(_processLogs) (199528) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:07:31,143::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199528) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:31,145::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:31,147::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:31,149::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:31,151::__init__::232::IOProcess::(_processLogs) (199529) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:07:31,152::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:31,154::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:31,156::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-33::DEBUG::2014-10-29 11:07:31,157::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:07:31,158::__init__::232::IOProcess::(_processLogs) (199530) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:07:31,160::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:31,160::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:31,160::__init__::232::IOProcess::(_processLogs) (199529) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:31,160::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:31,161::__init__::232::IOProcess::(_processLogs) (199531) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:07:31,161::__init__::232::IOProcess::(_processLogs) (199530) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:31,161::__init__::232::IOProcess::(_processLogs) (199531) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:31,164::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:31,164::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:31,164::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:31,164::__init__::232::IOProcess::(_processLogs) (199532) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:07:31,171::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199532) Queuing response >Thread-33::DEBUG::2014-10-29 11:07:31,172::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:07:31,173::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:31,173::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:31,174::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:31,174::__init__::232::IOProcess::(_processLogs) (199533) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:07:31,175::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199533) Queuing response >Thread-33::DEBUG::2014-10-29 11:07:31,176::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:07:31,177::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:31,178::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:31,179::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:31,179::__init__::232::IOProcess::(_processLogs) (199534) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:31,179::__init__::232::IOProcess::(_processLogs) (199534) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:31,180::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:31,180::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:31,180::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:31,181::__init__::232::IOProcess::(_processLogs) (199535) Got request for method 'glob' >Thread-33::DEBUG::2014-10-29 11:07:31,181::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:07:31,181::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199535) Queuing response >Thread-33::INFO::2014-10-29 11:07:31,182::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-33::INFO::2014-10-29 11:07:31,183::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135379::INFO::2014-10-29 11:07:31,184::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-33::DEBUG::2014-10-29 11:07:31,185::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:07:31,205::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000456709 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:07:31,205::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:31,208::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:31,208::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:31,209::__init__::232::IOProcess::(_processLogs) (199536) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:07:31,210::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199536) Queuing response >Thread-135379::DEBUG::2014-10-29 11:07:31,210::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135379::DEBUG::2014-10-29 11:07:31,214::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`e81ee313-5327-45a2-b3cd-f63cfcffb5bd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135379::DEBUG::2014-10-29 11:07:31,214::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135379::DEBUG::2014-10-29 11:07:31,215::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135379::DEBUG::2014-10-29 11:07:31,215::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`e81ee313-5327-45a2-b3cd-f63cfcffb5bd`::Granted request >Thread-135379::DEBUG::2014-10-29 11:07:31,216::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f3c7b0a5-0f37-45e6-85b0-d7e9f56386ff`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135379::DEBUG::2014-10-29 11:07:31,216::task::993::Storage.TaskManager.Task::(_decref) Task=`f3c7b0a5-0f37-45e6-85b0-d7e9f56386ff`::ref 1 aborting False >Thread-17::DEBUG::2014-10-29 11:07:31,221::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:31,224::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:31,226::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:31,228::__init__::232::IOProcess::(_processLogs) (199537) Got request for method 'statvfs' >Thread-135379::INFO::2014-10-29 11:07:31,229::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-17::DEBUG::2014-10-29 11:07:31,230::__init__::232::IOProcess::(_processLogs) (199537) Queuing response >Thread-135379::DEBUG::2014-10-29 11:07:31,230::task::1191::Storage.TaskManager.Task::(prepare) Task=`f3c7b0a5-0f37-45e6-85b0-d7e9f56386ff`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135379::DEBUG::2014-10-29 11:07:31,232::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3c7b0a5-0f37-45e6-85b0-d7e9f56386ff`::moving from state preparing -> state finished >Thread-135379::DEBUG::2014-10-29 11:07:31,233::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135379::DEBUG::2014-10-29 11:07:31,235::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17::DEBUG::2014-10-29 11:07:31,235::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:31,237::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-135379::DEBUG::2014-10-29 11:07:31,237::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-17::DEBUG::2014-10-29 11:07:31,239::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-135379::DEBUG::2014-10-29 11:07:31,239::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-17::DEBUG::2014-10-29 11:07:31,240::__init__::232::IOProcess::(_processLogs) (199538) Got request for method 'access' >Thread-135379::DEBUG::2014-10-29 11:07:31,240::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-17::DEBUG::2014-10-29 11:07:31,242::__init__::232::IOProcess::(_processLogs) (199538) Queuing response >Thread-135379::DEBUG::2014-10-29 11:07:31,242::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135379::DEBUG::2014-10-29 11:07:31,244::task::993::Storage.TaskManager.Task::(_decref) Task=`f3c7b0a5-0f37-45e6-85b0-d7e9f56386ff`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:07:31,245::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:31,247::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:31,248::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:31,249::__init__::232::IOProcess::(_processLogs) (199539) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:31,250::__init__::232::IOProcess::(_processLogs) (199539) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:31,254::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:31,255::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:31,255::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:31,255::__init__::232::IOProcess::(_processLogs) (199540) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:31,256::__init__::232::IOProcess::(_processLogs) (199540) Queuing response >Detector thread::DEBUG::2014-10-29 11:07:31,273::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53901 >Detector thread::DEBUG::2014-10-29 11:07:31,274::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53901 >Detector thread::DEBUG::2014-10-29 11:07:31,274::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53901 >Detector thread::DEBUG::2014-10-29 11:07:31,275::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53901) >Thread-22::DEBUG::2014-10-29 11:07:31,282::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-135384::DEBUG::2014-10-29 11:07:31,313::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135384::DEBUG::2014-10-29 11:07:31,313::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e329822-5557-4339-b66c-47e2fedde155`::moving from state init -> state preparing >Thread-135384::INFO::2014-10-29 11:07:31,314::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135384::INFO::2014-10-29 11:07:31,314::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00706502', 'lastCheck': '0.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456709', 'lastCheck': '0.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528104', 'lastCheck': '0.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00048635', 'lastCheck': '0.3', 'valid': True}} >Thread-135384::DEBUG::2014-10-29 11:07:31,315::task::1191::Storage.TaskManager.Task::(prepare) Task=`8e329822-5557-4339-b66c-47e2fedde155`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00706502', 'lastCheck': '0.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456709', 'lastCheck': '0.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528104', 'lastCheck': '0.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00048635', 'lastCheck': '0.3', 'valid': True}} >Thread-135384::DEBUG::2014-10-29 11:07:31,315::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e329822-5557-4339-b66c-47e2fedde155`::moving from state preparing -> state finished >Thread-135384::DEBUG::2014-10-29 11:07:31,315::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135384::DEBUG::2014-10-29 11:07:31,316::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135384::DEBUG::2014-10-29 11:07:31,316::task::993::Storage.TaskManager.Task::(_decref) Task=`8e329822-5557-4339-b66c-47e2fedde155`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:31,816::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:31,819::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135385::DEBUG::2014-10-29 11:07:31,823::task::595::Storage.TaskManager.Task::(_updateState) Task=`37297c46-f257-4a79-aa43-fe3be017c2de`::moving from state init -> state preparing >Thread-135385::INFO::2014-10-29 11:07:31,823::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135385::INFO::2014-10-29 11:07:31,823::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00706502', 'lastCheck': '0.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456709', 'lastCheck': '0.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528104', 'lastCheck': '0.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00048635', 'lastCheck': '0.9', 'valid': True}} >Thread-135385::DEBUG::2014-10-29 11:07:31,824::task::1191::Storage.TaskManager.Task::(prepare) Task=`37297c46-f257-4a79-aa43-fe3be017c2de`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00706502', 'lastCheck': '0.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456709', 'lastCheck': '0.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528104', 'lastCheck': '0.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00048635', 'lastCheck': '0.9', 'valid': True}} >Thread-135385::DEBUG::2014-10-29 11:07:31,824::task::595::Storage.TaskManager.Task::(_updateState) Task=`37297c46-f257-4a79-aa43-fe3be017c2de`::moving from state preparing -> state finished >Thread-135385::DEBUG::2014-10-29 11:07:31,824::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135385::DEBUG::2014-10-29 11:07:31,825::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135385::DEBUG::2014-10-29 11:07:31,825::task::993::Storage.TaskManager.Task::(_decref) Task=`37297c46-f257-4a79-aa43-fe3be017c2de`::ref 0 aborting False >Thread-135385::DEBUG::2014-10-29 11:07:31,847::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:31,871::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:31,873::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135386::DEBUG::2014-10-29 11:07:31,876::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135386::DEBUG::2014-10-29 11:07:31,878::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:07:33,177::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:33,782::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:33,784::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:33,786::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:34,938::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:34,941::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135387::DEBUG::2014-10-29 11:07:34,944::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:34,947::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:34,949::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135388::DEBUG::2014-10-29 11:07:34,952::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135388::DEBUG::2014-10-29 11:07:34,954::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:37,977::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:37,979::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135389::DEBUG::2014-10-29 11:07:37,982::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:37,984::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:37,986::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135390::DEBUG::2014-10-29 11:07:37,989::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135390::DEBUG::2014-10-29 11:07:37,991::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:38,793::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:38,795::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:38,797::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:07:39,517::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53902 >Detector thread::DEBUG::2014-10-29 11:07:39,517::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53902 >Detector thread::DEBUG::2014-10-29 11:07:39,518::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53902 >Detector thread::DEBUG::2014-10-29 11:07:39,518::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53902) >Thread-135391::DEBUG::2014-10-29 11:07:39,557::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135391::DEBUG::2014-10-29 11:07:39,558::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135391::DEBUG::2014-10-29 11:07:39,559::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.88', 'elapsedTime': '513492', 'displayType': 'vnc', 'cpuSys': '0.87', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '8933396', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '74122', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '33330.98'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.27', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:07:39,845::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53904 >Detector thread::DEBUG::2014-10-29 11:07:39,845::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53904 >Detector thread::DEBUG::2014-10-29 11:07:39,845::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53904 >Detector thread::DEBUG::2014-10-29 11:07:39,846::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53904) >Thread-135392::DEBUG::2014-10-29 11:07:39,885::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135392::DEBUG::2014-10-29 11:07:39,886::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135392::DEBUG::2014-10-29 11:07:39,904::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135392::DEBUG::2014-10-29 11:07:39,952::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '145', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '45', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-17::DEBUG::2014-10-29 11:07:40,975::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:40,975::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:40,976::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:40,976::__init__::232::IOProcess::(_processLogs) (199541) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:40,977::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199541) Queuing response >Thread-10269::DEBUG::2014-10-29 11:07:40,979::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:07:40,997::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00111257 s, 451 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:07:40,999::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:41,000::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:41,000::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:41,000::__init__::232::IOProcess::(_processLogs) (199542) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:41,002::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199542) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:41,006::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:41,009::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:07:41,013::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:41,015::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:41,017::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:41,018::__init__::232::IOProcess::(_processLogs) (199543) Got request for method 'statvfs' >Thread-135393::DEBUG::2014-10-29 11:07:41,019::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:07:41,023::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199543) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:41,027::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-179::DEBUG::2014-10-29 11:07:41,027::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:07:41,052::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-179::DEBUG::2014-10-29 11:07:41,056::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00125437 s, 297 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:07:41,056::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >JsonRpcServer::DEBUG::2014-10-29 11:07:41,057::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:07:41,062::__init__::232::IOProcess::(_processLogs) Extracting request information... >Detector thread::DEBUG::2014-10-29 11:07:41,064::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53905 >Thread-17::DEBUG::2014-10-29 11:07:41,065::__init__::232::IOProcess::(_processLogs) (199544) Got request for method 'statvfs' >Detector thread::DEBUG::2014-10-29 11:07:41,068::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53905 >Detector thread::DEBUG::2014-10-29 11:07:41,072::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53905 >Thread-135394::DEBUG::2014-10-29 11:07:41,075::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:07:41,076::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53905) >Thread-17::DEBUG::2014-10-29 11:07:41,084::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199544) Queuing response >Thread-178::DEBUG::2014-10-29 11:07:41,087::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:07:41,088::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:41,109::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:41,115::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-178::DEBUG::2014-10-29 11:07:41,116::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00116916 s, 435 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:07:41,118::__init__::232::IOProcess::(_processLogs) (199545) Got request for method 'statvfs' >Thread-135395::DEBUG::2014-10-29 11:07:41,128::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c42a6b0-287b-4e27-ac39-b2f600e7a1be`::moving from state init -> state preparing >Thread-135395::INFO::2014-10-29 11:07:41,131::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-17::DEBUG::2014-10-29 11:07:41,132::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199545) Queuing response >Thread-135395::INFO::2014-10-29 11:07:41,136::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00706502', 'lastCheck': '10.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456709', 'lastCheck': '9.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528104', 'lastCheck': '10.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111257', 'lastCheck': '0.1', 'valid': True}} >Thread-17::DEBUG::2014-10-29 11:07:41,140::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-135395::DEBUG::2014-10-29 11:07:41,140::task::1191::Storage.TaskManager.Task::(prepare) Task=`3c42a6b0-287b-4e27-ac39-b2f600e7a1be`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00706502', 'lastCheck': '10.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000456709', 'lastCheck': '9.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528104', 'lastCheck': '10.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111257', 'lastCheck': '0.1', 'valid': True}} >Thread-17::DEBUG::2014-10-29 11:07:41,143::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:41,145::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-135395::DEBUG::2014-10-29 11:07:41,144::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c42a6b0-287b-4e27-ac39-b2f600e7a1be`::moving from state preparing -> state finished >Thread-17::DEBUG::2014-10-29 11:07:41,147::__init__::232::IOProcess::(_processLogs) (199546) Got request for method 'statvfs' >Thread-135395::DEBUG::2014-10-29 11:07:41,148::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135394::DEBUG::2014-10-29 11:07:41,149::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-135395::DEBUG::2014-10-29 11:07:41,151::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135395::DEBUG::2014-10-29 11:07:41,156::task::993::Storage.TaskManager.Task::(_decref) Task=`3c42a6b0-287b-4e27-ac39-b2f600e7a1be`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:07:41,160::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199546) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:41,167::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:41,168::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:41,169::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:41,171::__init__::232::IOProcess::(_processLogs) (199547) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:41,171::__init__::232::IOProcess::(_processLogs) (199547) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:41,173::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:41,173::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:41,175::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:41,176::__init__::232::IOProcess::(_processLogs) (199548) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:41,176::__init__::232::IOProcess::(_processLogs) (199548) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:41,177::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:41,177::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:41,178::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:41,179::__init__::232::IOProcess::(_processLogs) (199549) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:41,183::__init__::232::IOProcess::(_processLogs) (199549) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:41,258::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:41,258::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:41,259::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:41,259::__init__::232::IOProcess::(_processLogs) (199550) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:41,259::__init__::232::IOProcess::(_processLogs) (199550) Queuing response >Thread-33::DEBUG::2014-10-29 11:07:41,261::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:07:41,280::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000507264 s, 960 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:07:41,282::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:41,282::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:41,282::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:41,283::__init__::232::IOProcess::(_processLogs) (199551) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:41,285::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199551) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:41,286::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:41,287::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:41,288::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:41,288::__init__::232::IOProcess::(_processLogs) (199552) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:41,289::__init__::232::IOProcess::(_processLogs) (199552) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:41,289::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:41,289::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:41,290::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:41,291::__init__::232::IOProcess::(_processLogs) (199553) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:41,291::__init__::232::IOProcess::(_processLogs) (199553) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:41,292::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:41,293::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:41,293::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:41,293::__init__::232::IOProcess::(_processLogs) (199554) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:41,293::__init__::232::IOProcess::(_processLogs) (199554) Queuing response >Detector thread::DEBUG::2014-10-29 11:07:41,897::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53907 >Detector thread::DEBUG::2014-10-29 11:07:41,897::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53907 >Detector thread::DEBUG::2014-10-29 11:07:41,898::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53907 >Detector thread::DEBUG::2014-10-29 11:07:41,898::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53907) >Thread-135396::DEBUG::2014-10-29 11:07:41,938::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135396::DEBUG::2014-10-29 11:07:41,939::task::595::Storage.TaskManager.Task::(_updateState) Task=`40dc201f-a2de-4dda-afbd-292e362984dc`::moving from state init -> state preparing >Thread-135396::INFO::2014-10-29 11:07:41,939::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135396::DEBUG::2014-10-29 11:07:41,942::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:07:41,943::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:41,943::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:41,944::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:41,944::__init__::232::IOProcess::(_processLogs) (199555) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:07:41,947::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199555) Queuing response >Thread-135396::DEBUG::2014-10-29 11:07:41,947::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135396::DEBUG::2014-10-29 11:07:41,949::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135396::INFO::2014-10-29 11:07:41,949::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135396::DEBUG::2014-10-29 11:07:41,949::task::1191::Storage.TaskManager.Task::(prepare) Task=`40dc201f-a2de-4dda-afbd-292e362984dc`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135396::DEBUG::2014-10-29 11:07:41,949::task::595::Storage.TaskManager.Task::(_updateState) Task=`40dc201f-a2de-4dda-afbd-292e362984dc`::moving from state preparing -> state finished >Thread-135396::DEBUG::2014-10-29 11:07:41,950::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135396::DEBUG::2014-10-29 11:07:41,950::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135396::DEBUG::2014-10-29 11:07:41,950::task::993::Storage.TaskManager.Task::(_decref) Task=`40dc201f-a2de-4dda-afbd-292e362984dc`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:07:41,993::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53908 >Detector thread::DEBUG::2014-10-29 11:07:41,994::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53908 >Detector thread::DEBUG::2014-10-29 11:07:41,994::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53908 >Detector thread::DEBUG::2014-10-29 11:07:41,995::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53908) >Thread-135397::DEBUG::2014-10-29 11:07:42,033::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135397::DEBUG::2014-10-29 11:07:42,034::task::595::Storage.TaskManager.Task::(_updateState) Task=`03d27a38-7880-4166-bb0f-929a1f5fcd3f`::moving from state init -> state preparing >Thread-135397::INFO::2014-10-29 11:07:42,034::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135397::DEBUG::2014-10-29 11:07:42,034::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135397::DEBUG::2014-10-29 11:07:42,034::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135397::DEBUG::2014-10-29 11:07:42,035::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135397::DEBUG::2014-10-29 11:07:42,035::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135397::DEBUG::2014-10-29 11:07:42,035::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135397::DEBUG::2014-10-29 11:07:42,036::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135397::DEBUG::2014-10-29 11:07:42,116::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135397::DEBUG::2014-10-29 11:07:42,117::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135397::DEBUG::2014-10-29 11:07:42,282::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135397::DEBUG::2014-10-29 11:07:42,283::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135397::DEBUG::2014-10-29 11:07:42,283::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135397::DEBUG::2014-10-29 11:07:42,284::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135397::DEBUG::2014-10-29 11:07:42,286::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135397::DEBUG::2014-10-29 11:07:42,286::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135397::DEBUG::2014-10-29 11:07:42,286::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135397::DEBUG::2014-10-29 11:07:42,287::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:07:42,293::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:42,296::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:42,297::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:42,297::__init__::232::IOProcess::(_processLogs) (199556) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:07:42,298::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199556) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:42,299::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:42,300::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:42,300::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:42,301::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:42,301::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:42,301::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:42,301::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:42,302::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:42,302::__init__::232::IOProcess::(_processLogs) (199557) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:07:42,302::__init__::232::IOProcess::(_processLogs) (199558) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:07:42,302::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:42,303::__init__::232::IOProcess::(_processLogs) (199559) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:07:42,304::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199558) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:42,305::__init__::232::IOProcess::(_processLogs) (199557) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:42,305::__init__::232::IOProcess::(_processLogs) (199559) Queuing response >Thread-135397::DEBUG::2014-10-29 11:07:42,311::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:07:42,312::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:42,313::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:42,313::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:42,313::__init__::232::IOProcess::(_processLogs) (199560) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:07:42,315::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199560) Queuing response >Thread-135397::DEBUG::2014-10-29 11:07:42,316::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:07:42,317::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:42,317::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:42,318::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:42,318::__init__::232::IOProcess::(_processLogs) (199561) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:07:42,319::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199561) Queuing response >Thread-135397::DEBUG::2014-10-29 11:07:42,319::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:07:42,321::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:42,322::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:42,323::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:42,323::__init__::232::IOProcess::(_processLogs) (199562) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:42,323::__init__::232::IOProcess::(_processLogs) (199562) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:42,324::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:42,324::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:42,324::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:42,324::__init__::232::IOProcess::(_processLogs) (199563) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:07:42,325::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199563) Queuing response >Thread-135397::DEBUG::2014-10-29 11:07:42,325::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-135397::INFO::2014-10-29 11:07:42,326::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135397::INFO::2014-10-29 11:07:42,327::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135397::INFO::2014-10-29 11:07:42,327::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:07:42,328::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:42,328::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:42,328::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:42,329::__init__::232::IOProcess::(_processLogs) (199564) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:07:42,330::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199564) Queuing response >Thread-135397::DEBUG::2014-10-29 11:07:42,331::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135397::DEBUG::2014-10-29 11:07:42,332::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`864f78f8-1d08-4f66-86c5-ed3e7f6fa676`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135397::DEBUG::2014-10-29 11:07:42,332::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135397::DEBUG::2014-10-29 11:07:42,333::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135397::DEBUG::2014-10-29 11:07:42,333::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`864f78f8-1d08-4f66-86c5-ed3e7f6fa676`::Granted request >Thread-135397::DEBUG::2014-10-29 11:07:42,334::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`03d27a38-7880-4166-bb0f-929a1f5fcd3f`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135397::DEBUG::2014-10-29 11:07:42,334::task::993::Storage.TaskManager.Task::(_decref) Task=`03d27a38-7880-4166-bb0f-929a1f5fcd3f`::ref 1 aborting False >Thread-135397::INFO::2014-10-29 11:07:42,337::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135397::DEBUG::2014-10-29 11:07:42,337::task::1191::Storage.TaskManager.Task::(prepare) Task=`03d27a38-7880-4166-bb0f-929a1f5fcd3f`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135397::DEBUG::2014-10-29 11:07:42,337::task::595::Storage.TaskManager.Task::(_updateState) Task=`03d27a38-7880-4166-bb0f-929a1f5fcd3f`::moving from state preparing -> state finished >Thread-135397::DEBUG::2014-10-29 11:07:42,338::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135397::DEBUG::2014-10-29 11:07:42,338::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135397::DEBUG::2014-10-29 11:07:42,338::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135397::DEBUG::2014-10-29 11:07:42,339::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135397::DEBUG::2014-10-29 11:07:42,339::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135397::DEBUG::2014-10-29 11:07:42,339::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135397::DEBUG::2014-10-29 11:07:42,339::task::993::Storage.TaskManager.Task::(_decref) Task=`03d27a38-7880-4166-bb0f-929a1f5fcd3f`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:07:42,362::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53909 >Detector thread::DEBUG::2014-10-29 11:07:42,362::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53909 >Detector thread::DEBUG::2014-10-29 11:07:42,362::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53909 >Detector thread::DEBUG::2014-10-29 11:07:42,363::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53909) >Thread-135402::DEBUG::2014-10-29 11:07:42,402::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135402::DEBUG::2014-10-29 11:07:42,403::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e322cf2-6b5c-4846-a3b0-4b984e6503a5`::moving from state init -> state preparing >Thread-135402::INFO::2014-10-29 11:07:42,403::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135402::INFO::2014-10-29 11:07:42,404::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00116916', 'lastCheck': '1.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507264', 'lastCheck': '1.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00125437', 'lastCheck': '1.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111257', 'lastCheck': '1.4', 'valid': True}} >Thread-135402::DEBUG::2014-10-29 11:07:42,404::task::1191::Storage.TaskManager.Task::(prepare) Task=`8e322cf2-6b5c-4846-a3b0-4b984e6503a5`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00116916', 'lastCheck': '1.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507264', 'lastCheck': '1.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00125437', 'lastCheck': '1.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111257', 'lastCheck': '1.4', 'valid': True}} >Thread-135402::DEBUG::2014-10-29 11:07:42,404::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e322cf2-6b5c-4846-a3b0-4b984e6503a5`::moving from state preparing -> state finished >Thread-135402::DEBUG::2014-10-29 11:07:42,404::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135402::DEBUG::2014-10-29 11:07:42,405::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135402::DEBUG::2014-10-29 11:07:42,405::task::993::Storage.TaskManager.Task::(_decref) Task=`8e322cf2-6b5c-4846-a3b0-4b984e6503a5`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:43,800::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:43,802::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:43,806::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:44,183::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:44,186::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135403::DEBUG::2014-10-29 11:07:44,190::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:44,194::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:44,196::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135404::DEBUG::2014-10-29 11:07:44,200::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135404::DEBUG::2014-10-29 11:07:44,202::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:07:46,288::task::595::Storage.TaskManager.Task::(_updateState) Task=`65841d18-26ea-432f-860f-9d6559b32013`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:07:46,290::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:07:46,294::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:46,296::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:46,301::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:46,303::__init__::232::IOProcess::(_processLogs) (199565) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:07:46,305::__init__::232::IOProcess::(_processLogs) (199565) Queuing response >Thread-22::INFO::2014-10-29 11:07:46,312::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010855424', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:07:46,312::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-22::DEBUG::2014-10-29 11:07:46,315::task::1191::Storage.TaskManager.Task::(prepare) Task=`65841d18-26ea-432f-860f-9d6559b32013`::finished: {'truesize': '6010855424', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:07:46,315::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-22::DEBUG::2014-10-29 11:07:46,316::task::595::Storage.TaskManager.Task::(_updateState) Task=`65841d18-26ea-432f-860f-9d6559b32013`::moving from state preparing -> state finished >Thread-17::DEBUG::2014-10-29 11:07:46,318::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-22::DEBUG::2014-10-29 11:07:46,318::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17::DEBUG::2014-10-29 11:07:46,320::__init__::232::IOProcess::(_processLogs) (199566) Got request for method 'stat' >Thread-22::DEBUG::2014-10-29 11:07:46,320::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17::DEBUG::2014-10-29 11:07:46,322::__init__::232::IOProcess::(_processLogs) (199566) Queuing response >Thread-22::DEBUG::2014-10-29 11:07:46,323::task::993::Storage.TaskManager.Task::(_decref) Task=`65841d18-26ea-432f-860f-9d6559b32013`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:07:46,397::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:47,216::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:47,218::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135405::DEBUG::2014-10-29 11:07:47,221::task::595::Storage.TaskManager.Task::(_updateState) Task=`5fc3b43d-201a-4c1d-aed3-210f07f76d6e`::moving from state init -> state preparing >Thread-135405::INFO::2014-10-29 11:07:47,222::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135405::INFO::2014-10-29 11:07:47,222::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00116916', 'lastCheck': '6.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507264', 'lastCheck': '5.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00125437', 'lastCheck': '6.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111257', 'lastCheck': '6.2', 'valid': True}} >Thread-135405::DEBUG::2014-10-29 11:07:47,223::task::1191::Storage.TaskManager.Task::(prepare) Task=`5fc3b43d-201a-4c1d-aed3-210f07f76d6e`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00116916', 'lastCheck': '6.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507264', 'lastCheck': '5.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00125437', 'lastCheck': '6.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111257', 'lastCheck': '6.2', 'valid': True}} >Thread-135405::DEBUG::2014-10-29 11:07:47,223::task::595::Storage.TaskManager.Task::(_updateState) Task=`5fc3b43d-201a-4c1d-aed3-210f07f76d6e`::moving from state preparing -> state finished >Thread-135405::DEBUG::2014-10-29 11:07:47,223::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135405::DEBUG::2014-10-29 11:07:47,223::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135405::DEBUG::2014-10-29 11:07:47,224::task::993::Storage.TaskManager.Task::(_decref) Task=`5fc3b43d-201a-4c1d-aed3-210f07f76d6e`::ref 0 aborting False >Thread-135405::DEBUG::2014-10-29 11:07:47,268::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:47,291::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:47,293::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135406::DEBUG::2014-10-29 11:07:47,297::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135406::DEBUG::2014-10-29 11:07:47,300::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:48,814::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:48,816::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:48,880::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:07:49,713::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53910 >Detector thread::DEBUG::2014-10-29 11:07:49,714::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53910 >Detector thread::DEBUG::2014-10-29 11:07:49,714::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53910 >Detector thread::DEBUG::2014-10-29 11:07:49,715::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53910) >Thread-135407::DEBUG::2014-10-29 11:07:49,753::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135407::DEBUG::2014-10-29 11:07:49,754::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135407::DEBUG::2014-10-29 11:07:49,755::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.86', 'elapsedTime': '513502', 'displayType': 'vnc', 'cpuSys': '0.60', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '41349652', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '64848', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '31636.46'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.35', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:07:50,002::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53912 >Detector thread::DEBUG::2014-10-29 11:07:50,002::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53912 >Detector thread::DEBUG::2014-10-29 11:07:50,003::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53912 >Detector thread::DEBUG::2014-10-29 11:07:50,003::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53912) >Thread-135408::DEBUG::2014-10-29 11:07:50,042::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135408::DEBUG::2014-10-29 11:07:50,044::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135408::DEBUG::2014-10-29 11:07:50,063::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135408::DEBUG::2014-10-29 11:07:50,108::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '130', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '30', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:07:50,231::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53913 >Detector thread::DEBUG::2014-10-29 11:07:50,232::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53913 >Detector thread::DEBUG::2014-10-29 11:07:50,232::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53913 >Detector thread::DEBUG::2014-10-29 11:07:50,233::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53913) >Thread-135409::DEBUG::2014-10-29 11:07:50,272::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d8b6628-398d-41a4-9528-fd26c51c32ee`::moving from state init -> state preparing >Thread-135409::INFO::2014-10-29 11:07:50,272::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135409::INFO::2014-10-29 11:07:50,273::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00116916', 'lastCheck': '9.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507264', 'lastCheck': '9.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00125437', 'lastCheck': '9.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111257', 'lastCheck': '9.3', 'valid': True}} >Thread-135409::DEBUG::2014-10-29 11:07:50,273::task::1191::Storage.TaskManager.Task::(prepare) Task=`5d8b6628-398d-41a4-9528-fd26c51c32ee`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00116916', 'lastCheck': '9.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507264', 'lastCheck': '9.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00125437', 'lastCheck': '9.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00111257', 'lastCheck': '9.3', 'valid': True}} >Thread-135409::DEBUG::2014-10-29 11:07:50,274::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d8b6628-398d-41a4-9528-fd26c51c32ee`::moving from state preparing -> state finished >Thread-135409::DEBUG::2014-10-29 11:07:50,274::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135409::DEBUG::2014-10-29 11:07:50,274::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135409::DEBUG::2014-10-29 11:07:50,274::task::993::Storage.TaskManager.Task::(_decref) Task=`5d8b6628-398d-41a4-9528-fd26c51c32ee`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:50,343::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:50,345::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135410::DEBUG::2014-10-29 11:07:50,349::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:50,351::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:50,353::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135411::DEBUG::2014-10-29 11:07:50,356::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135411::DEBUG::2014-10-29 11:07:50,358::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:07:51,005::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:51,006::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:51,006::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:51,006::__init__::232::IOProcess::(_processLogs) (199567) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:51,008::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199567) Queuing response >Thread-10269::DEBUG::2014-10-29 11:07:51,009::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:07:51,028::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000450603 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:07:51,030::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:51,030::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:51,031::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:51,032::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199568) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:51,034::__init__::232::IOProcess::(_processLogs) (199568) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:51,141::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:51,141::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:51,141::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:51,142::__init__::232::IOProcess::(_processLogs) (199569) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:51,143::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199569) Queuing response >Thread-179::DEBUG::2014-10-29 11:07:51,144::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:07:51,161::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000430693 s, 864 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:07:51,163::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:51,164::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:51,164::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:51,166::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199570) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:51,167::__init__::232::IOProcess::(_processLogs) (199570) Queuing response >Thread-178::DEBUG::2014-10-29 11:07:51,182::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 9b5dff8d-f9a0-4e5c-8800-3a988fc12016 >Thread-17::DEBUG::2014-10-29 11:07:51,191::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:51,193::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:51,193::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:51,193::__init__::232::IOProcess::(_processLogs) (199571) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:07:51,194::__init__::232::IOProcess::(_processLogs) (199571) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:51,197::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:51,200::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:51,201::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:51,202::__init__::232::IOProcess::(_processLogs) (199572) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:07:51,203::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199572) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:51,206::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:51,208::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-178::DEBUG::2014-10-29 11:07:51,210::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016 >Thread-17::DEBUG::2014-10-29 11:07:51,210::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:51,212::__init__::232::IOProcess::(_processLogs) (199573) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:07:51,213::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199573) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:51,214::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:51,214::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:51,214::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:51,215::__init__::232::IOProcess::(_processLogs) (199574) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:07:51,216::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199574) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:51,217::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:51,217::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:51,217::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:51,218::__init__::232::IOProcess::(_processLogs) (199575) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:07:51,220::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199575) Queuing response >Thread-178::DEBUG::2014-10-29 11:07:51,221::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:07:51,222::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:51,222::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:51,222::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:51,223::__init__::232::IOProcess::(_processLogs) (199576) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:07:51,223::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199576) Queuing response >Thread-178::DEBUG::2014-10-29 11:07:51,224::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nsednev_ovirt_3_5_HE_for_disks', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=Default', 'POOL_DOMAINS=9b5dff8d-f9a0-4e5c-8800-3a988fc12016:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=00000002-0002-0002-0002-000000000321', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_ovirt_3_5_HE_for_disks', 'ROLE=Master', 'SDUUID=9b5dff8d-f9a0-4e5c-8800-3a988fc12016', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=08256ef27d308c4f5bfe4a0974fd548f7d749489'] >Thread-17::DEBUG::2014-10-29 11:07:51,226::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:51,226::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:51,227::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:51,227::__init__::232::IOProcess::(_processLogs) (199577) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:51,228::__init__::232::IOProcess::(_processLogs) (199577) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:51,228::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:51,229::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:51,229::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:51,229::__init__::232::IOProcess::(_processLogs) (199578) Got request for method 'glob' >Thread-178::DEBUG::2014-10-29 11:07:51,230::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:07:51,230::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199578) Queuing response >Thread-178::INFO::2014-10-29 11:07:51,231::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9b5dff8d-f9a0-4e5c-8800-3a988fc12016_imageNS already registered >Thread-178::INFO::2014-10-29 11:07:51,232::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9b5dff8d-f9a0-4e5c-8800-3a988fc12016_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:07:51,232::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:51,233::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:51,233::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:51,233::__init__::232::IOProcess::(_processLogs) (199579) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:51,233::__init__::232::IOProcess::(_processLogs) (199579) Queuing response >Thread-178::DEBUG::2014-10-29 11:07:51,235::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:07:51,253::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000526787 s, 964 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:07:51,255::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:51,255::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:51,256::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:51,256::__init__::232::IOProcess::(_processLogs) (199580) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:51,257::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199580) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:51,259::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:51,260::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:51,260::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:51,260::__init__::232::IOProcess::(_processLogs) (199581) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:51,261::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199581) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:51,262::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:51,262::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:51,263::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:51,263::__init__::232::IOProcess::(_processLogs) (199582) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:51,264::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199582) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:51,265::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:51,265::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:51,265::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:51,265::__init__::232::IOProcess::(_processLogs) (199583) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:51,266::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199583) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:51,306::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:51,306::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:51,306::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:51,307::__init__::232::IOProcess::(_processLogs) (199584) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:51,308::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199584) Queuing response >Thread-33::DEBUG::2014-10-29 11:07:51,309::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:07:51,327::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000491524 s, 991 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:07:51,328::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:51,329::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:51,329::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:51,329::__init__::232::IOProcess::(_processLogs) (199585) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:07:51,331::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199585) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:51,333::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:51,333::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:51,333::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:51,333::__init__::232::IOProcess::(_processLogs) (199586) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:51,334::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199586) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:51,336::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:51,336::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:51,337::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:51,337::__init__::232::IOProcess::(_processLogs) (199587) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:51,338::__init__::232::IOProcess::(_processLogs) (199587) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:51,338::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:51,339::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:51,339::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:51,339::__init__::232::IOProcess::(_processLogs) (199588) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:51,340::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199588) Queuing response >Detector thread::DEBUG::2014-10-29 11:07:52,977::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53915 >Detector thread::DEBUG::2014-10-29 11:07:52,977::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53915 >Detector thread::DEBUG::2014-10-29 11:07:52,978::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53915 >Detector thread::DEBUG::2014-10-29 11:07:52,978::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53915) >Thread-135416::DEBUG::2014-10-29 11:07:53,018::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135416::DEBUG::2014-10-29 11:07:53,019::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf9260e8-64a1-4401-a106-676bee0282fe`::moving from state init -> state preparing >Thread-135416::INFO::2014-10-29 11:07:53,019::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135416::DEBUG::2014-10-29 11:07:53,036::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:07:53,037::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:53,038::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:53,038::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:53,038::__init__::232::IOProcess::(_processLogs) (199589) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:07:53,039::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199589) Queuing response >Thread-135416::DEBUG::2014-10-29 11:07:53,040::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135416::DEBUG::2014-10-29 11:07:53,040::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135416::INFO::2014-10-29 11:07:53,040::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135416::DEBUG::2014-10-29 11:07:53,041::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf9260e8-64a1-4401-a106-676bee0282fe`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135416::DEBUG::2014-10-29 11:07:53,041::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf9260e8-64a1-4401-a106-676bee0282fe`::moving from state preparing -> state finished >Thread-135416::DEBUG::2014-10-29 11:07:53,041::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135416::DEBUG::2014-10-29 11:07:53,041::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135416::DEBUG::2014-10-29 11:07:53,042::task::993::Storage.TaskManager.Task::(_decref) Task=`cf9260e8-64a1-4401-a106-676bee0282fe`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:07:53,085::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53916 >Detector thread::DEBUG::2014-10-29 11:07:53,086::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53916 >Detector thread::DEBUG::2014-10-29 11:07:53,086::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53916 >Detector thread::DEBUG::2014-10-29 11:07:53,086::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53916) >Thread-135417::DEBUG::2014-10-29 11:07:53,125::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135417::DEBUG::2014-10-29 11:07:53,126::task::595::Storage.TaskManager.Task::(_updateState) Task=`9923c786-2c40-4334-b32c-7e33c79341b0`::moving from state init -> state preparing >Thread-135417::INFO::2014-10-29 11:07:53,126::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135417::DEBUG::2014-10-29 11:07:53,126::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135417::DEBUG::2014-10-29 11:07:53,126::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135417::DEBUG::2014-10-29 11:07:53,127::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135417::DEBUG::2014-10-29 11:07:53,127::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135417::DEBUG::2014-10-29 11:07:53,127::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135417::DEBUG::2014-10-29 11:07:53,128::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135417::DEBUG::2014-10-29 11:07:53,216::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135417::DEBUG::2014-10-29 11:07:53,217::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:53,380::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:53,388::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135417::DEBUG::2014-10-29 11:07:53,397::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135418::DEBUG::2014-10-29 11:07:53,401::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-135417::DEBUG::2014-10-29 11:07:53,403::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135417::DEBUG::2014-10-29 11:07:53,408::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:53,412::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-135417::DEBUG::2014-10-29 11:07:53,414::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135417::DEBUG::2014-10-29 11:07:53,419::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >JsonRpcServer::DEBUG::2014-10-29 11:07:53,422::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135417::DEBUG::2014-10-29 11:07:53,426::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135417::DEBUG::2014-10-29 11:07:53,431::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135417::DEBUG::2014-10-29 11:07:53,434::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135419::DEBUG::2014-10-29 11:07:53,435::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:07:53,446::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:53,449::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:53,450::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:53,451::__init__::232::IOProcess::(_processLogs) (199590) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:07:53,455::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199590) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:53,460::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:53,461::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:53,462::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:53,464::__init__::232::IOProcess::(_processLogs) (199591) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:07:53,467::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199591) Queuing response >Thread-135419::DEBUG::2014-10-29 11:07:53,470::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:07:53,472::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:53,475::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:53,478::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:53,478::__init__::232::IOProcess::(_processLogs) (199592) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:07:53,479::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199592) Queuing response >Thread-135417::DEBUG::2014-10-29 11:07:53,483::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:07:53,484::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:53,484::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:53,485::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:53,485::__init__::232::IOProcess::(_processLogs) (199593) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:07:53,486::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199593) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:53,487::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:53,487::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:53,488::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:53,488::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199594) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:07:53,488::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199594) Queuing response >Thread-135417::DEBUG::2014-10-29 11:07:53,489::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:07:53,490::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:53,490::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:53,491::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-135417::DEBUG::2014-10-29 11:07:53,491::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:07:53,493::__init__::232::IOProcess::(_processLogs) (199595) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:07:53,494::__init__::232::IOProcess::(_processLogs) (199595) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:53,496::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:53,496::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:53,496::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:53,497::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199596) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:07:53,498::__init__::232::IOProcess::(_processLogs) (199596) Queuing response >Thread-17::DEBUG::2014-10-29 11:07:53,498::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:53,498::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:53,499::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:53,499::__init__::232::IOProcess::(_processLogs) (199597) Got request for method 'glob' >Thread-135417::DEBUG::2014-10-29 11:07:53,500::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:07:53,500::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199597) Queuing response >Thread-135417::INFO::2014-10-29 11:07:53,501::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135417::INFO::2014-10-29 11:07:53,502::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135417::INFO::2014-10-29 11:07:53,502::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:07:53,503::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:07:53,503::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:07:53,503::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:07:53,503::__init__::232::IOProcess::(_processLogs) (199598) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:07:53,504::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199598) Queuing response >Thread-135417::DEBUG::2014-10-29 11:07:53,504::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135417::DEBUG::2014-10-29 11:07:53,507::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`d267ae5e-6164-40fb-9d62-8efc9f4bd724`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135417::DEBUG::2014-10-29 11:07:53,507::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135417::DEBUG::2014-10-29 11:07:53,507::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135417::DEBUG::2014-10-29 11:07:53,508::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`d267ae5e-6164-40fb-9d62-8efc9f4bd724`::Granted request >Thread-135417::DEBUG::2014-10-29 11:07:53,508::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9923c786-2c40-4334-b32c-7e33c79341b0`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135417::DEBUG::2014-10-29 11:07:53,509::task::993::Storage.TaskManager.Task::(_decref) Task=`9923c786-2c40-4334-b32c-7e33c79341b0`::ref 1 aborting False >Thread-135417::INFO::2014-10-29 11:07:53,511::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135417::DEBUG::2014-10-29 11:07:53,512::task::1191::Storage.TaskManager.Task::(prepare) Task=`9923c786-2c40-4334-b32c-7e33c79341b0`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135417::DEBUG::2014-10-29 11:07:53,512::task::595::Storage.TaskManager.Task::(_updateState) Task=`9923c786-2c40-4334-b32c-7e33c79341b0`::moving from state preparing -> state finished >Thread-135417::DEBUG::2014-10-29 11:07:53,512::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135417::DEBUG::2014-10-29 11:07:53,512::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135417::DEBUG::2014-10-29 11:07:53,513::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135417::DEBUG::2014-10-29 11:07:53,513::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135417::DEBUG::2014-10-29 11:07:53,513::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135417::DEBUG::2014-10-29 11:07:53,514::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135417::DEBUG::2014-10-29 11:07:53,514::task::993::Storage.TaskManager.Task::(_decref) Task=`9923c786-2c40-4334-b32c-7e33c79341b0`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:07:53,536::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53917 >Detector thread::DEBUG::2014-10-29 11:07:53,537::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53917 >Detector thread::DEBUG::2014-10-29 11:07:53,537::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53917 >Detector thread::DEBUG::2014-10-29 11:07:53,538::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53917) >Thread-135424::DEBUG::2014-10-29 11:07:53,577::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135424::DEBUG::2014-10-29 11:07:53,578::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f3787cb-792d-4be2-9a65-a78ab5dc617e`::moving from state init -> state preparing >Thread-135424::INFO::2014-10-29 11:07:53,578::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135424::INFO::2014-10-29 11:07:53,579::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526787', 'lastCheck': '2.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491524', 'lastCheck': '2.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430693', 'lastCheck': '2.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000450603', 'lastCheck': '2.5', 'valid': True}} >Thread-135424::DEBUG::2014-10-29 11:07:53,579::task::1191::Storage.TaskManager.Task::(prepare) Task=`3f3787cb-792d-4be2-9a65-a78ab5dc617e`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526787', 'lastCheck': '2.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491524', 'lastCheck': '2.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430693', 'lastCheck': '2.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000450603', 'lastCheck': '2.5', 'valid': True}} >Thread-135424::DEBUG::2014-10-29 11:07:53,579::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f3787cb-792d-4be2-9a65-a78ab5dc617e`::moving from state preparing -> state finished >Thread-135424::DEBUG::2014-10-29 11:07:53,579::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135424::DEBUG::2014-10-29 11:07:53,580::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135424::DEBUG::2014-10-29 11:07:53,580::task::993::Storage.TaskManager.Task::(_decref) Task=`3f3787cb-792d-4be2-9a65-a78ab5dc617e`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:53,888::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:53,889::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:53,892::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:56,490::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:56,493::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135425::DEBUG::2014-10-29 11:07:56,497::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:56,500::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:56,502::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135426::DEBUG::2014-10-29 11:07:56,505::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135426::DEBUG::2014-10-29 11:07:56,507::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:58,899::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:58,901::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:07:58,902::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:59,521::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:59,525::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135427::DEBUG::2014-10-29 11:07:59,528::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:07:59,530::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:07:59,532::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135428::DEBUG::2014-10-29 11:07:59,535::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135428::DEBUG::2014-10-29 11:07:59,537::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:07:59,906::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53918 >Detector thread::DEBUG::2014-10-29 11:07:59,906::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53918 >Detector thread::DEBUG::2014-10-29 11:07:59,906::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53918 >Detector thread::DEBUG::2014-10-29 11:07:59,907::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53918) >Thread-135429::DEBUG::2014-10-29 11:07:59,946::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135429::DEBUG::2014-10-29 11:07:59,947::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135429::DEBUG::2014-10-29 11:07:59,947::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.86', 'elapsedTime': '513512', 'displayType': 'vnc', 'cpuSys': '0.60', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '41349652', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '64848', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '31636.46'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.55', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:08:00,158::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53920 >Detector thread::DEBUG::2014-10-29 11:08:00,159::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53920 >Detector thread::DEBUG::2014-10-29 11:08:00,159::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53920 >Detector thread::DEBUG::2014-10-29 11:08:00,159::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53920) >Thread-135430::DEBUG::2014-10-29 11:08:00,198::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135430::DEBUG::2014-10-29 11:08:00,199::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135430::DEBUG::2014-10-29 11:08:00,218::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135430::DEBUG::2014-10-29 11:08:00,265::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '114', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '14', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:08:00,344::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53921 >Detector thread::DEBUG::2014-10-29 11:08:00,345::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53921 >Detector thread::DEBUG::2014-10-29 11:08:00,345::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53921 >Detector thread::DEBUG::2014-10-29 11:08:00,346::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53921) >Thread-135431::DEBUG::2014-10-29 11:08:00,385::task::595::Storage.TaskManager.Task::(_updateState) Task=`6eb3ff4f-88dd-4dbf-bbc5-4bab583c1fe8`::moving from state init -> state preparing >Thread-135431::INFO::2014-10-29 11:08:00,385::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135431::INFO::2014-10-29 11:08:00,386::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526787', 'lastCheck': '9.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491524', 'lastCheck': '9.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430693', 'lastCheck': '9.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000450603', 'lastCheck': '9.4', 'valid': True}} >Thread-135431::DEBUG::2014-10-29 11:08:00,386::task::1191::Storage.TaskManager.Task::(prepare) Task=`6eb3ff4f-88dd-4dbf-bbc5-4bab583c1fe8`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526787', 'lastCheck': '9.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491524', 'lastCheck': '9.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430693', 'lastCheck': '9.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000450603', 'lastCheck': '9.4', 'valid': True}} >Thread-135431::DEBUG::2014-10-29 11:08:00,387::task::595::Storage.TaskManager.Task::(_updateState) Task=`6eb3ff4f-88dd-4dbf-bbc5-4bab583c1fe8`::moving from state preparing -> state finished >Thread-135431::DEBUG::2014-10-29 11:08:00,387::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135431::DEBUG::2014-10-29 11:08:00,387::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135431::DEBUG::2014-10-29 11:08:00,387::task::993::Storage.TaskManager.Task::(_decref) Task=`6eb3ff4f-88dd-4dbf-bbc5-4bab583c1fe8`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:08:01,035::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:01,036::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:01,036::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:01,036::__init__::232::IOProcess::(_processLogs) (199599) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:01,169::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:01,170::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:01,170::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:01,170::__init__::232::IOProcess::(_processLogs) (199600) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:01,187::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199600) Queuing response >Thread-179::DEBUG::2014-10-29 11:08:01,195::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:08:01,213::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199599) Queuing response >Thread-10269::DEBUG::2014-10-29 11:08:01,221::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:08:01,223::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000506504 s, 734 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:08:01,249::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-10269::DEBUG::2014-10-29 11:08:01,249::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000577373 s, 869 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:08:01,252::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:01,254::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:01,255::__init__::232::IOProcess::(_processLogs) (199601) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:01,261::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199601) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:01,268::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:01,274::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:01,276::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:01,278::__init__::232::IOProcess::(_processLogs) (199602) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:01,280::__init__::232::IOProcess::(_processLogs) (199602) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:01,283::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:01,284::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:01,284::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:01,284::__init__::232::IOProcess::(_processLogs) (199603) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:01,286::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199603) Queuing response >Thread-178::DEBUG::2014-10-29 11:08:01,287::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:08:01,305::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000432787 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:08:01,307::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:01,308::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:01,308::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:01,308::__init__::232::IOProcess::(_processLogs) (199604) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:01,308::__init__::232::IOProcess::(_processLogs) (199604) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:01,310::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:01,311::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:01,311::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:01,311::__init__::232::IOProcess::(_processLogs) (199605) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:01,312::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199605) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:01,313::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:01,313::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:01,314::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:01,314::__init__::232::IOProcess::(_processLogs) (199606) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:01,315::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199606) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:01,316::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:01,316::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:01,316::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:01,316::__init__::232::IOProcess::(_processLogs) (199607) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:01,317::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199607) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:01,341::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:01,342::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:01,342::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:01,342::__init__::232::IOProcess::(_processLogs) (199608) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:01,343::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199608) Queuing response >Thread-33::DEBUG::2014-10-29 11:08:01,344::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:08:01,362::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000525708 s, 926 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:08:01,364::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:01,364::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:01,364::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:01,364::__init__::232::IOProcess::(_processLogs) (199609) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:01,365::__init__::232::IOProcess::(_processLogs) (199609) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:01,367::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:01,367::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:01,368::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:01,368::__init__::232::IOProcess::(_processLogs) (199610) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:01,369::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199610) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:01,370::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:01,371::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:01,371::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:01,371::__init__::232::IOProcess::(_processLogs) (199611) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:01,372::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199611) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:01,373::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:01,373::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:01,373::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:01,374::__init__::232::IOProcess::(_processLogs) (199612) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:01,375::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199612) Queuing response >Thread-22::DEBUG::2014-10-29 11:08:01,421::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:02,552::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:02,554::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135432::DEBUG::2014-10-29 11:08:02,558::task::595::Storage.TaskManager.Task::(_updateState) Task=`8a35731f-db45-4dfd-9453-4b309d9b3b26`::moving from state init -> state preparing >Thread-135432::INFO::2014-10-29 11:08:02,558::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135432::INFO::2014-10-29 11:08:02,559::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000432787', 'lastCheck': '1.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525708', 'lastCheck': '1.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506504', 'lastCheck': '1.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000577373', 'lastCheck': '1.3', 'valid': True}} >Thread-135432::DEBUG::2014-10-29 11:08:02,560::task::1191::Storage.TaskManager.Task::(prepare) Task=`8a35731f-db45-4dfd-9453-4b309d9b3b26`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000432787', 'lastCheck': '1.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525708', 'lastCheck': '1.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506504', 'lastCheck': '1.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000577373', 'lastCheck': '1.3', 'valid': True}} >Thread-135432::DEBUG::2014-10-29 11:08:02,560::task::595::Storage.TaskManager.Task::(_updateState) Task=`8a35731f-db45-4dfd-9453-4b309d9b3b26`::moving from state preparing -> state finished >Thread-135432::DEBUG::2014-10-29 11:08:02,560::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135432::DEBUG::2014-10-29 11:08:02,560::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135432::DEBUG::2014-10-29 11:08:02,561::task::993::Storage.TaskManager.Task::(_decref) Task=`8a35731f-db45-4dfd-9453-4b309d9b3b26`::ref 0 aborting False >Thread-135432::DEBUG::2014-10-29 11:08:02,583::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:02,605::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:02,607::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135433::DEBUG::2014-10-29 11:08:02,610::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135433::DEBUG::2014-10-29 11:08:02,613::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:08:03,221::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:03,920::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:03,921::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:03,923::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:08:04,201::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53923 >Detector thread::DEBUG::2014-10-29 11:08:04,202::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53923 >Detector thread::DEBUG::2014-10-29 11:08:04,202::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53923 >Detector thread::DEBUG::2014-10-29 11:08:04,203::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53923) >Thread-135434::DEBUG::2014-10-29 11:08:04,242::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135434::DEBUG::2014-10-29 11:08:04,243::task::595::Storage.TaskManager.Task::(_updateState) Task=`12a60de8-ae9b-48b5-bf11-a3b79b0f450a`::moving from state init -> state preparing >Thread-135434::INFO::2014-10-29 11:08:04,244::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135434::DEBUG::2014-10-29 11:08:04,249::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:08:04,250::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:04,250::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:04,250::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:04,250::__init__::232::IOProcess::(_processLogs) (199613) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:08:04,251::__init__::232::IOProcess::(_processLogs) (199613) Queuing response >Thread-135434::DEBUG::2014-10-29 11:08:04,252::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135434::DEBUG::2014-10-29 11:08:04,252::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135434::INFO::2014-10-29 11:08:04,252::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135434::DEBUG::2014-10-29 11:08:04,253::task::1191::Storage.TaskManager.Task::(prepare) Task=`12a60de8-ae9b-48b5-bf11-a3b79b0f450a`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135434::DEBUG::2014-10-29 11:08:04,253::task::595::Storage.TaskManager.Task::(_updateState) Task=`12a60de8-ae9b-48b5-bf11-a3b79b0f450a`::moving from state preparing -> state finished >Thread-135434::DEBUG::2014-10-29 11:08:04,253::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135434::DEBUG::2014-10-29 11:08:04,253::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135434::DEBUG::2014-10-29 11:08:04,254::task::993::Storage.TaskManager.Task::(_decref) Task=`12a60de8-ae9b-48b5-bf11-a3b79b0f450a`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:08:04,298::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53924 >Detector thread::DEBUG::2014-10-29 11:08:04,299::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53924 >Detector thread::DEBUG::2014-10-29 11:08:04,299::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53924 >Detector thread::DEBUG::2014-10-29 11:08:04,299::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53924) >Thread-135435::DEBUG::2014-10-29 11:08:04,338::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135435::DEBUG::2014-10-29 11:08:04,338::task::595::Storage.TaskManager.Task::(_updateState) Task=`d17cea91-8dfc-455a-aee7-b40bc2920d84`::moving from state init -> state preparing >Thread-135435::INFO::2014-10-29 11:08:04,339::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135435::DEBUG::2014-10-29 11:08:04,339::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135435::DEBUG::2014-10-29 11:08:04,339::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135435::DEBUG::2014-10-29 11:08:04,340::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135435::DEBUG::2014-10-29 11:08:04,340::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135435::DEBUG::2014-10-29 11:08:04,340::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135435::DEBUG::2014-10-29 11:08:04,341::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135435::DEBUG::2014-10-29 11:08:04,435::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135435::DEBUG::2014-10-29 11:08:04,436::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135435::DEBUG::2014-10-29 11:08:04,619::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135435::DEBUG::2014-10-29 11:08:04,621::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135435::DEBUG::2014-10-29 11:08:04,622::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135435::DEBUG::2014-10-29 11:08:04,622::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135435::DEBUG::2014-10-29 11:08:04,623::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135435::DEBUG::2014-10-29 11:08:04,623::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135435::DEBUG::2014-10-29 11:08:04,623::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135435::DEBUG::2014-10-29 11:08:04,624::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:08:04,631::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:04,632::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:04,632::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:04,632::__init__::232::IOProcess::(_processLogs) (199614) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:08:04,634::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199614) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:04,636::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:04,636::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:04,637::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:04,637::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:04,637::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:04,640::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:04,641::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:04,641::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:04,641::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:04,641::__init__::232::IOProcess::(_processLogs) (199615) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:08:04,643::__init__::232::IOProcess::(_processLogs) (199616) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:08:04,645::__init__::232::IOProcess::(_processLogs) (199617) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:08:04,647::__init__::232::IOProcess::(_processLogs) (199616) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:04,647::__init__::232::IOProcess::(_processLogs) (199615) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:04,647::__init__::232::IOProcess::(_processLogs) (199617) Queuing response >Thread-135435::DEBUG::2014-10-29 11:08:04,652::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:08:04,653::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:04,653::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:04,653::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:04,654::__init__::232::IOProcess::(_processLogs) (199618) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:08:04,654::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199618) Queuing response >Thread-135435::DEBUG::2014-10-29 11:08:04,655::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:08:04,656::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:04,656::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:04,657::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:04,657::__init__::232::IOProcess::(_processLogs) (199619) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:08:04,658::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199619) Queuing response >Thread-135435::DEBUG::2014-10-29 11:08:04,658::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:08:04,660::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:04,661::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:04,662::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:04,662::__init__::232::IOProcess::(_processLogs) (199620) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:04,662::__init__::232::IOProcess::(_processLogs) (199620) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:04,662::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:04,663::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:04,663::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:04,663::__init__::232::IOProcess::(_processLogs) (199621) Got request for method 'glob' >Thread-135435::DEBUG::2014-10-29 11:08:04,664::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:08:04,664::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199621) Queuing response >Thread-135435::INFO::2014-10-29 11:08:04,665::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135435::INFO::2014-10-29 11:08:04,666::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135435::INFO::2014-10-29 11:08:04,666::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:08:04,667::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:04,667::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:04,668::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:04,668::__init__::232::IOProcess::(_processLogs) (199622) Got request for method 'readfile' >Thread-135435::DEBUG::2014-10-29 11:08:04,669::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:08:04,669::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199622) Queuing response >Thread-135435::DEBUG::2014-10-29 11:08:04,672::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`e05e39a7-c022-4f58-a6e1-6de7c3cf63c1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135435::DEBUG::2014-10-29 11:08:04,672::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135435::DEBUG::2014-10-29 11:08:04,672::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135435::DEBUG::2014-10-29 11:08:04,673::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`e05e39a7-c022-4f58-a6e1-6de7c3cf63c1`::Granted request >Thread-135435::DEBUG::2014-10-29 11:08:04,673::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d17cea91-8dfc-455a-aee7-b40bc2920d84`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135435::DEBUG::2014-10-29 11:08:04,674::task::993::Storage.TaskManager.Task::(_decref) Task=`d17cea91-8dfc-455a-aee7-b40bc2920d84`::ref 1 aborting False >Thread-135435::INFO::2014-10-29 11:08:04,676::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135435::DEBUG::2014-10-29 11:08:04,677::task::1191::Storage.TaskManager.Task::(prepare) Task=`d17cea91-8dfc-455a-aee7-b40bc2920d84`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135435::DEBUG::2014-10-29 11:08:04,677::task::595::Storage.TaskManager.Task::(_updateState) Task=`d17cea91-8dfc-455a-aee7-b40bc2920d84`::moving from state preparing -> state finished >Thread-135435::DEBUG::2014-10-29 11:08:04,677::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135435::DEBUG::2014-10-29 11:08:04,677::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135435::DEBUG::2014-10-29 11:08:04,678::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135435::DEBUG::2014-10-29 11:08:04,678::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135435::DEBUG::2014-10-29 11:08:04,678::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135435::DEBUG::2014-10-29 11:08:04,679::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135435::DEBUG::2014-10-29 11:08:04,679::task::993::Storage.TaskManager.Task::(_decref) Task=`d17cea91-8dfc-455a-aee7-b40bc2920d84`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:08:04,712::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53925 >Detector thread::DEBUG::2014-10-29 11:08:04,712::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53925 >Detector thread::DEBUG::2014-10-29 11:08:04,713::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53925 >Detector thread::DEBUG::2014-10-29 11:08:04,713::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53925) >Thread-135440::DEBUG::2014-10-29 11:08:04,752::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135440::DEBUG::2014-10-29 11:08:04,753::task::595::Storage.TaskManager.Task::(_updateState) Task=`3b23dc51-6cc5-4201-93ed-2eb2d143b903`::moving from state init -> state preparing >Thread-135440::INFO::2014-10-29 11:08:04,753::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135440::INFO::2014-10-29 11:08:04,754::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000432787', 'lastCheck': '3.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525708', 'lastCheck': '3.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506504', 'lastCheck': '3.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000577373', 'lastCheck': '3.5', 'valid': True}} >Thread-135440::DEBUG::2014-10-29 11:08:04,754::task::1191::Storage.TaskManager.Task::(prepare) Task=`3b23dc51-6cc5-4201-93ed-2eb2d143b903`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000432787', 'lastCheck': '3.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525708', 'lastCheck': '3.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506504', 'lastCheck': '3.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000577373', 'lastCheck': '3.5', 'valid': True}} >Thread-135440::DEBUG::2014-10-29 11:08:04,754::task::595::Storage.TaskManager.Task::(_updateState) Task=`3b23dc51-6cc5-4201-93ed-2eb2d143b903`::moving from state preparing -> state finished >Thread-135440::DEBUG::2014-10-29 11:08:04,755::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135440::DEBUG::2014-10-29 11:08:04,755::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135440::DEBUG::2014-10-29 11:08:04,755::task::993::Storage.TaskManager.Task::(_decref) Task=`3b23dc51-6cc5-4201-93ed-2eb2d143b903`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:05,665::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:05,668::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135441::DEBUG::2014-10-29 11:08:05,672::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:05,674::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:05,676::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135442::DEBUG::2014-10-29 11:08:05,681::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135442::DEBUG::2014-10-29 11:08:05,684::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:08,706::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:08,709::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135443::DEBUG::2014-10-29 11:08:08,711::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:08,714::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:08,715::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135444::DEBUG::2014-10-29 11:08:08,718::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135444::DEBUG::2014-10-29 11:08:08,720::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:08,932::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:08,933::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:08,935::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:08:09,314::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53926 >Detector thread::DEBUG::2014-10-29 11:08:09,314::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53926 >Detector thread::DEBUG::2014-10-29 11:08:09,315::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53926 >Detector thread::DEBUG::2014-10-29 11:08:09,315::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53926) >Thread-135445::DEBUG::2014-10-29 11:08:09,354::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135445::DEBUG::2014-10-29 11:08:09,356::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135445::DEBUG::2014-10-29 11:08:09,376::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135445::DEBUG::2014-10-29 11:08:09,424::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '198', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '98', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:08:10,102::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53927 >Detector thread::DEBUG::2014-10-29 11:08:10,103::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53927 >Detector thread::DEBUG::2014-10-29 11:08:10,103::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53927 >Detector thread::DEBUG::2014-10-29 11:08:10,104::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53927) >Thread-135446::DEBUG::2014-10-29 11:08:10,142::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135446::DEBUG::2014-10-29 11:08:10,144::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135446::DEBUG::2014-10-29 11:08:10,144::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.81', 'elapsedTime': '513522', 'displayType': 'vnc', 'cpuSys': '1.13', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '41349652', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '64848', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '31636.46'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.72', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:08:10,320::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53929 >Detector thread::DEBUG::2014-10-29 11:08:10,321::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53929 >Detector thread::DEBUG::2014-10-29 11:08:10,321::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53929 >Detector thread::DEBUG::2014-10-29 11:08:10,321::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53929) >Thread-135447::DEBUG::2014-10-29 11:08:10,361::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ba5ec85-9200-4917-8461-7ce4e7268957`::moving from state init -> state preparing >Thread-135447::INFO::2014-10-29 11:08:10,361::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135447::INFO::2014-10-29 11:08:10,362::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000432787', 'lastCheck': '9.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525708', 'lastCheck': '9.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506504', 'lastCheck': '9.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000577373', 'lastCheck': '9.1', 'valid': True}} >Thread-135447::DEBUG::2014-10-29 11:08:10,362::task::1191::Storage.TaskManager.Task::(prepare) Task=`6ba5ec85-9200-4917-8461-7ce4e7268957`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000432787', 'lastCheck': '9.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525708', 'lastCheck': '9.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506504', 'lastCheck': '9.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000577373', 'lastCheck': '9.1', 'valid': True}} >Thread-135447::DEBUG::2014-10-29 11:08:10,363::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ba5ec85-9200-4917-8461-7ce4e7268957`::moving from state preparing -> state finished >Thread-135447::DEBUG::2014-10-29 11:08:10,363::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135447::DEBUG::2014-10-29 11:08:10,363::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135447::DEBUG::2014-10-29 11:08:10,363::task::993::Storage.TaskManager.Task::(_decref) Task=`6ba5ec85-9200-4917-8461-7ce4e7268957`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:08:11,268::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:11,268::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:11,268::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:11,269::__init__::232::IOProcess::(_processLogs) (199623) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:11,269::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199623) Queuing response >Thread-179::DEBUG::2014-10-29 11:08:11,271::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:08:11,290::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000515572 s, 722 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:08:11,291::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:11,293::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:11,294::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:11,295::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199624) Got request for method 'statvfs' >Thread-10269::DEBUG::2014-10-29 11:08:11,296::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:08:11,314::__init__::232::IOProcess::(_processLogs) (199624) Queuing response >Thread-10269::DEBUG::2014-10-29 11:08:11,318::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000452461 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:08:11,318::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:11,322::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:11,322::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:11,322::__init__::232::IOProcess::(_processLogs) (199625) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:11,324::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199625) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:11,326::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:11,326::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:11,326::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:11,327::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:11,328::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:11,328::__init__::232::IOProcess::(_processLogs) (199626) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:11,330::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-178::DEBUG::2014-10-29 11:08:11,331::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:08:11,332::__init__::232::IOProcess::(_processLogs) (199627) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:11,348::__init__::232::IOProcess::(_processLogs) (199626) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:11,351::__init__::232::IOProcess::(_processLogs) (199627) Queuing response >Thread-178::DEBUG::2014-10-29 11:08:11,351::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000503219 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:08:11,358::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:11,359::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:11,359::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:11,359::__init__::232::IOProcess::(_processLogs) (199628) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:11,361::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199628) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:11,362::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:11,363::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:11,364::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:11,364::__init__::232::IOProcess::(_processLogs) (199629) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:11,365::__init__::232::IOProcess::(_processLogs) (199629) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:11,365::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:11,366::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:11,367::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:11,367::__init__::232::IOProcess::(_processLogs) (199630) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:11,367::__init__::232::IOProcess::(_processLogs) (199630) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:11,368::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:11,369::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:11,369::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:11,370::__init__::232::IOProcess::(_processLogs) (199631) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:11,371::__init__::232::IOProcess::(_processLogs) (199631) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:11,376::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:11,377::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:11,378::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:11,379::__init__::232::IOProcess::(_processLogs) (199632) Got request for method 'statvfs' >Thread-33::DEBUG::2014-10-29 11:08:11,380::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:08:11,380::__init__::232::IOProcess::(_processLogs) (199632) Queuing response >Thread-33::DEBUG::2014-10-29 11:08:11,400::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00152718 s, 319 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:08:11,401::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:11,402::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:11,402::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:11,402::__init__::232::IOProcess::(_processLogs) (199633) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:11,404::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199633) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:11,406::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:11,406::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:11,407::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:11,407::__init__::232::IOProcess::(_processLogs) (199634) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:11,408::__init__::232::IOProcess::(_processLogs) (199634) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:11,408::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:11,409::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:11,409::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:11,410::__init__::232::IOProcess::(_processLogs) (199635) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:11,410::__init__::232::IOProcess::(_processLogs) (199635) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:11,411::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:11,411::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:11,411::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:11,412::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199636) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:11,413::__init__::232::IOProcess::(_processLogs) (199636) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:11,737::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:11,739::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135448::DEBUG::2014-10-29 11:08:11,743::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:11,745::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:11,747::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135449::DEBUG::2014-10-29 11:08:11,750::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135449::DEBUG::2014-10-29 11:08:11,752::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:13,942::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:13,944::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:13,945::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:14,769::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:14,772::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135450::DEBUG::2014-10-29 11:08:14,776::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:14,779::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:14,781::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135451::DEBUG::2014-10-29 11:08:14,784::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135451::DEBUG::2014-10-29 11:08:14,786::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:08:15,299::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53931 >Detector thread::DEBUG::2014-10-29 11:08:15,300::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53931 >Detector thread::DEBUG::2014-10-29 11:08:15,300::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53931 >Detector thread::DEBUG::2014-10-29 11:08:15,301::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53931) >Thread-135452::DEBUG::2014-10-29 11:08:15,341::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135452::DEBUG::2014-10-29 11:08:15,342::task::595::Storage.TaskManager.Task::(_updateState) Task=`6349a19c-79d1-4c80-af8a-3c5008931b66`::moving from state init -> state preparing >Thread-135452::INFO::2014-10-29 11:08:15,342::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135452::DEBUG::2014-10-29 11:08:15,357::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:08:15,358::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:15,358::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:15,358::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:15,359::__init__::232::IOProcess::(_processLogs) (199637) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:08:16,290::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199637) Queuing response >Thread-135452::DEBUG::2014-10-29 11:08:16,304::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135452::DEBUG::2014-10-29 11:08:16,306::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135452::INFO::2014-10-29 11:08:16,307::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135452::DEBUG::2014-10-29 11:08:16,309::task::1191::Storage.TaskManager.Task::(prepare) Task=`6349a19c-79d1-4c80-af8a-3c5008931b66`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135452::DEBUG::2014-10-29 11:08:16,310::task::595::Storage.TaskManager.Task::(_updateState) Task=`6349a19c-79d1-4c80-af8a-3c5008931b66`::moving from state preparing -> state finished >Thread-135452::DEBUG::2014-10-29 11:08:16,311::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135452::DEBUG::2014-10-29 11:08:16,312::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135452::DEBUG::2014-10-29 11:08:16,313::task::993::Storage.TaskManager.Task::(_decref) Task=`6349a19c-79d1-4c80-af8a-3c5008931b66`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:08:16,362::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53932 >Detector thread::DEBUG::2014-10-29 11:08:16,362::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53932 >Detector thread::DEBUG::2014-10-29 11:08:16,363::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53932 >Detector thread::DEBUG::2014-10-29 11:08:16,363::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53932) >Thread-135453::DEBUG::2014-10-29 11:08:16,403::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135453::DEBUG::2014-10-29 11:08:16,405::task::595::Storage.TaskManager.Task::(_updateState) Task=`7151cd93-3d92-405e-ad29-c9dbaae3272d`::moving from state init -> state preparing >Thread-135453::INFO::2014-10-29 11:08:16,406::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135453::DEBUG::2014-10-29 11:08:16,408::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135453::DEBUG::2014-10-29 11:08:16,409::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135453::DEBUG::2014-10-29 11:08:16,409::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135453::DEBUG::2014-10-29 11:08:16,411::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135453::DEBUG::2014-10-29 11:08:16,412::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135453::DEBUG::2014-10-29 11:08:16,414::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-22::DEBUG::2014-10-29 11:08:16,467::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-135453::DEBUG::2014-10-29 11:08:16,503::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135453::DEBUG::2014-10-29 11:08:16,506::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135453::DEBUG::2014-10-29 11:08:16,681::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135453::DEBUG::2014-10-29 11:08:16,685::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135453::DEBUG::2014-10-29 11:08:16,687::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135453::DEBUG::2014-10-29 11:08:16,690::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135453::DEBUG::2014-10-29 11:08:16,692::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135453::DEBUG::2014-10-29 11:08:16,695::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135453::DEBUG::2014-10-29 11:08:16,697::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135453::DEBUG::2014-10-29 11:08:16,699::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:08:16,711::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:16,713::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:16,715::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:16,716::__init__::232::IOProcess::(_processLogs) (199638) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:08:16,719::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199638) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:16,721::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:16,723::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:16,726::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:16,728::__init__::232::IOProcess::(_processLogs) (199639) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:08:16,731::__init__::232::IOProcess::(_processLogs) (199639) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:16,734::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:16,736::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:16,738::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:16,741::__init__::232::IOProcess::(_processLogs) (199640) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:08:16,747::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199640) Queuing response >Thread-135453::DEBUG::2014-10-29 11:08:16,748::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:08:16,752::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:16,753::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:16,754::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:16,756::__init__::232::IOProcess::(_processLogs) (199641) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:08:16,759::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199641) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:16,762::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:16,764::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-135453::DEBUG::2014-10-29 11:08:16,766::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:08:16,767::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:16,770::__init__::232::IOProcess::(_processLogs) (199642) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:08:16,771::__init__::232::IOProcess::(_processLogs) (199642) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:16,774::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:16,775::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:16,776::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:16,777::__init__::232::IOProcess::(_processLogs) (199643) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:08:16,780::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199643) Queuing response >Thread-135453::DEBUG::2014-10-29 11:08:16,781::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:08:16,788::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:16,789::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:16,791::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:16,793::__init__::232::IOProcess::(_processLogs) (199644) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:16,794::__init__::232::IOProcess::(_processLogs) (199644) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:16,799::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:16,801::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:16,802::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:16,803::__init__::232::IOProcess::(_processLogs) (199645) Got request for method 'glob' >Thread-135453::DEBUG::2014-10-29 11:08:16,807::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:08:16,807::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199645) Queuing response >Thread-135453::INFO::2014-10-29 11:08:16,809::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135453::INFO::2014-10-29 11:08:16,810::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135453::INFO::2014-10-29 11:08:16,812::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:08:16,815::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:16,817::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:16,818::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:16,820::__init__::232::IOProcess::(_processLogs) (199646) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:08:16,823::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199646) Queuing response >Thread-135453::DEBUG::2014-10-29 11:08:16,823::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135453::DEBUG::2014-10-29 11:08:16,831::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`e95c538d-6561-4dda-8895-17bbc1713727`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135453::DEBUG::2014-10-29 11:08:16,832::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135453::DEBUG::2014-10-29 11:08:16,835::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135453::DEBUG::2014-10-29 11:08:16,836::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`e95c538d-6561-4dda-8895-17bbc1713727`::Granted request >Thread-135453::DEBUG::2014-10-29 11:08:16,839::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7151cd93-3d92-405e-ad29-c9dbaae3272d`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135453::DEBUG::2014-10-29 11:08:16,841::task::993::Storage.TaskManager.Task::(_decref) Task=`7151cd93-3d92-405e-ad29-c9dbaae3272d`::ref 1 aborting False >Thread-135453::INFO::2014-10-29 11:08:16,854::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135453::DEBUG::2014-10-29 11:08:16,856::task::1191::Storage.TaskManager.Task::(prepare) Task=`7151cd93-3d92-405e-ad29-c9dbaae3272d`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135453::DEBUG::2014-10-29 11:08:16,857::task::595::Storage.TaskManager.Task::(_updateState) Task=`7151cd93-3d92-405e-ad29-c9dbaae3272d`::moving from state preparing -> state finished >Thread-135453::DEBUG::2014-10-29 11:08:16,858::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135453::DEBUG::2014-10-29 11:08:16,859::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135453::DEBUG::2014-10-29 11:08:16,862::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135453::DEBUG::2014-10-29 11:08:16,864::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135453::DEBUG::2014-10-29 11:08:16,865::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135453::DEBUG::2014-10-29 11:08:16,866::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135453::DEBUG::2014-10-29 11:08:16,868::task::993::Storage.TaskManager.Task::(_decref) Task=`7151cd93-3d92-405e-ad29-c9dbaae3272d`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:08:16,896::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53933 >Detector thread::DEBUG::2014-10-29 11:08:16,896::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53933 >Detector thread::DEBUG::2014-10-29 11:08:16,897::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53933 >Detector thread::DEBUG::2014-10-29 11:08:16,897::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53933) >Thread-135458::DEBUG::2014-10-29 11:08:16,936::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135458::DEBUG::2014-10-29 11:08:16,939::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c329985-b0ce-419f-abcf-2d1de15d5a8e`::moving from state init -> state preparing >Thread-135458::INFO::2014-10-29 11:08:16,940::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135458::INFO::2014-10-29 11:08:16,943::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503219', 'lastCheck': '5.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00152718', 'lastCheck': '5.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515572', 'lastCheck': '5.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000452461', 'lastCheck': '5.6', 'valid': True}} >Thread-135458::DEBUG::2014-10-29 11:08:16,945::task::1191::Storage.TaskManager.Task::(prepare) Task=`4c329985-b0ce-419f-abcf-2d1de15d5a8e`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503219', 'lastCheck': '5.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00152718', 'lastCheck': '5.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515572', 'lastCheck': '5.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000452461', 'lastCheck': '5.6', 'valid': True}} >Thread-135458::DEBUG::2014-10-29 11:08:16,946::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c329985-b0ce-419f-abcf-2d1de15d5a8e`::moving from state preparing -> state finished >Thread-135458::DEBUG::2014-10-29 11:08:16,947::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135458::DEBUG::2014-10-29 11:08:16,948::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135458::DEBUG::2014-10-29 11:08:16,949::task::993::Storage.TaskManager.Task::(_decref) Task=`4c329985-b0ce-419f-abcf-2d1de15d5a8e`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:17,802::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:17,804::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135459::DEBUG::2014-10-29 11:08:17,807::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b4d1ef1-6474-4253-95e9-397baa4e8690`::moving from state init -> state preparing >Thread-135459::INFO::2014-10-29 11:08:17,808::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135459::INFO::2014-10-29 11:08:17,808::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503219', 'lastCheck': '6.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00152718', 'lastCheck': '6.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515572', 'lastCheck': '6.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000452461', 'lastCheck': '6.5', 'valid': True}} >Thread-135459::DEBUG::2014-10-29 11:08:17,809::task::1191::Storage.TaskManager.Task::(prepare) Task=`0b4d1ef1-6474-4253-95e9-397baa4e8690`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503219', 'lastCheck': '6.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00152718', 'lastCheck': '6.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515572', 'lastCheck': '6.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000452461', 'lastCheck': '6.5', 'valid': True}} >Thread-135459::DEBUG::2014-10-29 11:08:17,809::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b4d1ef1-6474-4253-95e9-397baa4e8690`::moving from state preparing -> state finished >Thread-135459::DEBUG::2014-10-29 11:08:17,809::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135459::DEBUG::2014-10-29 11:08:17,809::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135459::DEBUG::2014-10-29 11:08:17,810::task::993::Storage.TaskManager.Task::(_decref) Task=`0b4d1ef1-6474-4253-95e9-397baa4e8690`::ref 0 aborting False >Thread-135459::DEBUG::2014-10-29 11:08:17,839::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:17,867::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:17,869::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135460::DEBUG::2014-10-29 11:08:17,873::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135460::DEBUG::2014-10-29 11:08:17,875::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:18,952::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:18,953::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:18,956::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:08:19,295::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53934 >Detector thread::DEBUG::2014-10-29 11:08:19,296::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53934 >Detector thread::DEBUG::2014-10-29 11:08:19,296::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53934 >Detector thread::DEBUG::2014-10-29 11:08:19,297::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53934) >Thread-135461::DEBUG::2014-10-29 11:08:19,335::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135461::DEBUG::2014-10-29 11:08:19,336::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135461::DEBUG::2014-10-29 11:08:19,337::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.82', 'elapsedTime': '513531', 'displayType': 'vnc', 'cpuSys': '1.06', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '41349652', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '64848', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '31636.46'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.87', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:08:19,481::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53936 >Detector thread::DEBUG::2014-10-29 11:08:19,481::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53936 >Detector thread::DEBUG::2014-10-29 11:08:19,482::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53936 >Detector thread::DEBUG::2014-10-29 11:08:19,482::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53936) >Thread-135462::DEBUG::2014-10-29 11:08:19,521::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135462::DEBUG::2014-10-29 11:08:19,522::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135462::DEBUG::2014-10-29 11:08:19,540::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135462::DEBUG::2014-10-29 11:08:19,608::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '180', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '80', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:08:20,440::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53937 >Detector thread::DEBUG::2014-10-29 11:08:20,441::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53937 >Detector thread::DEBUG::2014-10-29 11:08:20,441::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53937 >Detector thread::DEBUG::2014-10-29 11:08:20,441::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53937) >Thread-135463::DEBUG::2014-10-29 11:08:20,481::task::595::Storage.TaskManager.Task::(_updateState) Task=`9fc7c2f7-d19e-41d6-8528-5c197f68cb43`::moving from state init -> state preparing >Thread-135463::INFO::2014-10-29 11:08:20,481::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135463::INFO::2014-10-29 11:08:20,482::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503219', 'lastCheck': '9.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00152718', 'lastCheck': '9.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515572', 'lastCheck': '9.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000452461', 'lastCheck': '9.1', 'valid': True}} >Thread-135463::DEBUG::2014-10-29 11:08:20,482::task::1191::Storage.TaskManager.Task::(prepare) Task=`9fc7c2f7-d19e-41d6-8528-5c197f68cb43`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503219', 'lastCheck': '9.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00152718', 'lastCheck': '9.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515572', 'lastCheck': '9.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000452461', 'lastCheck': '9.1', 'valid': True}} >Thread-135463::DEBUG::2014-10-29 11:08:20,483::task::595::Storage.TaskManager.Task::(_updateState) Task=`9fc7c2f7-d19e-41d6-8528-5c197f68cb43`::moving from state preparing -> state finished >Thread-135463::DEBUG::2014-10-29 11:08:20,483::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135463::DEBUG::2014-10-29 11:08:20,483::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135463::DEBUG::2014-10-29 11:08:20,483::task::993::Storage.TaskManager.Task::(_decref) Task=`9fc7c2f7-d19e-41d6-8528-5c197f68cb43`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:08:21,329::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:21,329::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:21,330::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:21,330::__init__::232::IOProcess::(_processLogs) (199647) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:21,331::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199647) Queuing response >Thread-179::DEBUG::2014-10-29 11:08:21,332::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:08:21,349::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000498982 s, 746 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:08:21,351::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:21,352::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:21,352::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:21,352::__init__::232::IOProcess::(_processLogs) (199648) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:21,352::__init__::232::IOProcess::(_processLogs) (199648) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:21,359::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:21,360::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:21,360::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:21,360::__init__::232::IOProcess::(_processLogs) (199649) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:21,361::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199649) Queuing response >Thread-10269::DEBUG::2014-10-29 11:08:21,363::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:08:21,383::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-10269::DEBUG::2014-10-29 11:08:21,383::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000436475 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:08:21,385::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:21,386::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:21,386::__init__::232::IOProcess::(_processLogs) (199650) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:21,388::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199650) Queuing response >Thread-178::DEBUG::2014-10-29 11:08:21,389::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:08:21,408::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:21,413::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-178::DEBUG::2014-10-29 11:08:21,413::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000522664 s, 972 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:08:21,416::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:21,417::__init__::232::IOProcess::(_processLogs) (199651) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:21,418::__init__::232::IOProcess::(_processLogs) (199651) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:21,418::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:21,419::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:21,419::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:21,419::__init__::232::IOProcess::(_processLogs) (199652) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:21,421::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199652) Queuing response >Thread-33::DEBUG::2014-10-29 11:08:21,423::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:08:21,423::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:21,441::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:21,441::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:21,442::__init__::232::IOProcess::(_processLogs) (199653) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:21,442::__init__::232::IOProcess::(_processLogs) (199653) Queuing response >Thread-33::DEBUG::2014-10-29 11:08:21,444::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000608292 s, 801 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:08:21,450::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:21,450::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:21,450::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:21,451::__init__::232::IOProcess::(_processLogs) (199654) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:21,452::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199654) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:21,453::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:21,453::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:21,454::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:21,454::__init__::232::IOProcess::(_processLogs) (199655) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:21,454::__init__::232::IOProcess::(_processLogs) (199655) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:21,456::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:21,456::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:21,457::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:21,457::__init__::232::IOProcess::(_processLogs) (199656) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:21,458::__init__::232::IOProcess::(_processLogs) (199656) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:21,458::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:21,459::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:21,460::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:21,460::__init__::232::IOProcess::(_processLogs) (199657) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:21,460::__init__::232::IOProcess::(_processLogs) (199657) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:21,460::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:21,461::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:21,462::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:21,462::__init__::232::IOProcess::(_processLogs) (199658) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:21,463::__init__::232::IOProcess::(_processLogs) (199658) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:21,463::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:21,464::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:21,464::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:21,466::__init__::232::IOProcess::(_processLogs) (199659) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:21,466::__init__::232::IOProcess::(_processLogs) (199659) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:21,467::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:21,467::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:21,469::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:21,469::__init__::232::IOProcess::(_processLogs) (199660) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:21,469::__init__::232::IOProcess::(_processLogs) (199660) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:22,342::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:22,344::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135464::DEBUG::2014-10-29 11:08:22,348::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:22,350::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:22,352::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135465::DEBUG::2014-10-29 11:08:22,355::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135465::DEBUG::2014-10-29 11:08:22,358::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:23,963::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:23,965::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:23,966::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:25,383::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:25,386::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135466::DEBUG::2014-10-29 11:08:25,390::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:25,393::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:25,395::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135467::DEBUG::2014-10-29 11:08:25,398::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135467::DEBUG::2014-10-29 11:08:25,400::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:08:27,667::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53939 >Detector thread::DEBUG::2014-10-29 11:08:27,667::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53939 >Detector thread::DEBUG::2014-10-29 11:08:27,668::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53939 >Detector thread::DEBUG::2014-10-29 11:08:27,668::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53939) >Thread-135468::DEBUG::2014-10-29 11:08:27,708::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135468::DEBUG::2014-10-29 11:08:27,709::task::595::Storage.TaskManager.Task::(_updateState) Task=`314ea21f-11c7-4f8e-a44e-5a97eb068832`::moving from state init -> state preparing >Thread-135468::INFO::2014-10-29 11:08:27,710::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135468::DEBUG::2014-10-29 11:08:27,712::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:08:27,713::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:27,714::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:27,714::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:27,714::__init__::232::IOProcess::(_processLogs) (199661) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:08:27,716::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199661) Queuing response >Thread-135468::DEBUG::2014-10-29 11:08:27,716::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135468::DEBUG::2014-10-29 11:08:27,718::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135468::INFO::2014-10-29 11:08:27,718::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135468::DEBUG::2014-10-29 11:08:27,718::task::1191::Storage.TaskManager.Task::(prepare) Task=`314ea21f-11c7-4f8e-a44e-5a97eb068832`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135468::DEBUG::2014-10-29 11:08:27,718::task::595::Storage.TaskManager.Task::(_updateState) Task=`314ea21f-11c7-4f8e-a44e-5a97eb068832`::moving from state preparing -> state finished >Thread-135468::DEBUG::2014-10-29 11:08:27,719::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135468::DEBUG::2014-10-29 11:08:27,719::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135468::DEBUG::2014-10-29 11:08:27,719::task::993::Storage.TaskManager.Task::(_decref) Task=`314ea21f-11c7-4f8e-a44e-5a97eb068832`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:08:27,762::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53940 >Detector thread::DEBUG::2014-10-29 11:08:27,763::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53940 >Detector thread::DEBUG::2014-10-29 11:08:27,763::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53940 >Detector thread::DEBUG::2014-10-29 11:08:27,764::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53940) >Thread-135469::DEBUG::2014-10-29 11:08:27,802::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135469::DEBUG::2014-10-29 11:08:27,803::task::595::Storage.TaskManager.Task::(_updateState) Task=`4cc12efd-d4c6-4266-86cd-9327b896bc12`::moving from state init -> state preparing >Thread-135469::INFO::2014-10-29 11:08:27,803::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135469::DEBUG::2014-10-29 11:08:27,803::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135469::DEBUG::2014-10-29 11:08:27,804::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135469::DEBUG::2014-10-29 11:08:27,804::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135469::DEBUG::2014-10-29 11:08:27,804::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135469::DEBUG::2014-10-29 11:08:27,804::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135469::DEBUG::2014-10-29 11:08:27,805::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135469::DEBUG::2014-10-29 11:08:27,895::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135469::DEBUG::2014-10-29 11:08:27,896::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135469::DEBUG::2014-10-29 11:08:28,073::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135469::DEBUG::2014-10-29 11:08:28,074::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135469::DEBUG::2014-10-29 11:08:28,074::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135469::DEBUG::2014-10-29 11:08:28,075::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135469::DEBUG::2014-10-29 11:08:28,075::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135469::DEBUG::2014-10-29 11:08:28,075::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135469::DEBUG::2014-10-29 11:08:28,076::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135469::DEBUG::2014-10-29 11:08:28,076::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:08:28,082::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:28,085::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:28,085::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:28,086::__init__::232::IOProcess::(_processLogs) (199662) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:08:28,087::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199662) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:28,089::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:28,089::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:28,089::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:28,090::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:28,090::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:28,090::__init__::232::IOProcess::(_processLogs) (199663) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:08:28,096::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:28,098::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:28,100::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:28,102::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:28,103::__init__::232::IOProcess::(_processLogs) (199665) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:08:28,105::__init__::232::IOProcess::(_processLogs) (199664) Got request for method 'glob' >Thread-135469::DEBUG::2014-10-29 11:08:28,106::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:08:28,107::__init__::232::IOProcess::(_processLogs) (199663) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:28,108::__init__::232::IOProcess::(_processLogs) (199664) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:28,109::__init__::232::IOProcess::(_processLogs) (199665) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:28,109::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:28,109::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:28,110::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:28,110::__init__::232::IOProcess::(_processLogs) (199666) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:08:28,112::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199666) Queuing response >Thread-135469::DEBUG::2014-10-29 11:08:28,113::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:08:28,114::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:28,114::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:28,114::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:28,115::__init__::232::IOProcess::(_processLogs) (199667) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:08:28,115::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199667) Queuing response >Thread-135469::DEBUG::2014-10-29 11:08:28,116::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:08:28,118::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:28,119::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:28,119::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:28,120::__init__::232::IOProcess::(_processLogs) (199668) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:28,120::__init__::232::IOProcess::(_processLogs) (199668) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:28,120::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:28,121::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:28,121::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:28,121::__init__::232::IOProcess::(_processLogs) (199669) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:08:28,122::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199669) Queuing response >Thread-135469::DEBUG::2014-10-29 11:08:28,122::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-135469::INFO::2014-10-29 11:08:28,123::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135469::INFO::2014-10-29 11:08:28,124::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135469::INFO::2014-10-29 11:08:28,124::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:08:28,125::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:28,125::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:28,125::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:28,126::__init__::232::IOProcess::(_processLogs) (199670) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:08:28,127::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199670) Queuing response >Thread-135469::DEBUG::2014-10-29 11:08:28,128::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135469::DEBUG::2014-10-29 11:08:28,130::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`62862927-12ab-493c-89ca-c1db3a87ea1f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135469::DEBUG::2014-10-29 11:08:28,130::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135469::DEBUG::2014-10-29 11:08:28,131::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135469::DEBUG::2014-10-29 11:08:28,131::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`62862927-12ab-493c-89ca-c1db3a87ea1f`::Granted request >Thread-135469::DEBUG::2014-10-29 11:08:28,132::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4cc12efd-d4c6-4266-86cd-9327b896bc12`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135469::DEBUG::2014-10-29 11:08:28,132::task::993::Storage.TaskManager.Task::(_decref) Task=`4cc12efd-d4c6-4266-86cd-9327b896bc12`::ref 1 aborting False >Thread-135469::INFO::2014-10-29 11:08:28,135::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135469::DEBUG::2014-10-29 11:08:28,135::task::1191::Storage.TaskManager.Task::(prepare) Task=`4cc12efd-d4c6-4266-86cd-9327b896bc12`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135469::DEBUG::2014-10-29 11:08:28,135::task::595::Storage.TaskManager.Task::(_updateState) Task=`4cc12efd-d4c6-4266-86cd-9327b896bc12`::moving from state preparing -> state finished >Thread-135469::DEBUG::2014-10-29 11:08:28,136::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135469::DEBUG::2014-10-29 11:08:28,136::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135469::DEBUG::2014-10-29 11:08:28,136::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135469::DEBUG::2014-10-29 11:08:28,136::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135469::DEBUG::2014-10-29 11:08:28,137::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135469::DEBUG::2014-10-29 11:08:28,137::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135469::DEBUG::2014-10-29 11:08:28,137::task::993::Storage.TaskManager.Task::(_decref) Task=`4cc12efd-d4c6-4266-86cd-9327b896bc12`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:08:28,159::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53941 >Detector thread::DEBUG::2014-10-29 11:08:28,160::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53941 >Detector thread::DEBUG::2014-10-29 11:08:28,160::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53941 >Detector thread::DEBUG::2014-10-29 11:08:28,160::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53941) >Thread-135474::DEBUG::2014-10-29 11:08:28,199::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135474::DEBUG::2014-10-29 11:08:28,200::task::595::Storage.TaskManager.Task::(_updateState) Task=`fff88fb2-05ca-4ecc-80f3-85dde4440330`::moving from state init -> state preparing >Thread-135474::INFO::2014-10-29 11:08:28,200::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135474::INFO::2014-10-29 11:08:28,201::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522664', 'lastCheck': '6.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000608292', 'lastCheck': '6.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000498982', 'lastCheck': '6.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000436475', 'lastCheck': '6.8', 'valid': True}} >Thread-135474::DEBUG::2014-10-29 11:08:28,201::task::1191::Storage.TaskManager.Task::(prepare) Task=`fff88fb2-05ca-4ecc-80f3-85dde4440330`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522664', 'lastCheck': '6.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000608292', 'lastCheck': '6.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000498982', 'lastCheck': '6.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000436475', 'lastCheck': '6.8', 'valid': True}} >Thread-135474::DEBUG::2014-10-29 11:08:28,201::task::595::Storage.TaskManager.Task::(_updateState) Task=`fff88fb2-05ca-4ecc-80f3-85dde4440330`::moving from state preparing -> state finished >Thread-135474::DEBUG::2014-10-29 11:08:28,201::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135474::DEBUG::2014-10-29 11:08:28,202::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135474::DEBUG::2014-10-29 11:08:28,202::task::993::Storage.TaskManager.Task::(_decref) Task=`fff88fb2-05ca-4ecc-80f3-85dde4440330`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:28,424::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:28,428::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135475::DEBUG::2014-10-29 11:08:28,432::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:28,435::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:28,436::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135476::DEBUG::2014-10-29 11:08:28,439::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135476::DEBUG::2014-10-29 11:08:28,442::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:28,974::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:28,975::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:28,978::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:08:29,491::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53942 >Detector thread::DEBUG::2014-10-29 11:08:29,492::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53942 >Detector thread::DEBUG::2014-10-29 11:08:29,493::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53942 >Detector thread::DEBUG::2014-10-29 11:08:29,493::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53942) >Thread-135477::DEBUG::2014-10-29 11:08:29,532::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135477::DEBUG::2014-10-29 11:08:29,533::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135477::DEBUG::2014-10-29 11:08:29,534::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.82', 'elapsedTime': '513542', 'displayType': 'vnc', 'cpuSys': '1.06', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '41349652', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '64848', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '31636.46'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.06', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:08:29,659::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53944 >Detector thread::DEBUG::2014-10-29 11:08:29,660::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53944 >Detector thread::DEBUG::2014-10-29 11:08:29,661::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53944 >Detector thread::DEBUG::2014-10-29 11:08:29,661::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53944) >Thread-135478::DEBUG::2014-10-29 11:08:29,700::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135478::DEBUG::2014-10-29 11:08:29,702::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135478::DEBUG::2014-10-29 11:08:29,721::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135478::DEBUG::2014-10-29 11:08:29,769::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '164', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '64', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:08:30,544::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53945 >Detector thread::DEBUG::2014-10-29 11:08:30,545::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53945 >Detector thread::DEBUG::2014-10-29 11:08:30,545::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53945 >Detector thread::DEBUG::2014-10-29 11:08:30,545::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53945) >Thread-135479::DEBUG::2014-10-29 11:08:30,585::task::595::Storage.TaskManager.Task::(_updateState) Task=`32eeb152-3f27-4b9f-b650-2d024b1d7ef5`::moving from state init -> state preparing >Thread-135479::INFO::2014-10-29 11:08:30,585::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135479::INFO::2014-10-29 11:08:30,586::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522664', 'lastCheck': '9.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000608292', 'lastCheck': '9.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000498982', 'lastCheck': '9.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000436475', 'lastCheck': '9.2', 'valid': True}} >Thread-135479::DEBUG::2014-10-29 11:08:30,586::task::1191::Storage.TaskManager.Task::(prepare) Task=`32eeb152-3f27-4b9f-b650-2d024b1d7ef5`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522664', 'lastCheck': '9.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000608292', 'lastCheck': '9.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000498982', 'lastCheck': '9.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000436475', 'lastCheck': '9.2', 'valid': True}} >Thread-135479::DEBUG::2014-10-29 11:08:30,586::task::595::Storage.TaskManager.Task::(_updateState) Task=`32eeb152-3f27-4b9f-b650-2d024b1d7ef5`::moving from state preparing -> state finished >Thread-135479::DEBUG::2014-10-29 11:08:30,587::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135479::DEBUG::2014-10-29 11:08:30,587::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135479::DEBUG::2014-10-29 11:08:30,587::task::993::Storage.TaskManager.Task::(_decref) Task=`32eeb152-3f27-4b9f-b650-2d024b1d7ef5`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:08:31,357::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:31,358::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:31,358::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:31,358::__init__::232::IOProcess::(_processLogs) (199671) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:31,359::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199671) Queuing response >Thread-179::DEBUG::2014-10-29 11:08:31,361::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:08:31,379::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000437833 s, 850 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:08:31,381::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:31,381::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:31,382::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:31,382::__init__::232::IOProcess::(_processLogs) (199672) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:31,383::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199672) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:31,415::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:31,415::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:31,415::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:31,417::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199673) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:31,418::__init__::232::IOProcess::(_processLogs) (199673) Queuing response >Thread-10269::DEBUG::2014-10-29 11:08:31,418::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:08:31,435::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000484683 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:08:31,437::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:31,437::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:31,438::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:31,438::__init__::232::IOProcess::(_processLogs) (199674) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:31,440::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199674) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:31,457::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:31,459::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135480::DEBUG::2014-10-29 11:08:31,463::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:31,465::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-17::DEBUG::2014-10-29 11:08:31,470::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >JsonRpcServer::DEBUG::2014-10-29 11:08:31,470::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:08:31,473::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-135481::DEBUG::2014-10-29 11:08:31,480::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:08:31,484::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:31,485::__init__::232::IOProcess::(_processLogs) (199675) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:08:31,487::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:08:31,488::__init__::232::IOProcess::(_processLogs) (199675) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:31,510::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-178::DEBUG::2014-10-29 11:08:31,512::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00145532 s, 349 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:08:31,513::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-22::DEBUG::2014-10-29 11:08:31,516::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-17::DEBUG::2014-10-29 11:08:31,517::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:31,524::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199676) Got request for method 'statvfs' >Thread-33::DEBUG::2014-10-29 11:08:31,526::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:08:31,526::__init__::232::IOProcess::(_processLogs) (199676) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:31,547::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-33::DEBUG::2014-10-29 11:08:31,548::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00221388 s, 220 kB/s\n'; <rc> = 0 >Thread-135481::DEBUG::2014-10-29 11:08:31,555::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:08:31,557::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:31,561::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:31,562::__init__::232::IOProcess::(_processLogs) (199677) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:31,563::__init__::232::IOProcess::(_processLogs) (199677) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:31,563::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:31,564::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:31,564::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:31,564::__init__::232::IOProcess::(_processLogs) (199678) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:31,566::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199678) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:31,567::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:31,568::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:31,568::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:31,568::__init__::232::IOProcess::(_processLogs) (199679) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:31,568::__init__::232::IOProcess::(_processLogs) (199679) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:31,571::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:31,572::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:31,572::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:31,572::__init__::232::IOProcess::(_processLogs) (199680) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:31,573::__init__::232::IOProcess::(_processLogs) (199680) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:31,573::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:31,574::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:31,575::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:31,575::__init__::232::IOProcess::(_processLogs) (199681) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:31,575::__init__::232::IOProcess::(_processLogs) (199681) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:31,576::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:31,576::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:31,577::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:31,578::__init__::232::IOProcess::(_processLogs) (199682) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:31,578::__init__::232::IOProcess::(_processLogs) (199682) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:31,578::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:31,579::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:31,579::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:31,581::__init__::232::IOProcess::(_processLogs) (199683) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:31,581::__init__::232::IOProcess::(_processLogs) (199683) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:31,581::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:31,582::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:31,582::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:31,584::__init__::232::IOProcess::(_processLogs) (199684) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:31,584::__init__::232::IOProcess::(_processLogs) (199684) Queuing response >VM Channels Listener::DEBUG::2014-10-29 11:08:33,253::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:33,985::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:33,986::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:33,988::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:34,577::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:34,580::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135482::DEBUG::2014-10-29 11:08:34,585::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9e1ce1d-fafd-4dcd-9651-a361bea52993`::moving from state init -> state preparing >Thread-135482::INFO::2014-10-29 11:08:34,585::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135482::INFO::2014-10-29 11:08:34,586::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00145532', 'lastCheck': '3.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00221388', 'lastCheck': '3.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437833', 'lastCheck': '3.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000484683', 'lastCheck': '3.1', 'valid': True}} >Thread-135482::DEBUG::2014-10-29 11:08:34,586::task::1191::Storage.TaskManager.Task::(prepare) Task=`e9e1ce1d-fafd-4dcd-9651-a361bea52993`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00145532', 'lastCheck': '3.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00221388', 'lastCheck': '3.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437833', 'lastCheck': '3.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000484683', 'lastCheck': '3.1', 'valid': True}} >Thread-135482::DEBUG::2014-10-29 11:08:34,587::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9e1ce1d-fafd-4dcd-9651-a361bea52993`::moving from state preparing -> state finished >Thread-135482::DEBUG::2014-10-29 11:08:34,587::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135482::DEBUG::2014-10-29 11:08:34,587::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135482::DEBUG::2014-10-29 11:08:34,588::task::993::Storage.TaskManager.Task::(_decref) Task=`e9e1ce1d-fafd-4dcd-9651-a361bea52993`::ref 0 aborting False >Thread-135482::DEBUG::2014-10-29 11:08:34,609::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:34,635::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:34,637::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135483::DEBUG::2014-10-29 11:08:34,640::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135483::DEBUG::2014-10-29 11:08:34,642::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:37,698::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:37,700::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135484::DEBUG::2014-10-29 11:08:37,703::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:37,705::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:37,707::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135485::DEBUG::2014-10-29 11:08:37,710::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135485::DEBUG::2014-10-29 11:08:37,712::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:08:38,770::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53947 >Detector thread::DEBUG::2014-10-29 11:08:38,773::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53947 >Detector thread::DEBUG::2014-10-29 11:08:38,773::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53947 >Detector thread::DEBUG::2014-10-29 11:08:38,774::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53947) >Thread-135486::DEBUG::2014-10-29 11:08:38,811::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135486::DEBUG::2014-10-29 11:08:38,812::task::595::Storage.TaskManager.Task::(_updateState) Task=`65f75108-c1ed-40dc-94ec-07c66b3636df`::moving from state init -> state preparing >Thread-135486::INFO::2014-10-29 11:08:38,812::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135486::DEBUG::2014-10-29 11:08:38,819::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:08:38,820::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:38,820::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:38,821::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:38,821::__init__::232::IOProcess::(_processLogs) (199685) Got request for method 'glob' >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:38,994::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:38,996::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:38,999::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:08:39,687::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53948 >Detector thread::DEBUG::2014-10-29 11:08:39,688::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53948 >Detector thread::DEBUG::2014-10-29 11:08:39,688::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53948 >Detector thread::DEBUG::2014-10-29 11:08:39,689::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53948) >Thread-135487::DEBUG::2014-10-29 11:08:39,728::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135487::DEBUG::2014-10-29 11:08:39,730::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135487::DEBUG::2014-10-29 11:08:39,730::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.79', 'elapsedTime': '513552', 'displayType': 'vnc', 'cpuSys': '0.40', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '41349652', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '64848', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '31636.46'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.21', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:08:39,819::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53949 >Detector thread::DEBUG::2014-10-29 11:08:39,820::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53949 >Detector thread::DEBUG::2014-10-29 11:08:39,820::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53949 >Detector thread::DEBUG::2014-10-29 11:08:39,821::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53949) >Thread-135488::DEBUG::2014-10-29 11:08:39,859::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135488::DEBUG::2014-10-29 11:08:39,861::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135488::DEBUG::2014-10-29 11:08:39,879::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135488::DEBUG::2014-10-29 11:08:39,935::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '147', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '47', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-17::DEBUG::2014-10-29 11:08:40,293::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199685) Queuing response >Thread-135486::DEBUG::2014-10-29 11:08:40,294::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135486::DEBUG::2014-10-29 11:08:40,295::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135486::INFO::2014-10-29 11:08:40,296::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135486::DEBUG::2014-10-29 11:08:40,296::task::1191::Storage.TaskManager.Task::(prepare) Task=`65f75108-c1ed-40dc-94ec-07c66b3636df`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135486::DEBUG::2014-10-29 11:08:40,296::task::595::Storage.TaskManager.Task::(_updateState) Task=`65f75108-c1ed-40dc-94ec-07c66b3636df`::moving from state preparing -> state finished >Thread-135486::DEBUG::2014-10-29 11:08:40,297::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135486::DEBUG::2014-10-29 11:08:40,297::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135486::DEBUG::2014-10-29 11:08:40,297::task::993::Storage.TaskManager.Task::(_decref) Task=`65f75108-c1ed-40dc-94ec-07c66b3636df`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:08:40,349::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53951 >Detector thread::DEBUG::2014-10-29 11:08:40,349::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53951 >Detector thread::DEBUG::2014-10-29 11:08:40,350::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53951 >Detector thread::DEBUG::2014-10-29 11:08:40,350::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53951) >Thread-135489::DEBUG::2014-10-29 11:08:40,389::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135489::DEBUG::2014-10-29 11:08:40,390::task::595::Storage.TaskManager.Task::(_updateState) Task=`62593d0e-dc17-4886-a70c-f15dd702a0e4`::moving from state init -> state preparing >Thread-135489::INFO::2014-10-29 11:08:40,390::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135489::DEBUG::2014-10-29 11:08:40,391::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135489::DEBUG::2014-10-29 11:08:40,391::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135489::DEBUG::2014-10-29 11:08:40,391::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135489::DEBUG::2014-10-29 11:08:40,392::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135489::DEBUG::2014-10-29 11:08:40,392::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135489::DEBUG::2014-10-29 11:08:40,392::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135489::DEBUG::2014-10-29 11:08:40,482::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135489::DEBUG::2014-10-29 11:08:40,483::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Detector thread::DEBUG::2014-10-29 11:08:40,657::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53952 >Thread-135489::DEBUG::2014-10-29 11:08:40,659::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Detector thread::DEBUG::2014-10-29 11:08:40,661::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53952 >Detector thread::DEBUG::2014-10-29 11:08:40,662::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53952 >Thread-135489::DEBUG::2014-10-29 11:08:40,663::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Detector thread::DEBUG::2014-10-29 11:08:40,666::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53952) >Thread-135489::DEBUG::2014-10-29 11:08:40,667::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135489::DEBUG::2014-10-29 11:08:40,671::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135489::DEBUG::2014-10-29 11:08:40,671::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135489::DEBUG::2014-10-29 11:08:40,672::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135489::DEBUG::2014-10-29 11:08:40,672::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135489::DEBUG::2014-10-29 11:08:40,672::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:08:40,680::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:40,681::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:40,682::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:40,682::__init__::232::IOProcess::(_processLogs) (199686) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:08:40,683::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199686) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:40,684::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:40,685::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:40,685::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:40,685::__init__::232::IOProcess::(_processLogs) (199687) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:08:40,686::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199687) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:40,689::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:40,691::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:40,691::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:40,693::__init__::232::IOProcess::(_processLogs) (199688) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:08:40,695::__init__::232::IOProcess::(_processLogs) (199688) Queuing response >Thread-135489::DEBUG::2014-10-29 11:08:40,702::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:08:40,705::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:40,708::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-135490::DEBUG::2014-10-29 11:08:40,710::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f5dd9b1-6fe5-45c1-ab9a-b0b891bbc491`::moving from state init -> state preparing >Thread-17::DEBUG::2014-10-29 11:08:40,710::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-135490::INFO::2014-10-29 11:08:40,711::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-17::DEBUG::2014-10-29 11:08:40,712::__init__::232::IOProcess::(_processLogs) (199689) Got request for method 'glob' >Thread-135490::INFO::2014-10-29 11:08:40,715::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00145532', 'lastCheck': '9.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00221388', 'lastCheck': '9.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437833', 'lastCheck': '9.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000484683', 'lastCheck': '9.3', 'valid': True}} >Thread-17::DEBUG::2014-10-29 11:08:40,716::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199689) Queuing response >Thread-135490::DEBUG::2014-10-29 11:08:40,717::task::1191::Storage.TaskManager.Task::(prepare) Task=`7f5dd9b1-6fe5-45c1-ab9a-b0b891bbc491`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00145532', 'lastCheck': '9.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00221388', 'lastCheck': '9.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437833', 'lastCheck': '9.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000484683', 'lastCheck': '9.3', 'valid': True}} >Thread-135490::DEBUG::2014-10-29 11:08:40,719::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f5dd9b1-6fe5-45c1-ab9a-b0b891bbc491`::moving from state preparing -> state finished >Thread-17::DEBUG::2014-10-29 11:08:40,720::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-135490::DEBUG::2014-10-29 11:08:40,720::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17::DEBUG::2014-10-29 11:08:40,722::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-135490::DEBUG::2014-10-29 11:08:40,722::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17::DEBUG::2014-10-29 11:08:40,723::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-135490::DEBUG::2014-10-29 11:08:40,724::task::993::Storage.TaskManager.Task::(_decref) Task=`7f5dd9b1-6fe5-45c1-ab9a-b0b891bbc491`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:08:40,724::__init__::232::IOProcess::(_processLogs) (199690) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:08:40,728::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199690) Queuing response >Thread-135489::DEBUG::2014-10-29 11:08:40,730::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:40,736::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-17::DEBUG::2014-10-29 11:08:40,740::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >JsonRpcServer::DEBUG::2014-10-29 11:08:40,744::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:08:40,744::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:40,748::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:40,750::__init__::232::IOProcess::(_processLogs) (199691) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:08:40,752::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199691) Queuing response >Thread-135489::DEBUG::2014-10-29 11:08:40,753::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135495::DEBUG::2014-10-29 11:08:40,758::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:08:40,760::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:40,760::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:40,762::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:40,762::__init__::232::IOProcess::(_processLogs) (199692) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:40,763::__init__::232::IOProcess::(_processLogs) (199692) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:40,766::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-17::DEBUG::2014-10-29 11:08:40,767::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:40,769::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:40,770::__init__::232::IOProcess::(_processLogs) Extracting request information... >JsonRpcServer::DEBUG::2014-10-29 11:08:40,772::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:08:40,772::__init__::232::IOProcess::(_processLogs) (199693) Got request for method 'glob' >Thread-135489::DEBUG::2014-10-29 11:08:40,780::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:08:40,780::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199693) Queuing response >Thread-135489::INFO::2014-10-29 11:08:40,783::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135489::INFO::2014-10-29 11:08:40,785::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135489::INFO::2014-10-29 11:08:40,785::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:08:40,788::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-135496::DEBUG::2014-10-29 11:08:40,789::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:08:40,791::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:40,793::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:40,796::__init__::232::IOProcess::(_processLogs) (199694) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:08:40,799::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199694) Queuing response >Thread-135489::DEBUG::2014-10-29 11:08:40,800::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135489::DEBUG::2014-10-29 11:08:40,805::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`cf626efd-4253-4ddd-a5a6-f4a444a97914`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135489::DEBUG::2014-10-29 11:08:40,808::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135489::DEBUG::2014-10-29 11:08:40,812::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135489::DEBUG::2014-10-29 11:08:40,815::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`cf626efd-4253-4ddd-a5a6-f4a444a97914`::Granted request >Thread-135489::DEBUG::2014-10-29 11:08:40,821::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`62593d0e-dc17-4886-a70c-f15dd702a0e4`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135496::DEBUG::2014-10-29 11:08:40,823::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-135489::DEBUG::2014-10-29 11:08:40,824::task::993::Storage.TaskManager.Task::(_decref) Task=`62593d0e-dc17-4886-a70c-f15dd702a0e4`::ref 1 aborting False >Thread-135489::INFO::2014-10-29 11:08:40,842::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135489::DEBUG::2014-10-29 11:08:40,844::task::1191::Storage.TaskManager.Task::(prepare) Task=`62593d0e-dc17-4886-a70c-f15dd702a0e4`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135489::DEBUG::2014-10-29 11:08:40,846::task::595::Storage.TaskManager.Task::(_updateState) Task=`62593d0e-dc17-4886-a70c-f15dd702a0e4`::moving from state preparing -> state finished >Thread-135489::DEBUG::2014-10-29 11:08:40,847::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135489::DEBUG::2014-10-29 11:08:40,849::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135489::DEBUG::2014-10-29 11:08:40,851::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135489::DEBUG::2014-10-29 11:08:40,852::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135489::DEBUG::2014-10-29 11:08:40,852::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135489::DEBUG::2014-10-29 11:08:40,852::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135489::DEBUG::2014-10-29 11:08:40,852::task::993::Storage.TaskManager.Task::(_decref) Task=`62593d0e-dc17-4886-a70c-f15dd702a0e4`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:08:40,873::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53953 >Detector thread::DEBUG::2014-10-29 11:08:40,874::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53953 >Detector thread::DEBUG::2014-10-29 11:08:40,874::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53953 >Detector thread::DEBUG::2014-10-29 11:08:40,874::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53953) >Thread-135497::DEBUG::2014-10-29 11:08:40,913::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135497::DEBUG::2014-10-29 11:08:40,913::task::595::Storage.TaskManager.Task::(_updateState) Task=`1b7fd513-2332-4be0-8cd2-44021e609d13`::moving from state init -> state preparing >Thread-135497::INFO::2014-10-29 11:08:40,914::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135497::INFO::2014-10-29 11:08:40,914::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00145532', 'lastCheck': '9.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00221388', 'lastCheck': '9.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437833', 'lastCheck': '9.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000484683', 'lastCheck': '9.5', 'valid': True}} >Thread-135497::DEBUG::2014-10-29 11:08:40,915::task::1191::Storage.TaskManager.Task::(prepare) Task=`1b7fd513-2332-4be0-8cd2-44021e609d13`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00145532', 'lastCheck': '9.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00221388', 'lastCheck': '9.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437833', 'lastCheck': '9.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000484683', 'lastCheck': '9.5', 'valid': True}} >Thread-135497::DEBUG::2014-10-29 11:08:40,915::task::595::Storage.TaskManager.Task::(_updateState) Task=`1b7fd513-2332-4be0-8cd2-44021e609d13`::moving from state preparing -> state finished >Thread-135497::DEBUG::2014-10-29 11:08:40,915::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135497::DEBUG::2014-10-29 11:08:40,915::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135497::DEBUG::2014-10-29 11:08:40,916::task::993::Storage.TaskManager.Task::(_decref) Task=`1b7fd513-2332-4be0-8cd2-44021e609d13`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:08:41,387::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:41,387::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:41,388::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:41,388::__init__::232::IOProcess::(_processLogs) (199695) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:41,389::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199695) Queuing response >Thread-179::DEBUG::2014-10-29 11:08:41,390::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:08:41,407::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000520535 s, 715 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:08:41,409::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:41,411::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:41,413::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:41,413::__init__::232::IOProcess::(_processLogs) (199696) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:41,413::__init__::232::IOProcess::(_processLogs) (199696) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:41,442::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:41,442::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:41,444::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-10269::DEBUG::2014-10-29 11:08:41,445::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:08:41,445::__init__::232::IOProcess::(_processLogs) (199697) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:41,465::__init__::232::IOProcess::(_processLogs) (199697) Queuing response >Thread-10269::DEBUG::2014-10-29 11:08:41,467::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000575441 s, 872 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:08:41,469::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:41,469::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:41,469::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:41,469::__init__::232::IOProcess::(_processLogs) (199698) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:41,471::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199698) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:41,581::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:41,582::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:41,582::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:41,582::__init__::232::IOProcess::(_processLogs) (199699) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:41,584::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199699) Queuing response >Thread-178::DEBUG::2014-10-29 11:08:41,586::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:08:41,607::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-33::DEBUG::2014-10-29 11:08:41,608::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:08:41,611::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-178::DEBUG::2014-10-29 11:08:41,628::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000677791 s, 749 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:08:41,630::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-33::DEBUG::2014-10-29 11:08:41,631::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000527393 s, 923 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:08:41,634::__init__::232::IOProcess::(_processLogs) (199700) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:41,635::__init__::232::IOProcess::(_processLogs) (199700) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:41,636::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:41,636::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:41,636::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:41,637::__init__::232::IOProcess::(_processLogs) (199701) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:41,637::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:41,637::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:41,637::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:41,639::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199702) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:41,641::__init__::232::IOProcess::(_processLogs) (199701) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:41,641::__init__::232::IOProcess::(_processLogs) (199702) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:41,644::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:41,644::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:41,645::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:41,646::__init__::232::IOProcess::(_processLogs) (199703) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:41,646::__init__::232::IOProcess::(_processLogs) (199703) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:41,646::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:41,647::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:41,648::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:41,649::__init__::232::IOProcess::(_processLogs) (199704) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:41,649::__init__::232::IOProcess::(_processLogs) (199704) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:41,650::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:41,650::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:41,650::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:41,651::__init__::232::IOProcess::(_processLogs) (199705) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:41,652::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199705) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:41,653::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:41,653::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:41,653::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:41,653::__init__::232::IOProcess::(_processLogs) (199706) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:41,654::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199706) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:41,655::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:41,656::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:41,657::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:41,658::__init__::232::IOProcess::(_processLogs) (199707) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:41,658::__init__::232::IOProcess::(_processLogs) (199707) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:41,659::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:41,659::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:41,659::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:41,660::__init__::232::IOProcess::(_processLogs) (199708) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:41,660::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199708) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:43,874::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:43,876::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135498::DEBUG::2014-10-29 11:08:43,880::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:43,883::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:43,884::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135499::DEBUG::2014-10-29 11:08:43,888::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135499::DEBUG::2014-10-29 11:08:43,890::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:44,006::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:44,007::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:44,009::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-22::DEBUG::2014-10-29 11:08:46,525::task::595::Storage.TaskManager.Task::(_updateState) Task=`b4344a58-8766-40ce-8a5f-15b6ab069716`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:08:46,528::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:08:46,532::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:46,534::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:46,539::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:46,541::__init__::232::IOProcess::(_processLogs) (199709) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:08:46,543::__init__::232::IOProcess::(_processLogs) (199709) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:46,545::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:46,546::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:46,548::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:46,549::__init__::232::IOProcess::(_processLogs) (199710) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:08:46,551::__init__::232::IOProcess::(_processLogs) (199710) Queuing response >Thread-22::INFO::2014-10-29 11:08:46,556::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010855424', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:08:46,558::task::1191::Storage.TaskManager.Task::(prepare) Task=`b4344a58-8766-40ce-8a5f-15b6ab069716`::finished: {'truesize': '6010855424', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:08:46,559::task::595::Storage.TaskManager.Task::(_updateState) Task=`b4344a58-8766-40ce-8a5f-15b6ab069716`::moving from state preparing -> state finished >Thread-22::DEBUG::2014-10-29 11:08:46,560::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-10-29 11:08:46,561::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2014-10-29 11:08:46,563::task::993::Storage.TaskManager.Task::(_decref) Task=`b4344a58-8766-40ce-8a5f-15b6ab069716`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:08:46,637::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:46,905::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:46,911::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135500::DEBUG::2014-10-29 11:08:46,919::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:46,924::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:46,928::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135501::DEBUG::2014-10-29 11:08:46,936::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135501::DEBUG::2014-10-29 11:08:46,950::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:49,014::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:49,015::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:49,017::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:08:49,881::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53954 >Detector thread::DEBUG::2014-10-29 11:08:49,882::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53954 >Detector thread::DEBUG::2014-10-29 11:08:49,882::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53954 >Detector thread::DEBUG::2014-10-29 11:08:49,883::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53954) >Thread-135502::DEBUG::2014-10-29 11:08:49,921::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135502::DEBUG::2014-10-29 11:08:49,922::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135502::DEBUG::2014-10-29 11:08:49,923::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.94', 'elapsedTime': '513562', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '89961265', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '58399', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '33658.40'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.28', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:49,970::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:49,973::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135503::DEBUG::2014-10-29 11:08:49,977::task::595::Storage.TaskManager.Task::(_updateState) Task=`58f7b7ae-6d41-4f20-8e3d-463dd82c9ac9`::moving from state init -> state preparing >Detector thread::DEBUG::2014-10-29 11:08:49,977::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53955 >Detector thread::DEBUG::2014-10-29 11:08:49,979::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53955 >Detector thread::DEBUG::2014-10-29 11:08:49,979::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53955 >Thread-135503::INFO::2014-10-29 11:08:49,980::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Detector thread::DEBUG::2014-10-29 11:08:49,981::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53955) >Thread-135503::INFO::2014-10-29 11:08:49,986::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677791', 'lastCheck': '8.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527393', 'lastCheck': '8.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520535', 'lastCheck': '8.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000575441', 'lastCheck': '8.5', 'valid': True}} >Thread-135503::DEBUG::2014-10-29 11:08:49,987::task::1191::Storage.TaskManager.Task::(prepare) Task=`58f7b7ae-6d41-4f20-8e3d-463dd82c9ac9`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677791', 'lastCheck': '8.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527393', 'lastCheck': '8.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520535', 'lastCheck': '8.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000575441', 'lastCheck': '8.5', 'valid': True}} >Thread-135503::DEBUG::2014-10-29 11:08:49,987::task::595::Storage.TaskManager.Task::(_updateState) Task=`58f7b7ae-6d41-4f20-8e3d-463dd82c9ac9`::moving from state preparing -> state finished >Thread-135503::DEBUG::2014-10-29 11:08:49,987::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135503::DEBUG::2014-10-29 11:08:49,987::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135503::DEBUG::2014-10-29 11:08:49,988::task::993::Storage.TaskManager.Task::(_decref) Task=`58f7b7ae-6d41-4f20-8e3d-463dd82c9ac9`::ref 0 aborting False >Thread-135503::DEBUG::2014-10-29 11:08:50,009::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-135504::DEBUG::2014-10-29 11:08:50,018::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135504::DEBUG::2014-10-29 11:08:50,020::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135504::DEBUG::2014-10-29 11:08:50,040::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:50,047::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:50,052::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135505::DEBUG::2014-10-29 11:08:50,066::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135505::DEBUG::2014-10-29 11:08:50,079::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-135504::DEBUG::2014-10-29 11:08:50,116::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '129', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '29', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:08:50,898::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53957 >Detector thread::DEBUG::2014-10-29 11:08:50,899::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53957 >Detector thread::DEBUG::2014-10-29 11:08:50,899::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53957 >Detector thread::DEBUG::2014-10-29 11:08:50,900::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53957) >Thread-135506::DEBUG::2014-10-29 11:08:50,940::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac0e3b96-714e-4400-b3f0-0e20c614149f`::moving from state init -> state preparing >Thread-135506::INFO::2014-10-29 11:08:50,940::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135506::INFO::2014-10-29 11:08:50,941::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677791', 'lastCheck': '9.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527393', 'lastCheck': '9.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520535', 'lastCheck': '9.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000575441', 'lastCheck': '9.5', 'valid': True}} >Thread-135506::DEBUG::2014-10-29 11:08:50,941::task::1191::Storage.TaskManager.Task::(prepare) Task=`ac0e3b96-714e-4400-b3f0-0e20c614149f`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677791', 'lastCheck': '9.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527393', 'lastCheck': '9.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520535', 'lastCheck': '9.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000575441', 'lastCheck': '9.5', 'valid': True}} >Thread-135506::DEBUG::2014-10-29 11:08:50,942::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac0e3b96-714e-4400-b3f0-0e20c614149f`::moving from state preparing -> state finished >Thread-135506::DEBUG::2014-10-29 11:08:50,942::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135506::DEBUG::2014-10-29 11:08:50,942::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135506::DEBUG::2014-10-29 11:08:50,943::task::993::Storage.TaskManager.Task::(_decref) Task=`ac0e3b96-714e-4400-b3f0-0e20c614149f`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:08:51,415::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:51,416::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:51,416::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:51,416::__init__::232::IOProcess::(_processLogs) (199711) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:51,417::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199711) Queuing response >Thread-179::DEBUG::2014-10-29 11:08:51,419::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:08:51,440::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000567147 s, 656 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:08:51,442::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:51,443::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:51,443::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:51,443::__init__::232::IOProcess::(_processLogs) (199712) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:51,443::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199712) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:51,474::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:51,474::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:51,476::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-10269::DEBUG::2014-10-29 11:08:51,477::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:08:51,477::__init__::232::IOProcess::(_processLogs) (199713) Got request for method 'statvfs' >Detector thread::DEBUG::2014-10-29 11:08:51,500::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53959 >Thread-17::DEBUG::2014-10-29 11:08:51,503::__init__::232::IOProcess::(_processLogs) (199713) Queuing response >Thread-10269::DEBUG::2014-10-29 11:08:51,505::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000421832 s, 1.2 MB/s\n'; <rc> = 0 >Detector thread::DEBUG::2014-10-29 11:08:51,506::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53959 >Detector thread::DEBUG::2014-10-29 11:08:51,509::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53959 >Thread-17::DEBUG::2014-10-29 11:08:51,510::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Detector thread::DEBUG::2014-10-29 11:08:51,512::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53959) >Thread-17::DEBUG::2014-10-29 11:08:51,513::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:51,519::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:51,520::__init__::232::IOProcess::(_processLogs) (199714) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:51,521::__init__::232::IOProcess::(_processLogs) (199714) Queuing response >Thread-135507::DEBUG::2014-10-29 11:08:51,540::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135507::DEBUG::2014-10-29 11:08:51,541::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a5d4522-3ebd-48cd-aecf-3956ee24a995`::moving from state init -> state preparing >Thread-135507::INFO::2014-10-29 11:08:51,541::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135507::DEBUG::2014-10-29 11:08:51,544::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:08:51,545::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:51,545::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:51,545::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:51,546::__init__::232::IOProcess::(_processLogs) (199715) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:08:51,546::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199715) Queuing response >Thread-135507::DEBUG::2014-10-29 11:08:51,547::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135507::DEBUG::2014-10-29 11:08:51,548::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135507::INFO::2014-10-29 11:08:51,548::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135507::DEBUG::2014-10-29 11:08:51,548::task::1191::Storage.TaskManager.Task::(prepare) Task=`9a5d4522-3ebd-48cd-aecf-3956ee24a995`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135507::DEBUG::2014-10-29 11:08:51,549::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a5d4522-3ebd-48cd-aecf-3956ee24a995`::moving from state preparing -> state finished >Thread-135507::DEBUG::2014-10-29 11:08:51,549::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135507::DEBUG::2014-10-29 11:08:51,549::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135507::DEBUG::2014-10-29 11:08:51,549::task::993::Storage.TaskManager.Task::(_decref) Task=`9a5d4522-3ebd-48cd-aecf-3956ee24a995`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:08:51,593::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53960 >Detector thread::DEBUG::2014-10-29 11:08:51,594::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53960 >Detector thread::DEBUG::2014-10-29 11:08:51,595::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53960 >Detector thread::DEBUG::2014-10-29 11:08:51,595::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53960) >Thread-135508::DEBUG::2014-10-29 11:08:51,634::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135508::DEBUG::2014-10-29 11:08:51,634::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc349afe-4916-4490-b45c-07c700e34adc`::moving from state init -> state preparing >Thread-135508::INFO::2014-10-29 11:08:51,635::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135508::DEBUG::2014-10-29 11:08:51,635::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135508::DEBUG::2014-10-29 11:08:51,635::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135508::DEBUG::2014-10-29 11:08:51,636::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135508::DEBUG::2014-10-29 11:08:51,636::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135508::DEBUG::2014-10-29 11:08:51,636::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135508::DEBUG::2014-10-29 11:08:51,637::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-17::DEBUG::2014-10-29 11:08:51,660::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:51,660::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:51,662::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-178::DEBUG::2014-10-29 11:08:51,664::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:08:51,664::__init__::232::IOProcess::(_processLogs) (199716) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:51,682::__init__::232::IOProcess::(_processLogs) (199716) Queuing response >Thread-178::DEBUG::2014-10-29 11:08:51,686::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00316252 s, 161 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:08:51,687::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:51,688::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:51,688::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:51,688::__init__::232::IOProcess::(_processLogs) (199717) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:51,690::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199717) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:51,691::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:51,692::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:51,693::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:51,693::__init__::232::IOProcess::(_processLogs) (199718) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:51,693::__init__::232::IOProcess::(_processLogs) (199718) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:51,694::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:51,694::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:51,695::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:51,695::__init__::232::IOProcess::(_processLogs) (199719) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:51,696::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199719) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:51,697::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:51,697::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:51,698::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:51,698::__init__::232::IOProcess::(_processLogs) (199720) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:51,699::__init__::232::IOProcess::(_processLogs) (199720) Queuing response >Thread-135508::DEBUG::2014-10-29 11:08:51,717::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135508::DEBUG::2014-10-29 11:08:51,718::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135508::DEBUG::2014-10-29 11:08:51,890::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135508::DEBUG::2014-10-29 11:08:51,891::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135508::DEBUG::2014-10-29 11:08:51,891::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135508::DEBUG::2014-10-29 11:08:51,892::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135508::DEBUG::2014-10-29 11:08:51,892::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135508::DEBUG::2014-10-29 11:08:51,892::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135508::DEBUG::2014-10-29 11:08:51,893::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135508::DEBUG::2014-10-29 11:08:51,893::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:08:51,898::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:51,901::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:51,902::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:51,902::__init__::232::IOProcess::(_processLogs) (199721) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:08:51,903::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199721) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:51,905::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:51,905::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:51,906::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:51,906::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:51,906::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:51,909::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:51,911::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:51,913::__init__::232::IOProcess::(_processLogs) (199722) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:08:51,915::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:51,917::__init__::232::IOProcess::(_processLogs) (199723) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:08:51,920::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-135508::DEBUG::2014-10-29 11:08:51,922::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:08:51,923::__init__::232::IOProcess::(_processLogs) (199724) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:08:51,925::__init__::232::IOProcess::(_processLogs) (199722) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:51,925::__init__::232::IOProcess::(_processLogs) (199724) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:51,925::__init__::232::IOProcess::(_processLogs) (199723) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:51,927::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:51,927::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:51,927::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:51,928::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199725) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:08:51,928::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199725) Queuing response >Thread-135508::DEBUG::2014-10-29 11:08:51,929::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:08:51,930::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:51,930::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:51,931::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:51,931::__init__::232::IOProcess::(_processLogs) (199726) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:08:51,932::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199726) Queuing response >Thread-135508::DEBUG::2014-10-29 11:08:51,932::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:08:51,934::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:51,935::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:51,935::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:51,936::__init__::232::IOProcess::(_processLogs) (199727) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:51,936::__init__::232::IOProcess::(_processLogs) (199727) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:51,936::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:51,937::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:51,937::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:51,937::__init__::232::IOProcess::(_processLogs) (199728) Got request for method 'glob' >Thread-135508::DEBUG::2014-10-29 11:08:51,938::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:08:51,938::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199728) Queuing response >Thread-135508::INFO::2014-10-29 11:08:51,939::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135508::INFO::2014-10-29 11:08:51,940::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135508::INFO::2014-10-29 11:08:51,941::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:08:51,942::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:51,943::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:51,943::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:51,944::__init__::232::IOProcess::(_processLogs) (199729) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:08:51,945::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199729) Queuing response >Thread-33::DEBUG::2014-10-29 11:08:51,947::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:08:51,947::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:51,963::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:51,964::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:51,966::__init__::232::IOProcess::(_processLogs) (199730) Got request for method 'readfile' >Thread-33::DEBUG::2014-10-29 11:08:51,966::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000686754 s, 709 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:08:51,970::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199730) Queuing response >Thread-135508::DEBUG::2014-10-29 11:08:51,970::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:08:51,973::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:51,975::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-135508::DEBUG::2014-10-29 11:08:51,977::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`b2ae8f03-ff16-4504-961a-7b3508e1ecd0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-17::DEBUG::2014-10-29 11:08:51,977::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-135508::DEBUG::2014-10-29 11:08:51,978::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-17::DEBUG::2014-10-29 11:08:51,979::__init__::232::IOProcess::(_processLogs) (199731) Got request for method 'statvfs' >Thread-135508::DEBUG::2014-10-29 11:08:51,980::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135508::DEBUG::2014-10-29 11:08:51,981::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`b2ae8f03-ff16-4504-961a-7b3508e1ecd0`::Granted request >Thread-135508::DEBUG::2014-10-29 11:08:51,985::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`dc349afe-4916-4490-b45c-07c700e34adc`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-17::DEBUG::2014-10-29 11:08:51,987::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199731) Queuing response >Thread-135508::DEBUG::2014-10-29 11:08:51,988::task::993::Storage.TaskManager.Task::(_decref) Task=`dc349afe-4916-4490-b45c-07c700e34adc`::ref 1 aborting False >Thread-17::DEBUG::2014-10-29 11:08:51,991::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:51,992::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:08:51,993::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:51,995::__init__::232::IOProcess::(_processLogs) (199732) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:51,998::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199732) Queuing response >Thread-17::DEBUG::2014-10-29 11:08:52,002::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-135508::INFO::2014-10-29 11:08:52,003::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-17::DEBUG::2014-10-29 11:08:52,003::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-135508::DEBUG::2014-10-29 11:08:52,004::task::1191::Storage.TaskManager.Task::(prepare) Task=`dc349afe-4916-4490-b45c-07c700e34adc`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135508::DEBUG::2014-10-29 11:08:52,005::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc349afe-4916-4490-b45c-07c700e34adc`::moving from state preparing -> state finished >Thread-17::DEBUG::2014-10-29 11:08:52,005::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-135508::DEBUG::2014-10-29 11:08:52,006::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-17::DEBUG::2014-10-29 11:08:52,007::__init__::232::IOProcess::(_processLogs) (199733) Got request for method 'access' >Thread-135508::DEBUG::2014-10-29 11:08:52,008::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135508::DEBUG::2014-10-29 11:08:52,010::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-17::DEBUG::2014-10-29 11:08:52,011::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199733) Queuing response >Thread-135508::DEBUG::2014-10-29 11:08:52,012::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135508::DEBUG::2014-10-29 11:08:52,013::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135508::DEBUG::2014-10-29 11:08:52,014::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-17::DEBUG::2014-10-29 11:08:52,014::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:08:52,016::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-135508::DEBUG::2014-10-29 11:08:52,016::task::993::Storage.TaskManager.Task::(_decref) Task=`dc349afe-4916-4490-b45c-07c700e34adc`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:08:52,018::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:08:52,019::__init__::232::IOProcess::(_processLogs) (199734) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:08:52,023::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199734) Queuing response >Detector thread::DEBUG::2014-10-29 11:08:52,043::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53961 >Detector thread::DEBUG::2014-10-29 11:08:52,043::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53961 >Detector thread::DEBUG::2014-10-29 11:08:52,043::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53961 >Detector thread::DEBUG::2014-10-29 11:08:52,044::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53961) >Thread-135513::DEBUG::2014-10-29 11:08:52,083::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135513::DEBUG::2014-10-29 11:08:52,084::task::595::Storage.TaskManager.Task::(_updateState) Task=`a39a14d1-05e9-48c4-85ac-5a8e1cedd9be`::moving from state init -> state preparing >Thread-135513::INFO::2014-10-29 11:08:52,084::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135513::INFO::2014-10-29 11:08:52,085::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00316252', 'lastCheck': '0.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000686754', 'lastCheck': '0.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567147', 'lastCheck': '0.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000421832', 'lastCheck': '0.6', 'valid': True}} >Thread-135513::DEBUG::2014-10-29 11:08:52,085::task::1191::Storage.TaskManager.Task::(prepare) Task=`a39a14d1-05e9-48c4-85ac-5a8e1cedd9be`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00316252', 'lastCheck': '0.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000686754', 'lastCheck': '0.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567147', 'lastCheck': '0.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000421832', 'lastCheck': '0.6', 'valid': True}} >Thread-135513::DEBUG::2014-10-29 11:08:52,085::task::595::Storage.TaskManager.Task::(_updateState) Task=`a39a14d1-05e9-48c4-85ac-5a8e1cedd9be`::moving from state preparing -> state finished >Thread-135513::DEBUG::2014-10-29 11:08:52,086::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135513::DEBUG::2014-10-29 11:08:52,086::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135513::DEBUG::2014-10-29 11:08:52,086::task::993::Storage.TaskManager.Task::(_decref) Task=`a39a14d1-05e9-48c4-85ac-5a8e1cedd9be`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:53,147::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:53,151::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135514::DEBUG::2014-10-29 11:08:53,155::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:53,157::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:53,159::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135515::DEBUG::2014-10-29 11:08:53,162::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135515::DEBUG::2014-10-29 11:08:53,165::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:54,024::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:54,026::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:54,029::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:56,183::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:56,185::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135516::DEBUG::2014-10-29 11:08:56,189::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:56,192::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:56,193::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135517::DEBUG::2014-10-29 11:08:56,196::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135517::DEBUG::2014-10-29 11:08:56,198::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:59,036::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:59,037::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:08:59,038::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:59,214::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:59,216::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135518::DEBUG::2014-10-29 11:08:59,219::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:08:59,221::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:08:59,223::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135519::DEBUG::2014-10-29 11:08:59,225::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135519::DEBUG::2014-10-29 11:08:59,227::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:09:00,095::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53962 >Detector thread::DEBUG::2014-10-29 11:09:00,096::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53962 >Detector thread::DEBUG::2014-10-29 11:09:00,096::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53962 >Detector thread::DEBUG::2014-10-29 11:09:00,097::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53962) >Thread-135520::DEBUG::2014-10-29 11:09:00,135::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135520::DEBUG::2014-10-29 11:09:00,137::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135520::DEBUG::2014-10-29 11:09:00,137::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.94', 'elapsedTime': '513572', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '89961265', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '58399', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '33658.40'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.49', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:09:00,168::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53963 >Detector thread::DEBUG::2014-10-29 11:09:00,169::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53963 >Detector thread::DEBUG::2014-10-29 11:09:00,169::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53963 >Detector thread::DEBUG::2014-10-29 11:09:00,170::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53963) >Thread-135521::DEBUG::2014-10-29 11:09:00,209::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135521::DEBUG::2014-10-29 11:09:00,211::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135521::DEBUG::2014-10-29 11:09:00,231::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135521::DEBUG::2014-10-29 11:09:00,281::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '113', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '13', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:09:01,001::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53965 >Detector thread::DEBUG::2014-10-29 11:09:01,002::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53965 >Detector thread::DEBUG::2014-10-29 11:09:01,002::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53965 >Detector thread::DEBUG::2014-10-29 11:09:01,003::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53965) >Thread-135522::DEBUG::2014-10-29 11:09:01,043::task::595::Storage.TaskManager.Task::(_updateState) Task=`0aa4cd08-b8a4-423f-b92a-c0329b9697f2`::moving from state init -> state preparing >Thread-135522::INFO::2014-10-29 11:09:01,044::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135522::INFO::2014-10-29 11:09:01,045::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00316252', 'lastCheck': '9.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000686754', 'lastCheck': '9.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567147', 'lastCheck': '9.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000421832', 'lastCheck': '9.5', 'valid': True}} >Thread-135522::DEBUG::2014-10-29 11:09:01,045::task::1191::Storage.TaskManager.Task::(prepare) Task=`0aa4cd08-b8a4-423f-b92a-c0329b9697f2`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00316252', 'lastCheck': '9.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000686754', 'lastCheck': '9.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567147', 'lastCheck': '9.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000421832', 'lastCheck': '9.5', 'valid': True}} >Thread-135522::DEBUG::2014-10-29 11:09:01,046::task::595::Storage.TaskManager.Task::(_updateState) Task=`0aa4cd08-b8a4-423f-b92a-c0329b9697f2`::moving from state preparing -> state finished >Thread-135522::DEBUG::2014-10-29 11:09:01,046::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135522::DEBUG::2014-10-29 11:09:01,046::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135522::DEBUG::2014-10-29 11:09:01,046::task::993::Storage.TaskManager.Task::(_decref) Task=`0aa4cd08-b8a4-423f-b92a-c0329b9697f2`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:09:01,459::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:01,459::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:01,460::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:01,460::__init__::232::IOProcess::(_processLogs) (199735) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:01,461::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199735) Queuing response >Thread-179::DEBUG::2014-10-29 11:09:01,463::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:09:01,480::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000595573 s, 625 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:09:01,482::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:01,482::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:01,482::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:01,483::__init__::232::IOProcess::(_processLogs) (199736) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:01,483::__init__::232::IOProcess::(_processLogs) (199736) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:01,522::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:01,522::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:01,522::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:01,523::__init__::232::IOProcess::(_processLogs) (199737) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:01,523::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199737) Queuing response >Thread-10269::DEBUG::2014-10-29 11:09:01,525::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:09:01,543::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00141106 s, 356 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:09:01,544::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:01,545::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:01,545::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:01,545::__init__::232::IOProcess::(_processLogs) (199738) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:01,546::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199738) Queuing response >Thread-22::DEBUG::2014-10-29 11:09:01,663::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-17::DEBUG::2014-10-29 11:09:01,700::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:01,701::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:01,702::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:01,703::__init__::232::IOProcess::(_processLogs) (199739) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:09:01,703::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:09:01,705::__init__::232::IOProcess::(_processLogs) (199739) Queuing response >Thread-178::DEBUG::2014-10-29 11:09:01,723::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000458257 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:09:01,725::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:01,725::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:01,725::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:01,726::__init__::232::IOProcess::(_processLogs) (199740) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:01,726::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199740) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:01,729::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:01,729::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:01,729::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:01,729::__init__::232::IOProcess::(_processLogs) (199741) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:01,730::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199741) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:01,732::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:01,732::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:01,732::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:01,733::__init__::232::IOProcess::(_processLogs) (199742) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:01,733::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199742) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:01,735::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:01,735::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:01,735::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:01,735::__init__::232::IOProcess::(_processLogs) (199743) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:01,736::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199743) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:02,026::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:02,028::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:02,029::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:02,029::__init__::232::IOProcess::(_processLogs) (199744) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:02,029::__init__::232::IOProcess::(_processLogs) (199744) Queuing response >Thread-33::DEBUG::2014-10-29 11:09:02,031::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:09:02,049::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000486455 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:09:02,051::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:02,052::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:02,052::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:02,052::__init__::232::IOProcess::(_processLogs) (199745) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:02,054::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199745) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:02,055::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:02,056::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:02,056::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:02,056::__init__::232::IOProcess::(_processLogs) (199746) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:02,057::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199746) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:02,058::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:02,058::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:02,059::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:02,059::__init__::232::IOProcess::(_processLogs) (199747) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:02,060::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199747) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:02,061::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:02,061::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:02,061::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:02,061::__init__::232::IOProcess::(_processLogs) (199748) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:02,062::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199748) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:02,243::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:02,247::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135523::DEBUG::2014-10-29 11:09:02,251::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:02,254::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:02,256::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135524::DEBUG::2014-10-29 11:09:02,260::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135524::DEBUG::2014-10-29 11:09:02,263::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:09:03,285::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:04,045::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:04,046::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:04,047::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:09:04,151::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53967 >Detector thread::DEBUG::2014-10-29 11:09:04,151::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53967 >Detector thread::DEBUG::2014-10-29 11:09:04,152::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53967 >Detector thread::DEBUG::2014-10-29 11:09:04,152::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53967) >Thread-135525::DEBUG::2014-10-29 11:09:04,192::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135525::DEBUG::2014-10-29 11:09:04,192::task::595::Storage.TaskManager.Task::(_updateState) Task=`4caa1164-a01f-4ceb-96fb-e069c2851642`::moving from state init -> state preparing >Thread-135525::INFO::2014-10-29 11:09:04,193::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135525::DEBUG::2014-10-29 11:09:04,198::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:09:04,198::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:04,199::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:04,199::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:04,199::__init__::232::IOProcess::(_processLogs) (199749) Got request for method 'glob' >Thread-135525::DEBUG::2014-10-29 11:09:04,200::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:09:04,200::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199749) Queuing response >Thread-135525::DEBUG::2014-10-29 11:09:04,202::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135525::INFO::2014-10-29 11:09:04,202::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135525::DEBUG::2014-10-29 11:09:04,203::task::1191::Storage.TaskManager.Task::(prepare) Task=`4caa1164-a01f-4ceb-96fb-e069c2851642`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135525::DEBUG::2014-10-29 11:09:04,203::task::595::Storage.TaskManager.Task::(_updateState) Task=`4caa1164-a01f-4ceb-96fb-e069c2851642`::moving from state preparing -> state finished >Thread-135525::DEBUG::2014-10-29 11:09:04,203::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135525::DEBUG::2014-10-29 11:09:04,204::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135525::DEBUG::2014-10-29 11:09:04,204::task::993::Storage.TaskManager.Task::(_decref) Task=`4caa1164-a01f-4ceb-96fb-e069c2851642`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:09:04,247::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53968 >Detector thread::DEBUG::2014-10-29 11:09:04,248::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53968 >Detector thread::DEBUG::2014-10-29 11:09:04,248::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53968 >Detector thread::DEBUG::2014-10-29 11:09:04,249::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53968) >Thread-135526::DEBUG::2014-10-29 11:09:04,287::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135526::DEBUG::2014-10-29 11:09:04,288::task::595::Storage.TaskManager.Task::(_updateState) Task=`e767cdaf-cba2-4457-96a4-af1fd01faded`::moving from state init -> state preparing >Thread-135526::INFO::2014-10-29 11:09:04,288::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135526::DEBUG::2014-10-29 11:09:04,288::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135526::DEBUG::2014-10-29 11:09:04,289::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135526::DEBUG::2014-10-29 11:09:04,289::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135526::DEBUG::2014-10-29 11:09:04,289::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135526::DEBUG::2014-10-29 11:09:04,289::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135526::DEBUG::2014-10-29 11:09:04,290::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135526::DEBUG::2014-10-29 11:09:04,378::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135526::DEBUG::2014-10-29 11:09:04,378::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135526::DEBUG::2014-10-29 11:09:04,554::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135526::DEBUG::2014-10-29 11:09:04,555::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135526::DEBUG::2014-10-29 11:09:04,555::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135526::DEBUG::2014-10-29 11:09:04,555::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135526::DEBUG::2014-10-29 11:09:04,556::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135526::DEBUG::2014-10-29 11:09:04,556::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135526::DEBUG::2014-10-29 11:09:04,556::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135526::DEBUG::2014-10-29 11:09:04,557::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:09:04,565::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:04,567::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:04,568::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:04,568::__init__::232::IOProcess::(_processLogs) (199750) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:09:04,569::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199750) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:04,571::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:04,571::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:04,571::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:04,572::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:04,572::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:04,572::__init__::232::IOProcess::(_processLogs) (199751) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:09:04,573::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199751) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:04,573::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:04,573::__init__::232::IOProcess::(_processLogs) (199752) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:09:04,574::__init__::232::IOProcess::(_processLogs) (199752) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:04,574::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:04,574::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:04,574::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:04,575::__init__::232::IOProcess::(_processLogs) (199753) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:09:04,575::__init__::232::IOProcess::(_processLogs) (199753) Queuing response >Thread-135526::DEBUG::2014-10-29 11:09:04,582::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:09:04,583::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:04,583::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:04,584::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:04,584::__init__::232::IOProcess::(_processLogs) (199754) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:09:04,584::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199754) Queuing response >Thread-135526::DEBUG::2014-10-29 11:09:04,585::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:09:04,586::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:04,587::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:04,587::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:04,587::__init__::232::IOProcess::(_processLogs) (199755) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:09:04,588::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199755) Queuing response >Thread-135526::DEBUG::2014-10-29 11:09:04,588::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:09:04,590::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:04,591::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:04,592::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:04,592::__init__::232::IOProcess::(_processLogs) (199756) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:04,592::__init__::232::IOProcess::(_processLogs) (199756) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:04,593::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:04,593::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:04,593::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:04,594::__init__::232::IOProcess::(_processLogs) (199757) Got request for method 'glob' >Thread-135526::DEBUG::2014-10-29 11:09:04,594::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:09:04,594::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199757) Queuing response >Thread-135526::INFO::2014-10-29 11:09:04,596::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135526::INFO::2014-10-29 11:09:04,596::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135526::INFO::2014-10-29 11:09:04,597::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:09:04,597::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:04,598::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:04,598::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:04,598::__init__::232::IOProcess::(_processLogs) (199758) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:09:04,599::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199758) Queuing response >Thread-135526::DEBUG::2014-10-29 11:09:04,599::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135526::DEBUG::2014-10-29 11:09:04,601::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`750f6b32-1672-47d1-83f9-25062241e922`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135526::DEBUG::2014-10-29 11:09:04,602::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135526::DEBUG::2014-10-29 11:09:04,602::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135526::DEBUG::2014-10-29 11:09:04,602::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`750f6b32-1672-47d1-83f9-25062241e922`::Granted request >Thread-135526::DEBUG::2014-10-29 11:09:04,603::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e767cdaf-cba2-4457-96a4-af1fd01faded`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135526::DEBUG::2014-10-29 11:09:04,603::task::993::Storage.TaskManager.Task::(_decref) Task=`e767cdaf-cba2-4457-96a4-af1fd01faded`::ref 1 aborting False >Thread-135526::INFO::2014-10-29 11:09:04,606::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135526::DEBUG::2014-10-29 11:09:04,606::task::1191::Storage.TaskManager.Task::(prepare) Task=`e767cdaf-cba2-4457-96a4-af1fd01faded`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135526::DEBUG::2014-10-29 11:09:04,607::task::595::Storage.TaskManager.Task::(_updateState) Task=`e767cdaf-cba2-4457-96a4-af1fd01faded`::moving from state preparing -> state finished >Thread-135526::DEBUG::2014-10-29 11:09:04,607::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135526::DEBUG::2014-10-29 11:09:04,607::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135526::DEBUG::2014-10-29 11:09:04,608::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135526::DEBUG::2014-10-29 11:09:04,608::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135526::DEBUG::2014-10-29 11:09:04,608::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135526::DEBUG::2014-10-29 11:09:04,608::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135526::DEBUG::2014-10-29 11:09:04,609::task::993::Storage.TaskManager.Task::(_decref) Task=`e767cdaf-cba2-4457-96a4-af1fd01faded`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:09:04,631::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53969 >Detector thread::DEBUG::2014-10-29 11:09:04,632::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53969 >Detector thread::DEBUG::2014-10-29 11:09:04,632::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53969 >Detector thread::DEBUG::2014-10-29 11:09:04,633::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53969) >Thread-135531::DEBUG::2014-10-29 11:09:04,671::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135531::DEBUG::2014-10-29 11:09:04,672::task::595::Storage.TaskManager.Task::(_updateState) Task=`ae02bdfe-f049-45c2-b1b8-ed373996305b`::moving from state init -> state preparing >Thread-135531::INFO::2014-10-29 11:09:04,672::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135531::INFO::2014-10-29 11:09:04,673::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458257', 'lastCheck': '2.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486455', 'lastCheck': '2.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595573', 'lastCheck': '3.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00141106', 'lastCheck': '3.1', 'valid': True}} >Thread-135531::DEBUG::2014-10-29 11:09:04,673::task::1191::Storage.TaskManager.Task::(prepare) Task=`ae02bdfe-f049-45c2-b1b8-ed373996305b`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458257', 'lastCheck': '2.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486455', 'lastCheck': '2.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595573', 'lastCheck': '3.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00141106', 'lastCheck': '3.1', 'valid': True}} >Thread-135531::DEBUG::2014-10-29 11:09:04,673::task::595::Storage.TaskManager.Task::(_updateState) Task=`ae02bdfe-f049-45c2-b1b8-ed373996305b`::moving from state preparing -> state finished >Thread-135531::DEBUG::2014-10-29 11:09:04,674::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135531::DEBUG::2014-10-29 11:09:04,674::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135531::DEBUG::2014-10-29 11:09:04,674::task::993::Storage.TaskManager.Task::(_decref) Task=`ae02bdfe-f049-45c2-b1b8-ed373996305b`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:05,276::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:05,279::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135532::DEBUG::2014-10-29 11:09:05,284::task::595::Storage.TaskManager.Task::(_updateState) Task=`8af259de-1745-4693-af12-f2277730d4e2`::moving from state init -> state preparing >Thread-135532::INFO::2014-10-29 11:09:05,284::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135532::INFO::2014-10-29 11:09:05,285::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458257', 'lastCheck': '3.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486455', 'lastCheck': '3.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595573', 'lastCheck': '3.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00141106', 'lastCheck': '3.7', 'valid': True}} >Thread-135532::DEBUG::2014-10-29 11:09:05,285::task::1191::Storage.TaskManager.Task::(prepare) Task=`8af259de-1745-4693-af12-f2277730d4e2`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458257', 'lastCheck': '3.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486455', 'lastCheck': '3.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595573', 'lastCheck': '3.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00141106', 'lastCheck': '3.7', 'valid': True}} >Thread-135532::DEBUG::2014-10-29 11:09:05,285::task::595::Storage.TaskManager.Task::(_updateState) Task=`8af259de-1745-4693-af12-f2277730d4e2`::moving from state preparing -> state finished >Thread-135532::DEBUG::2014-10-29 11:09:05,286::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135532::DEBUG::2014-10-29 11:09:05,286::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135532::DEBUG::2014-10-29 11:09:05,286::task::993::Storage.TaskManager.Task::(_decref) Task=`8af259de-1745-4693-af12-f2277730d4e2`::ref 0 aborting False >Thread-135532::DEBUG::2014-10-29 11:09:05,308::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:05,332::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:05,334::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135533::DEBUG::2014-10-29 11:09:05,338::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135533::DEBUG::2014-10-29 11:09:05,340::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:08,392::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:08,393::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135534::DEBUG::2014-10-29 11:09:08,396::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:08,399::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:08,401::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135535::DEBUG::2014-10-29 11:09:08,403::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135535::DEBUG::2014-10-29 11:09:08,406::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:09,054::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:09,056::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:09,057::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:09:09,293::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53970 >Detector thread::DEBUG::2014-10-29 11:09:09,293::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53970 >Detector thread::DEBUG::2014-10-29 11:09:09,295::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53970 >Detector thread::DEBUG::2014-10-29 11:09:09,295::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53970) >Detector thread::DEBUG::2014-10-29 11:09:09,327::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53971 >Detector thread::DEBUG::2014-10-29 11:09:09,327::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53971 >Detector thread::DEBUG::2014-10-29 11:09:09,328::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53971 >Detector thread::DEBUG::2014-10-29 11:09:09,328::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53971) >Thread-135536::DEBUG::2014-10-29 11:09:09,333::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135536::DEBUG::2014-10-29 11:09:09,334::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135536::DEBUG::2014-10-29 11:09:09,334::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.90', 'elapsedTime': '513581', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '89961265', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '58399', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '33658.40'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.67', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-135537::DEBUG::2014-10-29 11:09:09,368::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135537::DEBUG::2014-10-29 11:09:09,370::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135537::DEBUG::2014-10-29 11:09:09,389::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135537::DEBUG::2014-10-29 11:09:09,436::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '197', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '97', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:09:11,120::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53973 >Detector thread::DEBUG::2014-10-29 11:09:11,121::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53973 >Detector thread::DEBUG::2014-10-29 11:09:11,122::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53973 >Detector thread::DEBUG::2014-10-29 11:09:11,122::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53973) >Thread-135538::DEBUG::2014-10-29 11:09:11,162::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c303237-43e6-4e1d-a814-0034dbfa3b44`::moving from state init -> state preparing >Thread-135538::INFO::2014-10-29 11:09:11,163::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135538::INFO::2014-10-29 11:09:11,163::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458257', 'lastCheck': '9.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486455', 'lastCheck': '9.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595573', 'lastCheck': '9.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00141106', 'lastCheck': '9.6', 'valid': True}} >Thread-135538::DEBUG::2014-10-29 11:09:11,164::task::1191::Storage.TaskManager.Task::(prepare) Task=`4c303237-43e6-4e1d-a814-0034dbfa3b44`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458257', 'lastCheck': '9.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486455', 'lastCheck': '9.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595573', 'lastCheck': '9.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00141106', 'lastCheck': '9.6', 'valid': True}} >Thread-135538::DEBUG::2014-10-29 11:09:11,164::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c303237-43e6-4e1d-a814-0034dbfa3b44`::moving from state preparing -> state finished >Thread-135538::DEBUG::2014-10-29 11:09:11,164::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135538::DEBUG::2014-10-29 11:09:11,165::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135538::DEBUG::2014-10-29 11:09:11,165::task::993::Storage.TaskManager.Task::(_decref) Task=`4c303237-43e6-4e1d-a814-0034dbfa3b44`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:11,428::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:11,431::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135539::DEBUG::2014-10-29 11:09:11,434::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:11,437::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:11,438::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135540::DEBUG::2014-10-29 11:09:11,442::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135540::DEBUG::2014-10-29 11:09:11,444::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:09:11,487::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:11,487::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:11,488::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:11,488::__init__::232::IOProcess::(_processLogs) (199759) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:11,493::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199759) Queuing response >Thread-179::DEBUG::2014-10-29 11:09:11,494::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:09:11,515::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00149143 s, 249 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:09:11,517::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:11,517::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:11,518::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:11,518::__init__::232::IOProcess::(_processLogs) (199760) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:11,518::__init__::232::IOProcess::(_processLogs) (199760) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:11,548::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:11,549::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:11,549::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:11,549::__init__::232::IOProcess::(_processLogs) (199761) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:11,551::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199761) Queuing response >Thread-10269::DEBUG::2014-10-29 11:09:11,552::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:09:11,569::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000583926 s, 860 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:09:11,571::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:11,572::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:11,572::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:11,572::__init__::232::IOProcess::(_processLogs) (199762) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:11,574::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199762) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:11,738::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:11,738::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:11,739::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:11,739::__init__::232::IOProcess::(_processLogs) (199763) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:11,740::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199763) Queuing response >Thread-178::DEBUG::2014-10-29 11:09:11,742::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:09:11,758::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000540912 s, 939 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:09:11,760::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:11,761::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:11,761::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:11,762::__init__::232::IOProcess::(_processLogs) (199764) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:11,763::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199764) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:11,765::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:11,765::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:11,765::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:11,766::__init__::232::IOProcess::(_processLogs) (199765) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:11,767::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199765) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:11,768::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:11,768::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:11,768::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:11,768::__init__::232::IOProcess::(_processLogs) (199766) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:11,769::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199766) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:11,770::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:11,770::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:11,771::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:11,771::__init__::232::IOProcess::(_processLogs) (199767) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:11,771::__init__::232::IOProcess::(_processLogs) (199767) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:12,064::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:12,065::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:12,065::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:12,065::__init__::232::IOProcess::(_processLogs) (199768) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:12,066::__init__::232::IOProcess::(_processLogs) (199768) Queuing response >Thread-33::DEBUG::2014-10-29 11:09:12,067::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:09:12,084::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000540506 s, 901 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:09:12,086::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:12,086::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:12,086::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:12,087::__init__::232::IOProcess::(_processLogs) (199769) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:12,088::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199769) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:12,090::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:12,090::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:12,091::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:12,092::__init__::232::IOProcess::(_processLogs) (199770) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:12,092::__init__::232::IOProcess::(_processLogs) (199770) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:12,093::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:12,093::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:12,094::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:12,095::__init__::232::IOProcess::(_processLogs) (199771) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:12,095::__init__::232::IOProcess::(_processLogs) (199771) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:12,096::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:12,096::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:12,097::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:12,097::__init__::232::IOProcess::(_processLogs) (199772) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:12,099::__init__::232::IOProcess::(_processLogs) (199772) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:14,064::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:14,065::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:14,066::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:14,458::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:14,461::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135541::DEBUG::2014-10-29 11:09:14,465::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:14,468::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:14,470::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135542::DEBUG::2014-10-29 11:09:14,474::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135542::DEBUG::2014-10-29 11:09:14,476::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:09:15,265::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53975 >Detector thread::DEBUG::2014-10-29 11:09:15,266::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53975 >Detector thread::DEBUG::2014-10-29 11:09:15,266::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53975 >Detector thread::DEBUG::2014-10-29 11:09:15,267::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53975) >Thread-135543::DEBUG::2014-10-29 11:09:15,306::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135543::DEBUG::2014-10-29 11:09:15,308::task::595::Storage.TaskManager.Task::(_updateState) Task=`f50f7a2d-c9c8-49ec-b02f-c6edcefa6fa8`::moving from state init -> state preparing >Thread-135543::INFO::2014-10-29 11:09:15,308::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135543::DEBUG::2014-10-29 11:09:15,311::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:09:15,312::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:15,313::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:15,313::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:15,313::__init__::232::IOProcess::(_processLogs) (199773) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:09:15,314::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199773) Queuing response >Thread-135543::DEBUG::2014-10-29 11:09:15,314::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135543::DEBUG::2014-10-29 11:09:15,316::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135543::INFO::2014-10-29 11:09:15,316::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135543::DEBUG::2014-10-29 11:09:15,316::task::1191::Storage.TaskManager.Task::(prepare) Task=`f50f7a2d-c9c8-49ec-b02f-c6edcefa6fa8`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135543::DEBUG::2014-10-29 11:09:15,317::task::595::Storage.TaskManager.Task::(_updateState) Task=`f50f7a2d-c9c8-49ec-b02f-c6edcefa6fa8`::moving from state preparing -> state finished >Thread-135543::DEBUG::2014-10-29 11:09:15,317::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135543::DEBUG::2014-10-29 11:09:15,317::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135543::DEBUG::2014-10-29 11:09:15,318::task::993::Storage.TaskManager.Task::(_decref) Task=`f50f7a2d-c9c8-49ec-b02f-c6edcefa6fa8`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:09:15,362::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53976 >Detector thread::DEBUG::2014-10-29 11:09:15,362::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53976 >Detector thread::DEBUG::2014-10-29 11:09:15,363::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53976 >Detector thread::DEBUG::2014-10-29 11:09:15,363::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53976) >Thread-135544::DEBUG::2014-10-29 11:09:15,402::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135544::DEBUG::2014-10-29 11:09:15,402::task::595::Storage.TaskManager.Task::(_updateState) Task=`d250ea7c-6931-4d4a-b1ca-178143e97c94`::moving from state init -> state preparing >Thread-135544::INFO::2014-10-29 11:09:15,403::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135544::DEBUG::2014-10-29 11:09:15,403::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135544::DEBUG::2014-10-29 11:09:15,403::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135544::DEBUG::2014-10-29 11:09:15,404::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135544::DEBUG::2014-10-29 11:09:15,404::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135544::DEBUG::2014-10-29 11:09:15,404::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135544::DEBUG::2014-10-29 11:09:15,405::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135544::DEBUG::2014-10-29 11:09:15,500::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135544::DEBUG::2014-10-29 11:09:15,501::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135544::DEBUG::2014-10-29 11:09:15,665::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135544::DEBUG::2014-10-29 11:09:15,668::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135544::DEBUG::2014-10-29 11:09:15,668::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135544::DEBUG::2014-10-29 11:09:15,669::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135544::DEBUG::2014-10-29 11:09:15,669::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135544::DEBUG::2014-10-29 11:09:15,669::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135544::DEBUG::2014-10-29 11:09:15,670::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135544::DEBUG::2014-10-29 11:09:15,670::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:09:15,677::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:15,679::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:15,679::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:15,679::__init__::232::IOProcess::(_processLogs) (199774) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:09:15,680::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199774) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:15,682::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:15,683::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:15,683::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:15,683::__init__::232::IOProcess::(_processLogs) (199775) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:09:15,683::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:15,684::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:15,684::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:15,684::__init__::232::IOProcess::(_processLogs) (199776) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:09:15,685::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:15,685::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:15,685::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:15,686::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199777) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:09:15,689::__init__::232::IOProcess::(_processLogs) (199775) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:15,691::__init__::232::IOProcess::(_processLogs) (199776) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:15,693::__init__::232::IOProcess::(_processLogs) (199777) Queuing response >Thread-135544::DEBUG::2014-10-29 11:09:15,700::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:09:15,702::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:15,702::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:15,702::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:15,702::__init__::232::IOProcess::(_processLogs) (199778) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:09:15,706::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199778) Queuing response >Thread-135544::DEBUG::2014-10-29 11:09:15,707::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:09:15,708::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:15,709::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:15,709::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:15,709::__init__::232::IOProcess::(_processLogs) (199779) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:09:15,710::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199779) Queuing response >Thread-135544::DEBUG::2014-10-29 11:09:15,711::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:09:15,712::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:15,713::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:15,713::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:15,714::__init__::232::IOProcess::(_processLogs) (199780) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:15,714::__init__::232::IOProcess::(_processLogs) (199780) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:15,715::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:15,715::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:15,715::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:15,715::__init__::232::IOProcess::(_processLogs) (199781) Got request for method 'glob' >Thread-135544::DEBUG::2014-10-29 11:09:15,716::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:09:15,716::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199781) Queuing response >Thread-135544::INFO::2014-10-29 11:09:15,717::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135544::INFO::2014-10-29 11:09:15,718::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135544::INFO::2014-10-29 11:09:15,719::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:09:15,719::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:15,720::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:15,720::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:15,720::__init__::232::IOProcess::(_processLogs) (199782) Got request for method 'readfile' >Thread-135544::DEBUG::2014-10-29 11:09:15,723::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:09:15,723::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199782) Queuing response >Thread-135544::DEBUG::2014-10-29 11:09:15,727::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`ffa09f07-d344-46d8-8fac-56f431a58f49`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135544::DEBUG::2014-10-29 11:09:15,727::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135544::DEBUG::2014-10-29 11:09:15,727::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135544::DEBUG::2014-10-29 11:09:15,728::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`ffa09f07-d344-46d8-8fac-56f431a58f49`::Granted request >Thread-135544::DEBUG::2014-10-29 11:09:15,728::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d250ea7c-6931-4d4a-b1ca-178143e97c94`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135544::DEBUG::2014-10-29 11:09:15,729::task::993::Storage.TaskManager.Task::(_decref) Task=`d250ea7c-6931-4d4a-b1ca-178143e97c94`::ref 1 aborting False >Thread-135544::INFO::2014-10-29 11:09:15,732::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135544::DEBUG::2014-10-29 11:09:15,732::task::1191::Storage.TaskManager.Task::(prepare) Task=`d250ea7c-6931-4d4a-b1ca-178143e97c94`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135544::DEBUG::2014-10-29 11:09:15,732::task::595::Storage.TaskManager.Task::(_updateState) Task=`d250ea7c-6931-4d4a-b1ca-178143e97c94`::moving from state preparing -> state finished >Thread-135544::DEBUG::2014-10-29 11:09:15,733::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135544::DEBUG::2014-10-29 11:09:15,733::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135544::DEBUG::2014-10-29 11:09:15,733::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135544::DEBUG::2014-10-29 11:09:15,734::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135544::DEBUG::2014-10-29 11:09:15,734::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135544::DEBUG::2014-10-29 11:09:15,734::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135544::DEBUG::2014-10-29 11:09:15,735::task::993::Storage.TaskManager.Task::(_decref) Task=`d250ea7c-6931-4d4a-b1ca-178143e97c94`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:09:15,768::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53977 >Detector thread::DEBUG::2014-10-29 11:09:15,768::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53977 >Detector thread::DEBUG::2014-10-29 11:09:15,769::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53977 >Detector thread::DEBUG::2014-10-29 11:09:15,769::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53977) >Thread-135549::DEBUG::2014-10-29 11:09:15,808::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135549::DEBUG::2014-10-29 11:09:15,809::task::595::Storage.TaskManager.Task::(_updateState) Task=`88bfc85e-6f8a-4558-b7ad-1da7ebfd4f86`::moving from state init -> state preparing >Thread-135549::INFO::2014-10-29 11:09:15,809::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135549::INFO::2014-10-29 11:09:15,810::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540912', 'lastCheck': '4.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540506', 'lastCheck': '3.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00149143', 'lastCheck': '4.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000583926', 'lastCheck': '4.2', 'valid': True}} >Thread-135549::DEBUG::2014-10-29 11:09:15,810::task::1191::Storage.TaskManager.Task::(prepare) Task=`88bfc85e-6f8a-4558-b7ad-1da7ebfd4f86`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540912', 'lastCheck': '4.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540506', 'lastCheck': '3.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00149143', 'lastCheck': '4.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000583926', 'lastCheck': '4.2', 'valid': True}} >Thread-135549::DEBUG::2014-10-29 11:09:15,810::task::595::Storage.TaskManager.Task::(_updateState) Task=`88bfc85e-6f8a-4558-b7ad-1da7ebfd4f86`::moving from state preparing -> state finished >Thread-135549::DEBUG::2014-10-29 11:09:15,811::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135549::DEBUG::2014-10-29 11:09:15,811::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135549::DEBUG::2014-10-29 11:09:15,811::task::993::Storage.TaskManager.Task::(_decref) Task=`88bfc85e-6f8a-4558-b7ad-1da7ebfd4f86`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:09:16,689::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:17,489::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:17,492::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135550::DEBUG::2014-10-29 11:09:17,495::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:17,497::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:17,499::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135551::DEBUG::2014-10-29 11:09:17,501::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135551::DEBUG::2014-10-29 11:09:17,504::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:19,074::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:19,075::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:19,076::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:09:19,486::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53978 >Detector thread::DEBUG::2014-10-29 11:09:19,487::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53978 >Detector thread::DEBUG::2014-10-29 11:09:19,490::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53978 >Detector thread::DEBUG::2014-10-29 11:09:19,490::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53978) >Detector thread::DEBUG::2014-10-29 11:09:19,509::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53979 >Detector thread::DEBUG::2014-10-29 11:09:19,509::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53979 >Detector thread::DEBUG::2014-10-29 11:09:19,509::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53979 >Detector thread::DEBUG::2014-10-29 11:09:19,510::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53979) >Thread-135552::DEBUG::2014-10-29 11:09:19,527::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135552::DEBUG::2014-10-29 11:09:19,529::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135552::DEBUG::2014-10-29 11:09:19,550::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135553::DEBUG::2014-10-29 11:09:19,551::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135553::DEBUG::2014-10-29 11:09:19,557::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135553::DEBUG::2014-10-29 11:09:19,561::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.47', 'elapsedTime': '513592', 'displayType': 'vnc', 'cpuSys': '0.40', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '89961265', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '58399', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '33658.40'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.86', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-135552::DEBUG::2014-10-29 11:09:19,614::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '179', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '79', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:09:20,229::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53981 >Detector thread::DEBUG::2014-10-29 11:09:20,230::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53981 >Detector thread::DEBUG::2014-10-29 11:09:20,230::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53981 >Detector thread::DEBUG::2014-10-29 11:09:20,231::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53981) >Thread-135554::DEBUG::2014-10-29 11:09:20,274::task::595::Storage.TaskManager.Task::(_updateState) Task=`b4f84ede-4b82-46b4-88eb-d5291a0496b6`::moving from state init -> state preparing >Thread-135554::INFO::2014-10-29 11:09:20,274::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135554::INFO::2014-10-29 11:09:20,275::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540912', 'lastCheck': '8.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540506', 'lastCheck': '8.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00149143', 'lastCheck': '8.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000583926', 'lastCheck': '8.7', 'valid': True}} >Thread-135554::DEBUG::2014-10-29 11:09:20,275::task::1191::Storage.TaskManager.Task::(prepare) Task=`b4f84ede-4b82-46b4-88eb-d5291a0496b6`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540912', 'lastCheck': '8.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540506', 'lastCheck': '8.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00149143', 'lastCheck': '8.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000583926', 'lastCheck': '8.7', 'valid': True}} >Thread-135554::DEBUG::2014-10-29 11:09:20,276::task::595::Storage.TaskManager.Task::(_updateState) Task=`b4f84ede-4b82-46b4-88eb-d5291a0496b6`::moving from state preparing -> state finished >Thread-135554::DEBUG::2014-10-29 11:09:20,276::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135554::DEBUG::2014-10-29 11:09:20,276::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135554::DEBUG::2014-10-29 11:09:20,276::task::993::Storage.TaskManager.Task::(_decref) Task=`b4f84ede-4b82-46b4-88eb-d5291a0496b6`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:20,517::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:20,520::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135555::DEBUG::2014-10-29 11:09:20,524::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e2d61d4-1a07-4d7d-84e4-e2bf8e8ed4fe`::moving from state init -> state preparing >Thread-135555::INFO::2014-10-29 11:09:20,524::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135555::INFO::2014-10-29 11:09:20,525::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540912', 'lastCheck': '8.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540506', 'lastCheck': '8.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00149143', 'lastCheck': '9.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000583926', 'lastCheck': '8.9', 'valid': True}} >Thread-135555::DEBUG::2014-10-29 11:09:20,525::task::1191::Storage.TaskManager.Task::(prepare) Task=`9e2d61d4-1a07-4d7d-84e4-e2bf8e8ed4fe`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540912', 'lastCheck': '8.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540506', 'lastCheck': '8.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00149143', 'lastCheck': '9.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000583926', 'lastCheck': '8.9', 'valid': True}} >Thread-135555::DEBUG::2014-10-29 11:09:20,525::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e2d61d4-1a07-4d7d-84e4-e2bf8e8ed4fe`::moving from state preparing -> state finished >Thread-135555::DEBUG::2014-10-29 11:09:20,526::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135555::DEBUG::2014-10-29 11:09:20,526::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135555::DEBUG::2014-10-29 11:09:20,526::task::993::Storage.TaskManager.Task::(_decref) Task=`9e2d61d4-1a07-4d7d-84e4-e2bf8e8ed4fe`::ref 0 aborting False >Thread-135555::DEBUG::2014-10-29 11:09:20,546::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:20,570::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:20,572::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135556::DEBUG::2014-10-29 11:09:20,575::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135556::DEBUG::2014-10-29 11:09:20,578::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:09:21,522::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:21,523::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:21,523::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:21,523::__init__::232::IOProcess::(_processLogs) (199783) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:21,577::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:21,577::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:21,577::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:21,578::__init__::232::IOProcess::(_processLogs) (199784) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:21,774::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:21,774::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:21,774::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:21,774::__init__::232::IOProcess::(_processLogs) (199785) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:22,099::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:22,100::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:22,100::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:22,100::__init__::232::IOProcess::(_processLogs) (199786) Got request for method 'statvfs' >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:23,647::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:23,650::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135557::DEBUG::2014-10-29 11:09:23,653::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:23,655::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:23,657::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135558::DEBUG::2014-10-29 11:09:23,660::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135558::DEBUG::2014-10-29 11:09:23,662::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:24,083::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:24,084::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:24,086::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:09:24,286::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199785) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:24,289::__init__::232::IOProcess::(_processLogs) (199786) Queuing response >Thread-178::DEBUG::2014-10-29 11:09:24,290::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:09:24,315::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199784) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:24,317::__init__::232::IOProcess::(_processLogs) (199783) Queuing response >Thread-178::DEBUG::2014-10-29 11:09:24,317::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00043934 s, 1.2 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-10-29 11:09:24,317::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:09:24,341::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000476254 s, 1.0 MB/s\n'; <rc> = 0 >Thread-10269::DEBUG::2014-10-29 11:09:24,346::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:09:24,368::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-179::DEBUG::2014-10-29 11:09:24,369::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:09:24,371::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000524667 s, 957 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:09:24,372::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-179::DEBUG::2014-10-29 11:09:24,393::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000418418 s, 889 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:09:24,393::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:24,395::__init__::232::IOProcess::(_processLogs) (199787) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:24,397::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199787) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:24,399::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:24,400::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:24,400::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:24,400::__init__::232::IOProcess::(_processLogs) (199788) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:24,402::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199788) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:24,403::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:24,403::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:24,404::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:24,404::__init__::232::IOProcess::(_processLogs) (199789) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:24,404::__init__::232::IOProcess::(_processLogs) (199789) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:24,407::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:24,408::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:24,409::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:24,410::__init__::232::IOProcess::(_processLogs) (199790) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:24,410::__init__::232::IOProcess::(_processLogs) (199790) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:24,411::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:24,414::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:24,415::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:24,415::__init__::232::IOProcess::(_processLogs) (199791) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:24,416::__init__::232::IOProcess::(_processLogs) (199791) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:24,417::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:24,418::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:24,418::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:24,418::__init__::232::IOProcess::(_processLogs) (199792) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:24,418::__init__::232::IOProcess::(_processLogs) (199792) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:24,419::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:24,420::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:24,421::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:24,421::__init__::232::IOProcess::(_processLogs) (199793) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:24,421::__init__::232::IOProcess::(_processLogs) (199793) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:24,421::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:24,422::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:24,423::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:24,424::__init__::232::IOProcess::(_processLogs) (199794) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:24,424::__init__::232::IOProcess::(_processLogs) (199794) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:24,424::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:24,425::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:24,426::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:24,427::__init__::232::IOProcess::(_processLogs) (199795) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:24,427::__init__::232::IOProcess::(_processLogs) (199795) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:24,427::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:24,428::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:24,429::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:24,430::__init__::232::IOProcess::(_processLogs) (199796) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:24,430::__init__::232::IOProcess::(_processLogs) (199796) Queuing response >Detector thread::DEBUG::2014-10-29 11:09:26,395::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53983 >Detector thread::DEBUG::2014-10-29 11:09:26,396::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53983 >Detector thread::DEBUG::2014-10-29 11:09:26,396::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53983 >Detector thread::DEBUG::2014-10-29 11:09:26,397::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53983) >Thread-135559::DEBUG::2014-10-29 11:09:26,436::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135559::DEBUG::2014-10-29 11:09:26,437::task::595::Storage.TaskManager.Task::(_updateState) Task=`1543a506-5797-441e-b00f-9ae817aa3701`::moving from state init -> state preparing >Thread-135559::INFO::2014-10-29 11:09:26,438::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135559::DEBUG::2014-10-29 11:09:26,455::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:09:26,456::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:26,457::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:26,457::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:26,457::__init__::232::IOProcess::(_processLogs) (199797) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:09:27,291::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199797) Queuing response >Thread-135559::DEBUG::2014-10-29 11:09:27,292::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135559::DEBUG::2014-10-29 11:09:27,293::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135559::INFO::2014-10-29 11:09:27,293::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135559::DEBUG::2014-10-29 11:09:27,293::task::1191::Storage.TaskManager.Task::(prepare) Task=`1543a506-5797-441e-b00f-9ae817aa3701`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135559::DEBUG::2014-10-29 11:09:27,294::task::595::Storage.TaskManager.Task::(_updateState) Task=`1543a506-5797-441e-b00f-9ae817aa3701`::moving from state preparing -> state finished >Thread-135559::DEBUG::2014-10-29 11:09:27,294::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135559::DEBUG::2014-10-29 11:09:27,294::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135559::DEBUG::2014-10-29 11:09:27,294::task::993::Storage.TaskManager.Task::(_decref) Task=`1543a506-5797-441e-b00f-9ae817aa3701`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:27,312::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:27,315::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135560::DEBUG::2014-10-29 11:09:27,319::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:27,321::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:27,323::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135561::DEBUG::2014-10-29 11:09:27,328::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135561::DEBUG::2014-10-29 11:09:27,331::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:09:27,340::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53984 >Detector thread::DEBUG::2014-10-29 11:09:27,340::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53984 >Detector thread::DEBUG::2014-10-29 11:09:27,341::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53984 >Detector thread::DEBUG::2014-10-29 11:09:27,341::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53984) >Thread-135562::DEBUG::2014-10-29 11:09:27,380::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135562::DEBUG::2014-10-29 11:09:27,381::task::595::Storage.TaskManager.Task::(_updateState) Task=`ebf7c896-c7aa-4ba1-a943-c6788a3e1fbf`::moving from state init -> state preparing >Thread-135562::INFO::2014-10-29 11:09:27,381::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135562::DEBUG::2014-10-29 11:09:27,382::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135562::DEBUG::2014-10-29 11:09:27,382::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135562::DEBUG::2014-10-29 11:09:27,382::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135562::DEBUG::2014-10-29 11:09:27,382::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135562::DEBUG::2014-10-29 11:09:27,383::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135562::DEBUG::2014-10-29 11:09:27,383::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135562::DEBUG::2014-10-29 11:09:27,460::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135562::DEBUG::2014-10-29 11:09:27,461::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135562::DEBUG::2014-10-29 11:09:27,636::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135562::DEBUG::2014-10-29 11:09:27,637::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135562::DEBUG::2014-10-29 11:09:27,637::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135562::DEBUG::2014-10-29 11:09:27,637::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135562::DEBUG::2014-10-29 11:09:27,638::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135562::DEBUG::2014-10-29 11:09:27,638::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135562::DEBUG::2014-10-29 11:09:27,639::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135562::DEBUG::2014-10-29 11:09:27,639::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:09:27,647::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:27,649::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:27,650::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:27,650::__init__::232::IOProcess::(_processLogs) (199798) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:09:27,651::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199798) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:27,652::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:27,653::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:27,653::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:27,654::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:27,654::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:27,654::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:27,654::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:27,654::__init__::232::IOProcess::(_processLogs) (199799) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:09:27,655::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:27,656::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199800) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:09:27,658::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:27,660::__init__::232::IOProcess::(_processLogs) (199801) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:09:27,662::__init__::232::IOProcess::(_processLogs) (199799) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:27,664::__init__::232::IOProcess::(_processLogs) (199801) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:27,666::__init__::232::IOProcess::(_processLogs) (199800) Queuing response >Thread-135562::DEBUG::2014-10-29 11:09:27,668::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:09:27,672::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:27,673::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:27,673::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:27,673::__init__::232::IOProcess::(_processLogs) (199802) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:09:27,675::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199802) Queuing response >Thread-135562::DEBUG::2014-10-29 11:09:27,676::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:09:27,677::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:27,678::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:27,678::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:27,678::__init__::232::IOProcess::(_processLogs) (199803) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:09:27,679::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199803) Queuing response >Thread-135562::DEBUG::2014-10-29 11:09:27,680::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:09:27,682::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:27,683::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:27,684::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:27,684::__init__::232::IOProcess::(_processLogs) (199804) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:27,684::__init__::232::IOProcess::(_processLogs) (199804) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:27,685::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:27,685::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:27,685::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:27,685::__init__::232::IOProcess::(_processLogs) (199805) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:09:27,686::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199805) Queuing response >Thread-135562::DEBUG::2014-10-29 11:09:27,686::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-135562::INFO::2014-10-29 11:09:27,688::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135562::INFO::2014-10-29 11:09:27,688::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135562::INFO::2014-10-29 11:09:27,688::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:09:27,689::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:27,689::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:27,690::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:27,690::__init__::232::IOProcess::(_processLogs) (199806) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:09:27,691::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199806) Queuing response >Thread-135562::DEBUG::2014-10-29 11:09:27,691::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135562::DEBUG::2014-10-29 11:09:27,693::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`0d1c922d-3f01-4ef1-94ff-929fff339e8a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135562::DEBUG::2014-10-29 11:09:27,693::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135562::DEBUG::2014-10-29 11:09:27,694::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135562::DEBUG::2014-10-29 11:09:27,694::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`0d1c922d-3f01-4ef1-94ff-929fff339e8a`::Granted request >Thread-135562::DEBUG::2014-10-29 11:09:27,695::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ebf7c896-c7aa-4ba1-a943-c6788a3e1fbf`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135562::DEBUG::2014-10-29 11:09:27,695::task::993::Storage.TaskManager.Task::(_decref) Task=`ebf7c896-c7aa-4ba1-a943-c6788a3e1fbf`::ref 1 aborting False >Thread-135562::INFO::2014-10-29 11:09:27,698::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135562::DEBUG::2014-10-29 11:09:27,698::task::1191::Storage.TaskManager.Task::(prepare) Task=`ebf7c896-c7aa-4ba1-a943-c6788a3e1fbf`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135562::DEBUG::2014-10-29 11:09:27,698::task::595::Storage.TaskManager.Task::(_updateState) Task=`ebf7c896-c7aa-4ba1-a943-c6788a3e1fbf`::moving from state preparing -> state finished >Thread-135562::DEBUG::2014-10-29 11:09:27,698::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135562::DEBUG::2014-10-29 11:09:27,699::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135562::DEBUG::2014-10-29 11:09:27,699::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135562::DEBUG::2014-10-29 11:09:27,699::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135562::DEBUG::2014-10-29 11:09:27,700::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135562::DEBUG::2014-10-29 11:09:27,700::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135562::DEBUG::2014-10-29 11:09:27,700::task::993::Storage.TaskManager.Task::(_decref) Task=`ebf7c896-c7aa-4ba1-a943-c6788a3e1fbf`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:09:27,723::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53985 >Detector thread::DEBUG::2014-10-29 11:09:27,723::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53985 >Detector thread::DEBUG::2014-10-29 11:09:27,724::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53985 >Detector thread::DEBUG::2014-10-29 11:09:27,724::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53985) >Thread-135567::DEBUG::2014-10-29 11:09:27,763::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135567::DEBUG::2014-10-29 11:09:27,764::task::595::Storage.TaskManager.Task::(_updateState) Task=`aed62b4e-fb5e-4946-abe0-73b0b2342cc5`::moving from state init -> state preparing >Thread-135567::INFO::2014-10-29 11:09:27,764::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135567::INFO::2014-10-29 11:09:27,765::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043934', 'lastCheck': '3.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000476254', 'lastCheck': '3.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418418', 'lastCheck': '3.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000524667', 'lastCheck': '3.4', 'valid': True}} >Thread-135567::DEBUG::2014-10-29 11:09:27,765::task::1191::Storage.TaskManager.Task::(prepare) Task=`aed62b4e-fb5e-4946-abe0-73b0b2342cc5`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043934', 'lastCheck': '3.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000476254', 'lastCheck': '3.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418418', 'lastCheck': '3.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000524667', 'lastCheck': '3.4', 'valid': True}} >Thread-135567::DEBUG::2014-10-29 11:09:27,765::task::595::Storage.TaskManager.Task::(_updateState) Task=`aed62b4e-fb5e-4946-abe0-73b0b2342cc5`::moving from state preparing -> state finished >Thread-135567::DEBUG::2014-10-29 11:09:27,765::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135567::DEBUG::2014-10-29 11:09:27,766::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135567::DEBUG::2014-10-29 11:09:27,766::task::993::Storage.TaskManager.Task::(_decref) Task=`aed62b4e-fb5e-4946-abe0-73b0b2342cc5`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:29,093::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:29,094::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:29,095::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:09:29,662::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53986 >Detector thread::DEBUG::2014-10-29 11:09:29,663::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53986 >Detector thread::DEBUG::2014-10-29 11:09:29,663::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53986 >Detector thread::DEBUG::2014-10-29 11:09:29,664::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53986) >Thread-135568::DEBUG::2014-10-29 11:09:29,703::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135568::DEBUG::2014-10-29 11:09:29,705::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135568::DEBUG::2014-10-29 11:09:29,725::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Detector thread::DEBUG::2014-10-29 11:09:29,735::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53987 >Detector thread::DEBUG::2014-10-29 11:09:29,737::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53987 >Detector thread::DEBUG::2014-10-29 11:09:29,737::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53987 >Detector thread::DEBUG::2014-10-29 11:09:29,737::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53987) >Thread-135569::DEBUG::2014-10-29 11:09:29,783::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135569::DEBUG::2014-10-29 11:09:29,787::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135569::DEBUG::2014-10-29 11:09:29,789::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.47', 'elapsedTime': '513602', 'displayType': 'vnc', 'cpuSys': '0.40', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '89961265', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '58399', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '33658.40'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.09', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-135568::DEBUG::2014-10-29 11:09:29,792::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '162', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '62', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:30,345::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:30,348::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135570::DEBUG::2014-10-29 11:09:30,351::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:30,353::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:30,355::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135571::DEBUG::2014-10-29 11:09:30,358::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135571::DEBUG::2014-10-29 11:09:30,360::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:09:30,377::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53989 >Detector thread::DEBUG::2014-10-29 11:09:30,378::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53989 >Detector thread::DEBUG::2014-10-29 11:09:30,378::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53989 >Detector thread::DEBUG::2014-10-29 11:09:30,378::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53989) >Thread-135572::DEBUG::2014-10-29 11:09:30,419::task::595::Storage.TaskManager.Task::(_updateState) Task=`7940bf24-929c-41cb-8ee1-ac2318176d00`::moving from state init -> state preparing >Thread-135572::INFO::2014-10-29 11:09:30,420::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135572::INFO::2014-10-29 11:09:30,421::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043934', 'lastCheck': '6.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000476254', 'lastCheck': '6.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418418', 'lastCheck': '6.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000524667', 'lastCheck': '6.0', 'valid': True}} >Thread-135572::DEBUG::2014-10-29 11:09:30,421::task::1191::Storage.TaskManager.Task::(prepare) Task=`7940bf24-929c-41cb-8ee1-ac2318176d00`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00043934', 'lastCheck': '6.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000476254', 'lastCheck': '6.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418418', 'lastCheck': '6.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000524667', 'lastCheck': '6.0', 'valid': True}} >Thread-135572::DEBUG::2014-10-29 11:09:30,421::task::595::Storage.TaskManager.Task::(_updateState) Task=`7940bf24-929c-41cb-8ee1-ac2318176d00`::moving from state preparing -> state finished >Thread-135572::DEBUG::2014-10-29 11:09:30,422::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135572::DEBUG::2014-10-29 11:09:30,422::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135572::DEBUG::2014-10-29 11:09:30,422::task::993::Storage.TaskManager.Task::(_decref) Task=`7940bf24-929c-41cb-8ee1-ac2318176d00`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:09:31,712::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >VM Channels Listener::DEBUG::2014-10-29 11:09:33,321::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:33,377::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:33,380::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135573::DEBUG::2014-10-29 11:09:33,383::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:33,386::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:33,388::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135574::DEBUG::2014-10-29 11:09:33,391::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135574::DEBUG::2014-10-29 11:09:33,393::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:34,101::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:34,103::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:34,104::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:09:34,408::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:34,409::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:34,409::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:34,409::__init__::232::IOProcess::(_processLogs) (199807) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:34,412::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199807) Queuing response >Thread-10269::DEBUG::2014-10-29 11:09:34,413::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:09:34,435::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000511626 s, 981 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:09:34,436::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:34,438::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:34,440::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:34,441::__init__::232::IOProcess::(_processLogs) (199808) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:34,442::__init__::232::IOProcess::(_processLogs) (199808) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:34,443::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:34,443::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:34,443::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:34,443::__init__::232::IOProcess::(_processLogs) (199809) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:34,444::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:34,444::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:34,444::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:34,445::__init__::232::IOProcess::(_processLogs) (199810) Got request for method 'statvfs' >Thread-179::DEBUG::2014-10-29 11:09:34,441::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:09:34,446::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199810) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:34,465::__init__::232::IOProcess::(_processLogs) (199809) Queuing response >Thread-33::DEBUG::2014-10-29 11:09:34,466::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:09:34,469::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-179::DEBUG::2014-10-29 11:09:34,483::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00182898 s, 203 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:09:34,487::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:34,491::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-33::DEBUG::2014-10-29 11:09:34,491::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00128703 s, 378 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:09:34,492::__init__::232::IOProcess::(_processLogs) (199811) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:34,494::__init__::232::IOProcess::(_processLogs) (199811) Queuing response >Thread-178::DEBUG::2014-10-29 11:09:34,497::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:09:34,516::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-178::DEBUG::2014-10-29 11:09:34,520::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000743076 s, 684 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:09:34,520::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:34,523::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:34,523::__init__::232::IOProcess::(_processLogs) (199812) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:34,524::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199812) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:34,526::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:34,527::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:34,528::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:34,528::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:34,529::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:34,529::__init__::232::IOProcess::(_processLogs) (199813) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:34,529::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:34,529::__init__::232::IOProcess::(_processLogs) (199814) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:34,531::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199814) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:34,532::__init__::232::IOProcess::(_processLogs) (199813) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:34,535::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:34,536::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:34,536::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:34,536::__init__::232::IOProcess::(_processLogs) (199815) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:34,537::__init__::232::IOProcess::(_processLogs) (199815) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:34,537::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:34,538::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:34,538::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:34,539::__init__::232::IOProcess::(_processLogs) (199816) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:34,539::__init__::232::IOProcess::(_processLogs) (199816) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:34,539::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:34,540::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:34,541::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:34,541::__init__::232::IOProcess::(_processLogs) (199817) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:34,541::__init__::232::IOProcess::(_processLogs) (199817) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:34,541::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:34,543::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:34,543::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:34,543::__init__::232::IOProcess::(_processLogs) (199818) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:34,543::__init__::232::IOProcess::(_processLogs) (199818) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:34,544::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:34,545::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:34,545::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:34,546::__init__::232::IOProcess::(_processLogs) (199819) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:34,547::__init__::232::IOProcess::(_processLogs) (199819) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:34,547::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:34,547::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:34,548::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:34,548::__init__::232::IOProcess::(_processLogs) (199820) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:34,549::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199820) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:36,407::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:36,410::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135575::DEBUG::2014-10-29 11:09:36,414::task::595::Storage.TaskManager.Task::(_updateState) Task=`48263182-2d3f-4e4f-8a59-9c4486d04b6c`::moving from state init -> state preparing >Thread-135575::INFO::2014-10-29 11:09:36,414::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135575::INFO::2014-10-29 11:09:36,415::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000743076', 'lastCheck': '1.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00128703', 'lastCheck': '1.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00182898', 'lastCheck': '1.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000511626', 'lastCheck': '1.9', 'valid': True}} >Thread-135575::DEBUG::2014-10-29 11:09:36,415::task::1191::Storage.TaskManager.Task::(prepare) Task=`48263182-2d3f-4e4f-8a59-9c4486d04b6c`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000743076', 'lastCheck': '1.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00128703', 'lastCheck': '1.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00182898', 'lastCheck': '1.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000511626', 'lastCheck': '1.9', 'valid': True}} >Thread-135575::DEBUG::2014-10-29 11:09:36,415::task::595::Storage.TaskManager.Task::(_updateState) Task=`48263182-2d3f-4e4f-8a59-9c4486d04b6c`::moving from state preparing -> state finished >Thread-135575::DEBUG::2014-10-29 11:09:36,416::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135575::DEBUG::2014-10-29 11:09:36,416::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135575::DEBUG::2014-10-29 11:09:36,416::task::993::Storage.TaskManager.Task::(_decref) Task=`48263182-2d3f-4e4f-8a59-9c4486d04b6c`::ref 0 aborting False >Thread-135575::DEBUG::2014-10-29 11:09:37,312::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:37,342::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:37,344::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135576::DEBUG::2014-10-29 11:09:37,347::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135576::DEBUG::2014-10-29 11:09:37,349::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:09:38,329::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53991 >Detector thread::DEBUG::2014-10-29 11:09:38,330::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53991 >Detector thread::DEBUG::2014-10-29 11:09:38,330::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53991 >Detector thread::DEBUG::2014-10-29 11:09:38,331::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53991) >Thread-135577::DEBUG::2014-10-29 11:09:38,370::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135577::DEBUG::2014-10-29 11:09:38,371::task::595::Storage.TaskManager.Task::(_updateState) Task=`cbd440a1-aae6-441b-87ef-e4e9bc7ab902`::moving from state init -> state preparing >Thread-135577::INFO::2014-10-29 11:09:38,371::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135577::DEBUG::2014-10-29 11:09:38,374::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:09:38,375::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:38,375::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:38,376::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:38,376::__init__::232::IOProcess::(_processLogs) (199821) Got request for method 'glob' >Thread-135577::DEBUG::2014-10-29 11:09:38,378::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:09:38,378::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199821) Queuing response >Thread-135577::DEBUG::2014-10-29 11:09:38,380::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135577::INFO::2014-10-29 11:09:38,381::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135577::DEBUG::2014-10-29 11:09:38,381::task::1191::Storage.TaskManager.Task::(prepare) Task=`cbd440a1-aae6-441b-87ef-e4e9bc7ab902`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135577::DEBUG::2014-10-29 11:09:38,381::task::595::Storage.TaskManager.Task::(_updateState) Task=`cbd440a1-aae6-441b-87ef-e4e9bc7ab902`::moving from state preparing -> state finished >Thread-135577::DEBUG::2014-10-29 11:09:38,382::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135577::DEBUG::2014-10-29 11:09:38,382::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135577::DEBUG::2014-10-29 11:09:38,382::task::993::Storage.TaskManager.Task::(_decref) Task=`cbd440a1-aae6-441b-87ef-e4e9bc7ab902`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:09:38,426::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53992 >Detector thread::DEBUG::2014-10-29 11:09:38,427::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53992 >Detector thread::DEBUG::2014-10-29 11:09:38,427::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53992 >Detector thread::DEBUG::2014-10-29 11:09:38,428::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53992) >Thread-135578::DEBUG::2014-10-29 11:09:38,466::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135578::DEBUG::2014-10-29 11:09:38,467::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d1dfc12-95f6-4b07-a15e-f0f22e81f817`::moving from state init -> state preparing >Thread-135578::INFO::2014-10-29 11:09:38,467::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135578::DEBUG::2014-10-29 11:09:38,467::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135578::DEBUG::2014-10-29 11:09:38,467::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135578::DEBUG::2014-10-29 11:09:38,468::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135578::DEBUG::2014-10-29 11:09:38,468::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135578::DEBUG::2014-10-29 11:09:38,469::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135578::DEBUG::2014-10-29 11:09:38,470::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135578::DEBUG::2014-10-29 11:09:38,560::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135578::DEBUG::2014-10-29 11:09:38,561::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135578::DEBUG::2014-10-29 11:09:38,722::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135578::DEBUG::2014-10-29 11:09:38,724::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135578::DEBUG::2014-10-29 11:09:38,724::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135578::DEBUG::2014-10-29 11:09:38,724::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135578::DEBUG::2014-10-29 11:09:38,725::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135578::DEBUG::2014-10-29 11:09:38,725::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135578::DEBUG::2014-10-29 11:09:38,726::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135578::DEBUG::2014-10-29 11:09:38,726::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:09:38,736::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:38,737::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:38,738::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:38,738::__init__::232::IOProcess::(_processLogs) (199822) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:09:38,739::__init__::232::IOProcess::(_processLogs) (199822) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:38,740::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:38,741::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:38,742::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:38,744::__init__::232::IOProcess::(_processLogs) (199823) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:09:38,746::__init__::232::IOProcess::(_processLogs) (199823) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:38,748::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:38,750::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:38,752::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-135578::DEBUG::2014-10-29 11:09:38,754::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:09:38,754::__init__::232::IOProcess::(_processLogs) (199824) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:09:38,757::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199824) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:38,758::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:38,759::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:38,760::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:38,760::__init__::232::IOProcess::(_processLogs) (199825) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:09:38,760::__init__::232::IOProcess::(_processLogs) (199825) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:38,760::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:38,761::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:38,761::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:38,761::__init__::232::IOProcess::(_processLogs) (199826) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:09:38,763::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199826) Queuing response >Thread-135578::DEBUG::2014-10-29 11:09:38,764::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:09:38,766::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:38,766::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:38,766::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:38,767::__init__::232::IOProcess::(_processLogs) (199827) Got request for method 'readfile' >Thread-135578::DEBUG::2014-10-29 11:09:38,768::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:09:38,768::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199827) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:38,770::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:38,770::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:38,771::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:38,772::__init__::232::IOProcess::(_processLogs) (199828) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:38,772::__init__::232::IOProcess::(_processLogs) (199828) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:38,773::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:38,773::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-135578::DEBUG::2014-10-29 11:09:38,774::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:09:38,774::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-135578::INFO::2014-10-29 11:09:38,775::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135578::INFO::2014-10-29 11:09:38,776::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:09:38,776::__init__::232::IOProcess::(_processLogs) (199829) Got request for method 'glob' >Thread-135578::INFO::2014-10-29 11:09:38,777::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:09:38,778::__init__::232::IOProcess::(_processLogs) (199829) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:38,779::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:38,780::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:38,780::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:38,780::__init__::232::IOProcess::(_processLogs) (199830) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:09:38,781::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199830) Queuing response >Thread-135578::DEBUG::2014-10-29 11:09:38,781::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135578::DEBUG::2014-10-29 11:09:38,784::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`1f460f81-a6a2-4405-9ca6-b38a99027b08`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135578::DEBUG::2014-10-29 11:09:38,784::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135578::DEBUG::2014-10-29 11:09:38,784::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135578::DEBUG::2014-10-29 11:09:38,785::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`1f460f81-a6a2-4405-9ca6-b38a99027b08`::Granted request >Thread-135578::DEBUG::2014-10-29 11:09:38,785::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3d1dfc12-95f6-4b07-a15e-f0f22e81f817`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135578::DEBUG::2014-10-29 11:09:38,786::task::993::Storage.TaskManager.Task::(_decref) Task=`3d1dfc12-95f6-4b07-a15e-f0f22e81f817`::ref 1 aborting False >Thread-135578::INFO::2014-10-29 11:09:38,788::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135578::DEBUG::2014-10-29 11:09:38,789::task::1191::Storage.TaskManager.Task::(prepare) Task=`3d1dfc12-95f6-4b07-a15e-f0f22e81f817`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135578::DEBUG::2014-10-29 11:09:38,789::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d1dfc12-95f6-4b07-a15e-f0f22e81f817`::moving from state preparing -> state finished >Thread-135578::DEBUG::2014-10-29 11:09:38,789::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135578::DEBUG::2014-10-29 11:09:38,789::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135578::DEBUG::2014-10-29 11:09:38,790::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135578::DEBUG::2014-10-29 11:09:38,790::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135578::DEBUG::2014-10-29 11:09:38,790::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135578::DEBUG::2014-10-29 11:09:38,791::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135578::DEBUG::2014-10-29 11:09:38,791::task::993::Storage.TaskManager.Task::(_decref) Task=`3d1dfc12-95f6-4b07-a15e-f0f22e81f817`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:09:38,813::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53993 >Detector thread::DEBUG::2014-10-29 11:09:38,814::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53993 >Detector thread::DEBUG::2014-10-29 11:09:38,814::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53993 >Detector thread::DEBUG::2014-10-29 11:09:38,815::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53993) >Thread-135583::DEBUG::2014-10-29 11:09:38,853::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135583::DEBUG::2014-10-29 11:09:38,854::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0dc18f0-9774-4191-8881-9692566dccb4`::moving from state init -> state preparing >Thread-135583::INFO::2014-10-29 11:09:38,854::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135583::INFO::2014-10-29 11:09:38,855::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000743076', 'lastCheck': '4.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00128703', 'lastCheck': '4.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00182898', 'lastCheck': '4.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000511626', 'lastCheck': '4.3', 'valid': True}} >Thread-135583::DEBUG::2014-10-29 11:09:38,855::task::1191::Storage.TaskManager.Task::(prepare) Task=`b0dc18f0-9774-4191-8881-9692566dccb4`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000743076', 'lastCheck': '4.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00128703', 'lastCheck': '4.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00182898', 'lastCheck': '4.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000511626', 'lastCheck': '4.3', 'valid': True}} >Thread-135583::DEBUG::2014-10-29 11:09:38,855::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0dc18f0-9774-4191-8881-9692566dccb4`::moving from state preparing -> state finished >Thread-135583::DEBUG::2014-10-29 11:09:38,855::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135583::DEBUG::2014-10-29 11:09:38,856::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135583::DEBUG::2014-10-29 11:09:38,856::task::993::Storage.TaskManager.Task::(_decref) Task=`b0dc18f0-9774-4191-8881-9692566dccb4`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:39,111::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:39,112::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:39,113::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:09:39,864::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53994 >Detector thread::DEBUG::2014-10-29 11:09:39,865::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53994 >Detector thread::DEBUG::2014-10-29 11:09:39,865::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53994 >Detector thread::DEBUG::2014-10-29 11:09:39,865::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53994) >Thread-135584::DEBUG::2014-10-29 11:09:39,904::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135584::DEBUG::2014-10-29 11:09:39,908::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135584::DEBUG::2014-10-29 11:09:39,927::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Detector thread::DEBUG::2014-10-29 11:09:39,967::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53995 >Detector thread::DEBUG::2014-10-29 11:09:39,970::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53995 >Detector thread::DEBUG::2014-10-29 11:09:39,972::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53995 >Detector thread::DEBUG::2014-10-29 11:09:39,975::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53995) >Thread-135584::DEBUG::2014-10-29 11:09:40,006::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '142', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '42', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-135585::DEBUG::2014-10-29 11:09:40,010::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135585::DEBUG::2014-10-29 11:09:40,019::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135585::DEBUG::2014-10-29 11:09:40,026::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.23', 'elapsedTime': '513612', 'displayType': 'vnc', 'cpuSys': '0.67', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '89961265', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '58399', 'readRate': '0.00', 'truesize': '6010855424', 'writeRate': '33658.40'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.30', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:40,446::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:40,448::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135586::DEBUG::2014-10-29 11:09:40,452::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:40,454::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:40,456::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135587::DEBUG::2014-10-29 11:09:40,459::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135587::DEBUG::2014-10-29 11:09:40,461::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:09:40,518::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53997 >Detector thread::DEBUG::2014-10-29 11:09:40,519::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53997 >Detector thread::DEBUG::2014-10-29 11:09:40,519::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53997 >Detector thread::DEBUG::2014-10-29 11:09:40,520::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53997) >Thread-135588::DEBUG::2014-10-29 11:09:40,559::task::595::Storage.TaskManager.Task::(_updateState) Task=`1bd6228a-357a-4dfa-b292-620694608647`::moving from state init -> state preparing >Thread-135588::INFO::2014-10-29 11:09:40,559::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135588::INFO::2014-10-29 11:09:40,560::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000743076', 'lastCheck': '6.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00128703', 'lastCheck': '6.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00182898', 'lastCheck': '6.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000511626', 'lastCheck': '6.0', 'valid': True}} >Thread-135588::DEBUG::2014-10-29 11:09:40,560::task::1191::Storage.TaskManager.Task::(prepare) Task=`1bd6228a-357a-4dfa-b292-620694608647`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000743076', 'lastCheck': '6.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00128703', 'lastCheck': '6.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00182898', 'lastCheck': '6.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000511626', 'lastCheck': '6.0', 'valid': True}} >Thread-135588::DEBUG::2014-10-29 11:09:40,561::task::595::Storage.TaskManager.Task::(_updateState) Task=`1bd6228a-357a-4dfa-b292-620694608647`::moving from state preparing -> state finished >Thread-135588::DEBUG::2014-10-29 11:09:40,561::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135588::DEBUG::2014-10-29 11:09:40,561::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135588::DEBUG::2014-10-29 11:09:40,561::task::993::Storage.TaskManager.Task::(_decref) Task=`1bd6228a-357a-4dfa-b292-620694608647`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:43,478::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:43,482::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135589::DEBUG::2014-10-29 11:09:43,485::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:43,488::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:43,490::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135590::DEBUG::2014-10-29 11:09:43,493::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135590::DEBUG::2014-10-29 11:09:43,495::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:44,120::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:44,121::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:44,122::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:09:44,521::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:44,521::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:44,521::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:44,522::__init__::232::IOProcess::(_processLogs) (199831) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:44,523::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199831) Queuing response >Thread-10269::DEBUG::2014-10-29 11:09:44,525::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:09:44,544::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:44,545::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10269::DEBUG::2014-10-29 11:09:44,546::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000530593 s, 946 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:09:44,547::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:44,549::__init__::232::IOProcess::(_processLogs) (199832) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:44,552::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199832) Queuing response >Thread-179::DEBUG::2014-10-29 11:09:44,554::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:09:44,574::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000492805 s, 755 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:09:44,578::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-178::DEBUG::2014-10-29 11:09:44,579::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:09:44,580::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:44,597::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-178::DEBUG::2014-10-29 11:09:44,598::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000496391 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:09:44,600::__init__::232::IOProcess::(_processLogs) (199833) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:44,601::__init__::232::IOProcess::(_processLogs) (199833) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:44,602::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:44,603::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:44,603::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:44,604::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:44,604::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:44,604::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:44,604::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:44,605::__init__::232::IOProcess::(_processLogs) (199834) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:44,605::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:44,605::__init__::232::IOProcess::(_processLogs) (199835) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:44,607::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199834) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:44,609::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:44,609::__init__::232::IOProcess::(_processLogs) (199836) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:44,609::__init__::232::IOProcess::(_processLogs) (199835) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:44,610::__init__::232::IOProcess::(_processLogs) (199836) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:44,610::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:44,610::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:44,610::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:44,611::__init__::232::IOProcess::(_processLogs) (199837) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:44,611::__init__::232::IOProcess::(_processLogs) (199837) Queuing response >Thread-33::DEBUG::2014-10-29 11:09:44,614::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:09:44,638::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000492609 s, 989 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:09:44,645::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:44,645::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:44,645::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:44,647::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199838) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:44,648::__init__::232::IOProcess::(_processLogs) (199838) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:44,649::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:44,649::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:44,650::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:44,650::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:44,650::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:44,651::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:44,652::__init__::232::IOProcess::(_processLogs) (199839) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:44,652::__init__::232::IOProcess::(_processLogs) (199840) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:44,652::__init__::232::IOProcess::(_processLogs) (199840) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:44,653::__init__::232::IOProcess::(_processLogs) (199839) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:44,655::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:44,656::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:44,657::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:44,657::__init__::232::IOProcess::(_processLogs) (199841) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:44,657::__init__::232::IOProcess::(_processLogs) (199841) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:44,658::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:44,659::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:44,659::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:44,659::__init__::232::IOProcess::(_processLogs) (199842) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:44,660::__init__::232::IOProcess::(_processLogs) (199842) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:44,660::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:44,660::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:44,661::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:44,662::__init__::232::IOProcess::(_processLogs) (199843) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:44,663::__init__::232::IOProcess::(_processLogs) (199843) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:44,663::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:44,664::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:44,664::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:44,666::__init__::232::IOProcess::(_processLogs) (199844) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:44,666::__init__::232::IOProcess::(_processLogs) (199844) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:46,512::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:46,521::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135591::DEBUG::2014-10-29 11:09:46,536::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:46,545::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:46,553::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135592::DEBUG::2014-10-29 11:09:46,567::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135592::DEBUG::2014-10-29 11:09:46,597::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:09:46,719::task::595::Storage.TaskManager.Task::(_updateState) Task=`f78d2aad-ea27-4c74-9f02-a7bd7116100f`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:09:46,721::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:09:46,725::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:46,727::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:46,728::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:46,730::__init__::232::IOProcess::(_processLogs) (199845) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:09:46,732::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199845) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:46,740::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:46,741::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:46,742::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:46,744::__init__::232::IOProcess::(_processLogs) (199846) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:09:46,746::__init__::232::IOProcess::(_processLogs) (199846) Queuing response >Thread-22::INFO::2014-10-29 11:09:46,751::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010863616', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:09:46,753::task::1191::Storage.TaskManager.Task::(prepare) Task=`f78d2aad-ea27-4c74-9f02-a7bd7116100f`::finished: {'truesize': '6010863616', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:09:46,754::task::595::Storage.TaskManager.Task::(_updateState) Task=`f78d2aad-ea27-4c74-9f02-a7bd7116100f`::moving from state preparing -> state finished >Thread-22::DEBUG::2014-10-29 11:09:46,755::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-10-29 11:09:46,756::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2014-10-29 11:09:46,758::task::993::Storage.TaskManager.Task::(_decref) Task=`f78d2aad-ea27-4c74-9f02-a7bd7116100f`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:09:46,835::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:49,131::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:49,134::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:49,135::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:09:49,433::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:53999 >Detector thread::DEBUG::2014-10-29 11:09:49,434::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:53999 >Detector thread::DEBUG::2014-10-29 11:09:49,434::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:53999 >Detector thread::DEBUG::2014-10-29 11:09:49,434::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 53999) >Thread-135593::DEBUG::2014-10-29 11:09:49,474::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135593::DEBUG::2014-10-29 11:09:49,474::task::595::Storage.TaskManager.Task::(_updateState) Task=`12477246-6b0c-4e1e-b652-a10c6319397f`::moving from state init -> state preparing >Thread-135593::INFO::2014-10-29 11:09:49,475::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135593::DEBUG::2014-10-29 11:09:49,482::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:09:49,483::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:49,483::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:49,483::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:49,484::__init__::232::IOProcess::(_processLogs) (199847) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:09:49,485::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199847) Queuing response >Thread-135593::DEBUG::2014-10-29 11:09:49,486::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135593::DEBUG::2014-10-29 11:09:49,487::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135593::INFO::2014-10-29 11:09:49,487::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135593::DEBUG::2014-10-29 11:09:49,487::task::1191::Storage.TaskManager.Task::(prepare) Task=`12477246-6b0c-4e1e-b652-a10c6319397f`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135593::DEBUG::2014-10-29 11:09:49,488::task::595::Storage.TaskManager.Task::(_updateState) Task=`12477246-6b0c-4e1e-b652-a10c6319397f`::moving from state preparing -> state finished >Thread-135593::DEBUG::2014-10-29 11:09:49,488::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135593::DEBUG::2014-10-29 11:09:49,488::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135593::DEBUG::2014-10-29 11:09:49,488::task::993::Storage.TaskManager.Task::(_decref) Task=`12477246-6b0c-4e1e-b652-a10c6319397f`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:09:49,534::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54000 >Detector thread::DEBUG::2014-10-29 11:09:49,535::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54000 >Detector thread::DEBUG::2014-10-29 11:09:49,535::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54000 >Detector thread::DEBUG::2014-10-29 11:09:49,536::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54000) >Thread-135594::DEBUG::2014-10-29 11:09:49,574::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135594::DEBUG::2014-10-29 11:09:49,575::task::595::Storage.TaskManager.Task::(_updateState) Task=`69e7f3ea-1084-4af9-9cb7-1f9e395cfc81`::moving from state init -> state preparing >Thread-135594::INFO::2014-10-29 11:09:49,575::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135594::DEBUG::2014-10-29 11:09:49,575::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135594::DEBUG::2014-10-29 11:09:49,576::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135594::DEBUG::2014-10-29 11:09:49,576::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135594::DEBUG::2014-10-29 11:09:49,576::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135594::DEBUG::2014-10-29 11:09:49,576::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135594::DEBUG::2014-10-29 11:09:49,577::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:49,619::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:49,622::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135595::DEBUG::2014-10-29 11:09:49,626::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:49,628::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:49,631::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135596::DEBUG::2014-10-29 11:09:49,634::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135596::DEBUG::2014-10-29 11:09:49,637::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-135594::DEBUG::2014-10-29 11:09:49,676::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135594::DEBUG::2014-10-29 11:09:49,677::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135594::DEBUG::2014-10-29 11:09:49,855::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135594::DEBUG::2014-10-29 11:09:49,856::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135594::DEBUG::2014-10-29 11:09:49,857::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135594::DEBUG::2014-10-29 11:09:49,857::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135594::DEBUG::2014-10-29 11:09:49,858::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135594::DEBUG::2014-10-29 11:09:49,858::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135594::DEBUG::2014-10-29 11:09:49,858::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135594::DEBUG::2014-10-29 11:09:49,859::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:09:49,870::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:49,870::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:49,871::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:49,871::__init__::232::IOProcess::(_processLogs) (199848) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:09:49,871::__init__::232::IOProcess::(_processLogs) (199848) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:49,872::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:49,873::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:49,873::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:49,874::__init__::232::IOProcess::(_processLogs) (199849) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:09:49,874::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199849) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:49,876::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:49,878::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:49,879::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:49,881::__init__::232::IOProcess::(_processLogs) (199850) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:09:49,884::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199850) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:49,887::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:49,889::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-135594::DEBUG::2014-10-29 11:09:49,890::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:09:49,893::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:49,894::__init__::232::IOProcess::(_processLogs) (199851) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:09:49,894::__init__::232::IOProcess::(_processLogs) (199851) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:49,895::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:49,895::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:49,895::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:49,896::__init__::232::IOProcess::(_processLogs) (199852) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:09:49,896::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199852) Queuing response >Thread-135594::DEBUG::2014-10-29 11:09:49,897::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:09:49,898::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:49,898::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:49,898::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:49,899::__init__::232::IOProcess::(_processLogs) (199853) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:09:49,900::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199853) Queuing response >Thread-135594::DEBUG::2014-10-29 11:09:49,900::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:09:49,902::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:49,903::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:49,903::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:49,904::__init__::232::IOProcess::(_processLogs) (199854) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:49,904::__init__::232::IOProcess::(_processLogs) (199854) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:49,904::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:49,905::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:49,905::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:49,905::__init__::232::IOProcess::(_processLogs) (199855) Got request for method 'glob' >Thread-135594::DEBUG::2014-10-29 11:09:49,906::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:09:49,906::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199855) Queuing response >Thread-135594::INFO::2014-10-29 11:09:49,907::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135594::INFO::2014-10-29 11:09:49,908::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135594::INFO::2014-10-29 11:09:49,908::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:09:49,909::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:49,909::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:49,910::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:49,910::__init__::232::IOProcess::(_processLogs) (199856) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:09:49,911::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199856) Queuing response >Thread-135594::DEBUG::2014-10-29 11:09:49,911::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135594::DEBUG::2014-10-29 11:09:49,913::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`2897659b-7bc1-4a8c-a295-e67eb54d1ef7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135594::DEBUG::2014-10-29 11:09:49,914::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135594::DEBUG::2014-10-29 11:09:49,914::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135594::DEBUG::2014-10-29 11:09:49,914::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`2897659b-7bc1-4a8c-a295-e67eb54d1ef7`::Granted request >Thread-135594::DEBUG::2014-10-29 11:09:49,915::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`69e7f3ea-1084-4af9-9cb7-1f9e395cfc81`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135594::DEBUG::2014-10-29 11:09:49,915::task::993::Storage.TaskManager.Task::(_decref) Task=`69e7f3ea-1084-4af9-9cb7-1f9e395cfc81`::ref 1 aborting False >Thread-135594::INFO::2014-10-29 11:09:49,918::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135594::DEBUG::2014-10-29 11:09:49,918::task::1191::Storage.TaskManager.Task::(prepare) Task=`69e7f3ea-1084-4af9-9cb7-1f9e395cfc81`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135594::DEBUG::2014-10-29 11:09:49,918::task::595::Storage.TaskManager.Task::(_updateState) Task=`69e7f3ea-1084-4af9-9cb7-1f9e395cfc81`::moving from state preparing -> state finished >Thread-135594::DEBUG::2014-10-29 11:09:49,919::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135594::DEBUG::2014-10-29 11:09:49,919::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135594::DEBUG::2014-10-29 11:09:49,919::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135594::DEBUG::2014-10-29 11:09:49,920::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135594::DEBUG::2014-10-29 11:09:49,920::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135594::DEBUG::2014-10-29 11:09:49,920::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135594::DEBUG::2014-10-29 11:09:49,921::task::993::Storage.TaskManager.Task::(_decref) Task=`69e7f3ea-1084-4af9-9cb7-1f9e395cfc81`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:09:49,942::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54001 >Detector thread::DEBUG::2014-10-29 11:09:49,942::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54001 >Detector thread::DEBUG::2014-10-29 11:09:49,942::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54001 >Detector thread::DEBUG::2014-10-29 11:09:49,943::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54001) >Thread-135601::DEBUG::2014-10-29 11:09:49,982::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135601::DEBUG::2014-10-29 11:09:49,983::task::595::Storage.TaskManager.Task::(_updateState) Task=`ee9424eb-9055-44c1-9a1b-d174a1c54575`::moving from state init -> state preparing >Thread-135601::INFO::2014-10-29 11:09:49,983::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135601::INFO::2014-10-29 11:09:49,984::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496391', 'lastCheck': '5.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000492609', 'lastCheck': '5.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000492805', 'lastCheck': '5.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000530593', 'lastCheck': '5.4', 'valid': True}} >Thread-135601::DEBUG::2014-10-29 11:09:49,984::task::1191::Storage.TaskManager.Task::(prepare) Task=`ee9424eb-9055-44c1-9a1b-d174a1c54575`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496391', 'lastCheck': '5.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000492609', 'lastCheck': '5.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000492805', 'lastCheck': '5.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000530593', 'lastCheck': '5.4', 'valid': True}} >Thread-135601::DEBUG::2014-10-29 11:09:49,984::task::595::Storage.TaskManager.Task::(_updateState) Task=`ee9424eb-9055-44c1-9a1b-d174a1c54575`::moving from state preparing -> state finished >Thread-135601::DEBUG::2014-10-29 11:09:49,984::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135601::DEBUG::2014-10-29 11:09:49,985::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135601::DEBUG::2014-10-29 11:09:49,985::task::993::Storage.TaskManager.Task::(_decref) Task=`ee9424eb-9055-44c1-9a1b-d174a1c54575`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:09:50,104::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54002 >Detector thread::DEBUG::2014-10-29 11:09:50,105::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54002 >Detector thread::DEBUG::2014-10-29 11:09:50,105::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54002 >Detector thread::DEBUG::2014-10-29 11:09:50,106::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54002) >Thread-135602::DEBUG::2014-10-29 11:09:50,145::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135602::DEBUG::2014-10-29 11:09:50,147::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135602::DEBUG::2014-10-29 11:09:50,166::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Detector thread::DEBUG::2014-10-29 11:09:50,197::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54003 >Detector thread::DEBUG::2014-10-29 11:09:50,200::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54003 >Detector thread::DEBUG::2014-10-29 11:09:50,201::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54003 >Detector thread::DEBUG::2014-10-29 11:09:50,203::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54003) >Thread-135602::DEBUG::2014-10-29 11:09:50,234::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '117', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '17', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-135603::DEBUG::2014-10-29 11:09:50,238::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135603::DEBUG::2014-10-29 11:09:50,242::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135603::DEBUG::2014-10-29 11:09:50,245::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.75', 'elapsedTime': '513622', 'displayType': 'vnc', 'cpuSys': '0.60', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '52265398', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '68167', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '31436.06'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.40', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:09:50,622::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54005 >Detector thread::DEBUG::2014-10-29 11:09:50,623::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54005 >Detector thread::DEBUG::2014-10-29 11:09:50,623::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54005 >Detector thread::DEBUG::2014-10-29 11:09:50,623::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54005) >Thread-135604::DEBUG::2014-10-29 11:09:50,663::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d1f9fa1-ea3d-47e9-b844-a68f5c3cf1bc`::moving from state init -> state preparing >Thread-135604::INFO::2014-10-29 11:09:50,663::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135604::INFO::2014-10-29 11:09:50,664::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496391', 'lastCheck': '6.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000492609', 'lastCheck': '6.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000492805', 'lastCheck': '6.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000530593', 'lastCheck': '6.1', 'valid': True}} >Thread-135604::DEBUG::2014-10-29 11:09:50,664::task::1191::Storage.TaskManager.Task::(prepare) Task=`2d1f9fa1-ea3d-47e9-b844-a68f5c3cf1bc`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496391', 'lastCheck': '6.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000492609', 'lastCheck': '6.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000492805', 'lastCheck': '6.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000530593', 'lastCheck': '6.1', 'valid': True}} >Thread-135604::DEBUG::2014-10-29 11:09:50,665::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d1f9fa1-ea3d-47e9-b844-a68f5c3cf1bc`::moving from state preparing -> state finished >Thread-135604::DEBUG::2014-10-29 11:09:50,665::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135604::DEBUG::2014-10-29 11:09:50,665::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135604::DEBUG::2014-10-29 11:09:50,665::task::993::Storage.TaskManager.Task::(_decref) Task=`2d1f9fa1-ea3d-47e9-b844-a68f5c3cf1bc`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:52,649::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:52,652::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135605::DEBUG::2014-10-29 11:09:52,656::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea3f8a10-9b46-4d55-9d25-9ceaa78ee6e5`::moving from state init -> state preparing >Thread-135605::INFO::2014-10-29 11:09:52,657::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135605::INFO::2014-10-29 11:09:52,657::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496391', 'lastCheck': '8.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000492609', 'lastCheck': '8.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000492805', 'lastCheck': '8.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000530593', 'lastCheck': '8.0', 'valid': True}} >Thread-135605::DEBUG::2014-10-29 11:09:52,658::task::1191::Storage.TaskManager.Task::(prepare) Task=`ea3f8a10-9b46-4d55-9d25-9ceaa78ee6e5`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496391', 'lastCheck': '8.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000492609', 'lastCheck': '8.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000492805', 'lastCheck': '8.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000530593', 'lastCheck': '8.0', 'valid': True}} >Thread-135605::DEBUG::2014-10-29 11:09:52,658::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea3f8a10-9b46-4d55-9d25-9ceaa78ee6e5`::moving from state preparing -> state finished >Thread-135605::DEBUG::2014-10-29 11:09:52,658::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135605::DEBUG::2014-10-29 11:09:52,658::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135605::DEBUG::2014-10-29 11:09:52,659::task::993::Storage.TaskManager.Task::(_decref) Task=`ea3f8a10-9b46-4d55-9d25-9ceaa78ee6e5`::ref 0 aborting False >Thread-135605::DEBUG::2014-10-29 11:09:52,678::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:52,701::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:52,703::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135606::DEBUG::2014-10-29 11:09:52,707::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135606::DEBUG::2014-10-29 11:09:52,709::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:54,142::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:54,143::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:54,146::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:09:54,610::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:54,610::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:54,611::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:54,611::__init__::232::IOProcess::(_processLogs) (199857) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:54,612::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199857) Queuing response >Thread-10269::DEBUG::2014-10-29 11:09:54,614::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:09:54,631::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000450382 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:09:54,633::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:54,633::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:54,633::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:54,634::__init__::232::IOProcess::(_processLogs) (199858) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:54,634::__init__::232::IOProcess::(_processLogs) (199858) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:54,642::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:54,642::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:54,642::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:54,643::__init__::232::IOProcess::(_processLogs) (199859) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:54,643::__init__::232::IOProcess::(_processLogs) (199859) Queuing response >Thread-179::DEBUG::2014-10-29 11:09:54,644::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:09:54,661::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000433219 s, 859 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:09:54,665::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:54,666::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:54,666::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:54,667::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:54,667::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:54,667::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:54,668::__init__::232::IOProcess::(_processLogs) (199861) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:54,668::__init__::232::IOProcess::(_processLogs) (199860) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:54,669::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199860) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:54,671::__init__::232::IOProcess::(_processLogs) (199861) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:54,673::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-33::DEBUG::2014-10-29 11:09:54,675::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:09:54,676::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:54,692::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-33::DEBUG::2014-10-29 11:09:54,694::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000519091 s, 938 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:09:54,699::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199862) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:09:54,700::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:09:54,717::__init__::232::IOProcess::(_processLogs) (199862) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:54,721::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-178::DEBUG::2014-10-29 11:09:54,721::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000464623 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:09:54,723::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:54,726::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:54,728::__init__::232::IOProcess::(_processLogs) (199863) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:54,728::__init__::232::IOProcess::(_processLogs) (199863) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:54,729::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:54,729::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:54,729::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:54,730::__init__::232::IOProcess::(_processLogs) (199864) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:09:54,731::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199864) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:54,733::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:54,733::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:54,733::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:54,733::__init__::232::IOProcess::(_processLogs) (199865) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:54,734::__init__::232::IOProcess::(_processLogs) (199865) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:54,736::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:54,737::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:54,737::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:54,737::__init__::232::IOProcess::(_processLogs) (199866) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:54,738::__init__::232::IOProcess::(_processLogs) (199866) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:54,739::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:54,740::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:54,740::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:54,740::__init__::232::IOProcess::(_processLogs) (199867) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:54,740::__init__::232::IOProcess::(_processLogs) (199867) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:54,741::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:54,742::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:54,742::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:54,743::__init__::232::IOProcess::(_processLogs) (199868) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:54,743::__init__::232::IOProcess::(_processLogs) (199868) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:54,744::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:54,744::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:54,745::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:54,746::__init__::232::IOProcess::(_processLogs) (199869) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:54,746::__init__::232::IOProcess::(_processLogs) (199869) Queuing response >Thread-17::DEBUG::2014-10-29 11:09:54,746::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:09:54,747::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:09:54,748::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:09:54,749::__init__::232::IOProcess::(_processLogs) (199870) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:09:54,749::__init__::232::IOProcess::(_processLogs) (199870) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:55,791::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:55,793::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135607::DEBUG::2014-10-29 11:09:55,797::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:55,799::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:55,801::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135608::DEBUG::2014-10-29 11:09:55,804::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135608::DEBUG::2014-10-29 11:09:55,807::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:58,827::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:58,829::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135609::DEBUG::2014-10-29 11:09:58,833::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:09:58,837::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:09:58,839::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135610::DEBUG::2014-10-29 11:09:58,843::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135610::DEBUG::2014-10-29 11:09:58,845::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:59,153::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:59,154::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:09:59,156::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:09:59,314::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54006 >Detector thread::DEBUG::2014-10-29 11:09:59,315::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54006 >Detector thread::DEBUG::2014-10-29 11:09:59,315::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54006 >Detector thread::DEBUG::2014-10-29 11:09:59,316::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54006) >Thread-135611::DEBUG::2014-10-29 11:09:59,355::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135611::DEBUG::2014-10-29 11:09:59,356::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135611::DEBUG::2014-10-29 11:09:59,373::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135611::DEBUG::2014-10-29 11:09:59,420::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '199', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '99', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:09:59,423::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54007 >Detector thread::DEBUG::2014-10-29 11:09:59,426::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54007 >Detector thread::DEBUG::2014-10-29 11:09:59,427::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54007 >Detector thread::DEBUG::2014-10-29 11:09:59,429::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54007) >Thread-135612::DEBUG::2014-10-29 11:09:59,463::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135612::DEBUG::2014-10-29 11:09:59,464::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135612::DEBUG::2014-10-29 11:09:59,465::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.75', 'elapsedTime': '513631', 'displayType': 'vnc', 'cpuSys': '0.60', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '52265398', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '68167', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '31436.06'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.62', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:10:00,566::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54010 >Detector thread::DEBUG::2014-10-29 11:10:00,567::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54010 >Detector thread::DEBUG::2014-10-29 11:10:00,567::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54010 >Detector thread::DEBUG::2014-10-29 11:10:00,567::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54010) >Thread-135613::DEBUG::2014-10-29 11:10:00,607::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135613::DEBUG::2014-10-29 11:10:00,608::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab7a1843-b484-430d-aff1-a46d89c9204e`::moving from state init -> state preparing >Thread-135613::INFO::2014-10-29 11:10:00,608::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135613::DEBUG::2014-10-29 11:10:00,611::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:10:00,612::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:00,612::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:00,612::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:00,613::__init__::232::IOProcess::(_processLogs) (199871) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:00,614::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199871) Queuing response >Thread-135613::DEBUG::2014-10-29 11:10:00,615::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135613::DEBUG::2014-10-29 11:10:00,616::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135613::INFO::2014-10-29 11:10:00,616::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135613::DEBUG::2014-10-29 11:10:00,616::task::1191::Storage.TaskManager.Task::(prepare) Task=`ab7a1843-b484-430d-aff1-a46d89c9204e`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135613::DEBUG::2014-10-29 11:10:00,616::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab7a1843-b484-430d-aff1-a46d89c9204e`::moving from state preparing -> state finished >Thread-135613::DEBUG::2014-10-29 11:10:00,617::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135613::DEBUG::2014-10-29 11:10:00,617::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135613::DEBUG::2014-10-29 11:10:00,617::task::993::Storage.TaskManager.Task::(_decref) Task=`ab7a1843-b484-430d-aff1-a46d89c9204e`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:10:00,661::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54011 >Detector thread::DEBUG::2014-10-29 11:10:00,662::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54011 >Detector thread::DEBUG::2014-10-29 11:10:00,662::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54011 >Detector thread::DEBUG::2014-10-29 11:10:00,663::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54011) >Thread-135614::DEBUG::2014-10-29 11:10:00,702::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135614::DEBUG::2014-10-29 11:10:00,702::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3559345-6629-4b1e-96c7-fa9f97b3d711`::moving from state init -> state preparing >Thread-135614::INFO::2014-10-29 11:10:00,703::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135614::DEBUG::2014-10-29 11:10:00,703::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135614::DEBUG::2014-10-29 11:10:00,703::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135614::DEBUG::2014-10-29 11:10:00,704::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135614::DEBUG::2014-10-29 11:10:00,704::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135614::DEBUG::2014-10-29 11:10:00,704::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135614::DEBUG::2014-10-29 11:10:00,705::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Detector thread::DEBUG::2014-10-29 11:10:00,748::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54012 >Detector thread::DEBUG::2014-10-29 11:10:00,748::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54012 >Detector thread::DEBUG::2014-10-29 11:10:00,749::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54012 >Detector thread::DEBUG::2014-10-29 11:10:00,749::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54012) >Thread-135615::DEBUG::2014-10-29 11:10:00,789::task::595::Storage.TaskManager.Task::(_updateState) Task=`a397fc22-ee2d-4be3-925b-d0f98c184710`::moving from state init -> state preparing >Thread-135615::INFO::2014-10-29 11:10:00,790::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135615::INFO::2014-10-29 11:10:00,790::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464623', 'lastCheck': '6.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519091', 'lastCheck': '6.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000433219', 'lastCheck': '6.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000450382', 'lastCheck': '6.2', 'valid': True}} >Thread-135615::DEBUG::2014-10-29 11:10:00,791::task::1191::Storage.TaskManager.Task::(prepare) Task=`a397fc22-ee2d-4be3-925b-d0f98c184710`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464623', 'lastCheck': '6.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519091', 'lastCheck': '6.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000433219', 'lastCheck': '6.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000450382', 'lastCheck': '6.2', 'valid': True}} >Thread-135615::DEBUG::2014-10-29 11:10:00,791::task::595::Storage.TaskManager.Task::(_updateState) Task=`a397fc22-ee2d-4be3-925b-d0f98c184710`::moving from state preparing -> state finished >Thread-135615::DEBUG::2014-10-29 11:10:00,791::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135615::DEBUG::2014-10-29 11:10:00,791::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135615::DEBUG::2014-10-29 11:10:00,792::task::993::Storage.TaskManager.Task::(_decref) Task=`a397fc22-ee2d-4be3-925b-d0f98c184710`::ref 0 aborting False >Thread-135614::DEBUG::2014-10-29 11:10:00,796::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135614::DEBUG::2014-10-29 11:10:00,797::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135614::DEBUG::2014-10-29 11:10:00,971::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135614::DEBUG::2014-10-29 11:10:00,973::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135614::DEBUG::2014-10-29 11:10:00,974::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135614::DEBUG::2014-10-29 11:10:00,974::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135614::DEBUG::2014-10-29 11:10:00,975::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135614::DEBUG::2014-10-29 11:10:00,975::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135614::DEBUG::2014-10-29 11:10:00,975::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135614::DEBUG::2014-10-29 11:10:00,976::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:10:00,983::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:00,986::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:00,987::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:00,987::__init__::232::IOProcess::(_processLogs) (199872) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:00,989::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199872) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:00,990::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:00,991::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:00,991::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:00,991::__init__::232::IOProcess::(_processLogs) (199873) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:00,992::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199873) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:00,994::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:00,997::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:00,999::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:01,001::__init__::232::IOProcess::(_processLogs) (199874) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:01,005::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199874) Queuing response >Thread-135614::DEBUG::2014-10-29 11:10:01,008::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:10:01,010::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:01,011::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:01,012::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:01,013::__init__::232::IOProcess::(_processLogs) (199875) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:01,013::__init__::232::IOProcess::(_processLogs) (199875) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:01,014::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:01,014::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:01,016::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:01,016::__init__::232::IOProcess::(_processLogs) (199876) Got request for method 'touch' >Thread-135614::DEBUG::2014-10-29 11:10:01,018::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:10:01,019::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199876) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:01,021::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:01,021::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:01,021::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:01,022::__init__::232::IOProcess::(_processLogs) (199877) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:10:01,022::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199877) Queuing response >Thread-135614::DEBUG::2014-10-29 11:10:01,023::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:10:01,025::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:01,025::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:01,026::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:01,026::__init__::232::IOProcess::(_processLogs) (199878) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:01,026::__init__::232::IOProcess::(_processLogs) (199878) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:01,027::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:01,027::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-135614::DEBUG::2014-10-29 11:10:01,029::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:10:01,029::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-135614::INFO::2014-10-29 11:10:01,030::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:10:01,031::__init__::232::IOProcess::(_processLogs) (199879) Got request for method 'glob' >Thread-135614::INFO::2014-10-29 11:10:01,033::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:10:01,034::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199879) Queuing response >Thread-135614::INFO::2014-10-29 11:10:01,044::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:10:01,048::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:01,048::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:01,049::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:01,049::__init__::232::IOProcess::(_processLogs) (199880) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:10:01,051::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199880) Queuing response >Thread-135614::DEBUG::2014-10-29 11:10:01,051::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135614::DEBUG::2014-10-29 11:10:01,055::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`67e750ae-d503-46d1-911c-1312089118b6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135614::DEBUG::2014-10-29 11:10:01,055::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135614::DEBUG::2014-10-29 11:10:01,056::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135614::DEBUG::2014-10-29 11:10:01,057::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`67e750ae-d503-46d1-911c-1312089118b6`::Granted request >Thread-135614::DEBUG::2014-10-29 11:10:01,058::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f3559345-6629-4b1e-96c7-fa9f97b3d711`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135614::DEBUG::2014-10-29 11:10:01,058::task::993::Storage.TaskManager.Task::(_decref) Task=`f3559345-6629-4b1e-96c7-fa9f97b3d711`::ref 1 aborting False >Thread-135614::INFO::2014-10-29 11:10:01,063::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135614::DEBUG::2014-10-29 11:10:01,063::task::1191::Storage.TaskManager.Task::(prepare) Task=`f3559345-6629-4b1e-96c7-fa9f97b3d711`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135614::DEBUG::2014-10-29 11:10:01,064::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3559345-6629-4b1e-96c7-fa9f97b3d711`::moving from state preparing -> state finished >Thread-135614::DEBUG::2014-10-29 11:10:01,064::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135614::DEBUG::2014-10-29 11:10:01,064::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135614::DEBUG::2014-10-29 11:10:01,065::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135614::DEBUG::2014-10-29 11:10:01,065::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135614::DEBUG::2014-10-29 11:10:01,065::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135614::DEBUG::2014-10-29 11:10:01,065::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135614::DEBUG::2014-10-29 11:10:01,066::task::993::Storage.TaskManager.Task::(_decref) Task=`f3559345-6629-4b1e-96c7-fa9f97b3d711`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:10:01,108::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54013 >Detector thread::DEBUG::2014-10-29 11:10:01,108::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54013 >Detector thread::DEBUG::2014-10-29 11:10:01,109::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54013 >Detector thread::DEBUG::2014-10-29 11:10:01,109::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54013) >Thread-135620::DEBUG::2014-10-29 11:10:01,149::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135620::DEBUG::2014-10-29 11:10:01,150::task::595::Storage.TaskManager.Task::(_updateState) Task=`90931c35-8d9d-4f6a-9686-814849b32b3e`::moving from state init -> state preparing >Thread-135620::INFO::2014-10-29 11:10:01,151::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135620::INFO::2014-10-29 11:10:01,151::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464623', 'lastCheck': '6.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519091', 'lastCheck': '6.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000433219', 'lastCheck': '6.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000450382', 'lastCheck': '6.5', 'valid': True}} >Thread-135620::DEBUG::2014-10-29 11:10:01,152::task::1191::Storage.TaskManager.Task::(prepare) Task=`90931c35-8d9d-4f6a-9686-814849b32b3e`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464623', 'lastCheck': '6.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519091', 'lastCheck': '6.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000433219', 'lastCheck': '6.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000450382', 'lastCheck': '6.5', 'valid': True}} >Thread-135620::DEBUG::2014-10-29 11:10:01,152::task::595::Storage.TaskManager.Task::(_updateState) Task=`90931c35-8d9d-4f6a-9686-814849b32b3e`::moving from state preparing -> state finished >Thread-135620::DEBUG::2014-10-29 11:10:01,152::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135620::DEBUG::2014-10-29 11:10:01,153::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135620::DEBUG::2014-10-29 11:10:01,153::task::993::Storage.TaskManager.Task::(_decref) Task=`90931c35-8d9d-4f6a-9686-814849b32b3e`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:01,861::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:01,868::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135621::DEBUG::2014-10-29 11:10:01,874::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:01,877::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:01,880::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135622::DEBUG::2014-10-29 11:10:01,884::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135622::DEBUG::2014-10-29 11:10:01,887::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:10:01,892::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >VM Channels Listener::DEBUG::2014-10-29 11:10:03,350::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:04,162::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:04,163::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:04,165::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:10:04,637::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:04,637::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:04,638::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:04,638::__init__::232::IOProcess::(_processLogs) (199881) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:04,676::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:04,676::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:04,676::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:04,677::__init__::232::IOProcess::(_processLogs) (199882) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:04,746::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:04,747::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:04,747::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:04,747::__init__::232::IOProcess::(_processLogs) (199883) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:04,750::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:04,751::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:04,751::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:04,751::__init__::232::IOProcess::(_processLogs) (199884) Got request for method 'statvfs' >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:04,900::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:04,903::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135623::DEBUG::2014-10-29 11:10:04,906::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:04,909::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:04,911::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135624::DEBUG::2014-10-29 11:10:04,914::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135624::DEBUG::2014-10-29 11:10:04,916::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:10:05,289::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199883) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:05,289::__init__::232::IOProcess::(_processLogs) (199882) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:05,290::__init__::232::IOProcess::(_processLogs) (199884) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:05,292::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199881) Queuing response >Thread-33::DEBUG::2014-10-29 11:10:05,294::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:10:05,320::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:10:05,341::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000485109 s, 1.0 MB/s\n'; <rc> = 0 >Thread-179::DEBUG::2014-10-29 11:10:05,349::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000521393 s, 713 kB/s\n'; <rc> = 0 >Thread-178::DEBUG::2014-10-29 11:10:05,351::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:10:05,375::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-178::DEBUG::2014-10-29 11:10:05,376::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00048953 s, 1.0 MB/s\n'; <rc> = 0 >Thread-10269::DEBUG::2014-10-29 11:10:05,376::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:10:05,378::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:05,397::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:05,399::__init__::232::IOProcess::(_processLogs) (199885) Got request for method 'statvfs' >Thread-10269::DEBUG::2014-10-29 11:10:05,400::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000618378 s, 812 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:10:05,405::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199885) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:05,407::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:05,407::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:05,407::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:05,407::__init__::232::IOProcess::(_processLogs) (199886) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:05,409::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199886) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:05,410::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:05,410::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:05,411::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:05,411::__init__::232::IOProcess::(_processLogs) (199887) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:05,411::__init__::232::IOProcess::(_processLogs) (199887) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:05,414::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:05,415::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:05,415::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:05,416::__init__::232::IOProcess::(_processLogs) (199888) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:05,417::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199888) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:05,421::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:05,421::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:05,421::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:05,422::__init__::232::IOProcess::(_processLogs) (199889) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:05,422::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199889) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:05,424::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:05,424::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:05,424::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:05,425::__init__::232::IOProcess::(_processLogs) (199890) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:05,426::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199890) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:05,427::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:05,427::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:05,427::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:05,427::__init__::232::IOProcess::(_processLogs) (199891) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:05,429::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199891) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:05,429::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:05,430::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:05,430::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:05,430::__init__::232::IOProcess::(_processLogs) (199892) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:05,431::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199892) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:05,432::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:05,432::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:05,432::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:05,433::__init__::232::IOProcess::(_processLogs) (199893) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:05,433::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:05,433::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:05,434::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:05,434::__init__::232::IOProcess::(_processLogs) (199894) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:05,435::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199893) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:05,437::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199894) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:07,929::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:07,932::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135625::DEBUG::2014-10-29 11:10:07,936::task::595::Storage.TaskManager.Task::(_updateState) Task=`ffed8eae-9d5b-46fa-9c7f-2dccefc99d4b`::moving from state init -> state preparing >Thread-135625::INFO::2014-10-29 11:10:07,937::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135625::INFO::2014-10-29 11:10:07,937::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048953', 'lastCheck': '2.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485109', 'lastCheck': '2.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521393', 'lastCheck': '2.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000618378', 'lastCheck': '2.5', 'valid': True}} >Thread-135625::DEBUG::2014-10-29 11:10:07,938::task::1191::Storage.TaskManager.Task::(prepare) Task=`ffed8eae-9d5b-46fa-9c7f-2dccefc99d4b`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048953', 'lastCheck': '2.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485109', 'lastCheck': '2.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521393', 'lastCheck': '2.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000618378', 'lastCheck': '2.5', 'valid': True}} >Thread-135625::DEBUG::2014-10-29 11:10:07,938::task::595::Storage.TaskManager.Task::(_updateState) Task=`ffed8eae-9d5b-46fa-9c7f-2dccefc99d4b`::moving from state preparing -> state finished >Thread-135625::DEBUG::2014-10-29 11:10:07,938::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135625::DEBUG::2014-10-29 11:10:07,938::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135625::DEBUG::2014-10-29 11:10:07,939::task::993::Storage.TaskManager.Task::(_decref) Task=`ffed8eae-9d5b-46fa-9c7f-2dccefc99d4b`::ref 0 aborting False >Thread-135625::DEBUG::2014-10-29 11:10:07,992::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:08,016::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:08,018::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135626::DEBUG::2014-10-29 11:10:08,021::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135626::DEBUG::2014-10-29 11:10:08,023::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:09,171::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:09,173::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:09,174::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:10:09,482::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54014 >Detector thread::DEBUG::2014-10-29 11:10:09,482::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54014 >Detector thread::DEBUG::2014-10-29 11:10:09,483::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54014 >Detector thread::DEBUG::2014-10-29 11:10:09,483::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54014) >Thread-135627::DEBUG::2014-10-29 11:10:09,522::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135627::DEBUG::2014-10-29 11:10:09,524::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135627::DEBUG::2014-10-29 11:10:09,545::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135627::DEBUG::2014-10-29 11:10:09,593::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '181', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '81', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:10:09,632::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54015 >Detector thread::DEBUG::2014-10-29 11:10:09,633::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54015 >Detector thread::DEBUG::2014-10-29 11:10:09,633::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54015 >Detector thread::DEBUG::2014-10-29 11:10:09,633::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54015) >Thread-135628::DEBUG::2014-10-29 11:10:09,672::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135628::DEBUG::2014-10-29 11:10:09,673::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135628::DEBUG::2014-10-29 11:10:09,674::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.95', 'elapsedTime': '513642', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '52265398', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '68167', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '31436.06'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.78', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:10:10,862::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54017 >Detector thread::DEBUG::2014-10-29 11:10:10,863::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54017 >Detector thread::DEBUG::2014-10-29 11:10:10,863::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54017 >Detector thread::DEBUG::2014-10-29 11:10:10,864::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54017) >Thread-135629::DEBUG::2014-10-29 11:10:10,904::task::595::Storage.TaskManager.Task::(_updateState) Task=`b663be2c-161c-459e-a8e0-316983014240`::moving from state init -> state preparing >Thread-135629::INFO::2014-10-29 11:10:10,904::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135629::INFO::2014-10-29 11:10:10,905::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048953', 'lastCheck': '5.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485109', 'lastCheck': '5.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521393', 'lastCheck': '5.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000618378', 'lastCheck': '5.5', 'valid': True}} >Thread-135629::DEBUG::2014-10-29 11:10:10,905::task::1191::Storage.TaskManager.Task::(prepare) Task=`b663be2c-161c-459e-a8e0-316983014240`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048953', 'lastCheck': '5.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485109', 'lastCheck': '5.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521393', 'lastCheck': '5.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000618378', 'lastCheck': '5.5', 'valid': True}} >Thread-135629::DEBUG::2014-10-29 11:10:10,905::task::595::Storage.TaskManager.Task::(_updateState) Task=`b663be2c-161c-459e-a8e0-316983014240`::moving from state preparing -> state finished >Thread-135629::DEBUG::2014-10-29 11:10:10,906::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135629::DEBUG::2014-10-29 11:10:10,906::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135629::DEBUG::2014-10-29 11:10:10,906::task::993::Storage.TaskManager.Task::(_decref) Task=`b663be2c-161c-459e-a8e0-316983014240`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:11,076::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:11,079::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135630::DEBUG::2014-10-29 11:10:11,082::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:11,085::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:11,087::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135631::DEBUG::2014-10-29 11:10:11,090::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135631::DEBUG::2014-10-29 11:10:11,092::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:10:13,164::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54019 >Detector thread::DEBUG::2014-10-29 11:10:13,165::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54019 >Detector thread::DEBUG::2014-10-29 11:10:13,165::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54019 >Detector thread::DEBUG::2014-10-29 11:10:13,166::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54019) >Thread-135632::DEBUG::2014-10-29 11:10:13,205::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135632::DEBUG::2014-10-29 11:10:13,206::task::595::Storage.TaskManager.Task::(_updateState) Task=`3052071d-6e83-4601-9f0b-4c9faab64ae8`::moving from state init -> state preparing >Thread-135632::INFO::2014-10-29 11:10:13,206::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135632::DEBUG::2014-10-29 11:10:13,210::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:10:13,211::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:13,211::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:13,212::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:13,212::__init__::232::IOProcess::(_processLogs) (199895) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:13,213::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199895) Queuing response >Thread-135632::DEBUG::2014-10-29 11:10:13,214::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135632::DEBUG::2014-10-29 11:10:13,214::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135632::INFO::2014-10-29 11:10:13,215::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135632::DEBUG::2014-10-29 11:10:13,215::task::1191::Storage.TaskManager.Task::(prepare) Task=`3052071d-6e83-4601-9f0b-4c9faab64ae8`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135632::DEBUG::2014-10-29 11:10:13,215::task::595::Storage.TaskManager.Task::(_updateState) Task=`3052071d-6e83-4601-9f0b-4c9faab64ae8`::moving from state preparing -> state finished >Thread-135632::DEBUG::2014-10-29 11:10:13,215::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135632::DEBUG::2014-10-29 11:10:13,216::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135632::DEBUG::2014-10-29 11:10:13,216::task::993::Storage.TaskManager.Task::(_decref) Task=`3052071d-6e83-4601-9f0b-4c9faab64ae8`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:10:13,259::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54020 >Detector thread::DEBUG::2014-10-29 11:10:13,260::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54020 >Detector thread::DEBUG::2014-10-29 11:10:13,260::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54020 >Detector thread::DEBUG::2014-10-29 11:10:13,261::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54020) >Thread-135633::DEBUG::2014-10-29 11:10:13,299::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135633::DEBUG::2014-10-29 11:10:13,300::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe0274c7-520a-4964-8d88-f8e1a633e6f0`::moving from state init -> state preparing >Thread-135633::INFO::2014-10-29 11:10:13,300::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135633::DEBUG::2014-10-29 11:10:13,300::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135633::DEBUG::2014-10-29 11:10:13,301::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135633::DEBUG::2014-10-29 11:10:13,301::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135633::DEBUG::2014-10-29 11:10:13,301::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135633::DEBUG::2014-10-29 11:10:13,301::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135633::DEBUG::2014-10-29 11:10:13,302::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135633::DEBUG::2014-10-29 11:10:13,396::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135633::DEBUG::2014-10-29 11:10:13,397::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135633::DEBUG::2014-10-29 11:10:13,630::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135633::DEBUG::2014-10-29 11:10:13,633::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135633::DEBUG::2014-10-29 11:10:13,633::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135633::DEBUG::2014-10-29 11:10:13,633::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135633::DEBUG::2014-10-29 11:10:13,634::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135633::DEBUG::2014-10-29 11:10:13,634::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135633::DEBUG::2014-10-29 11:10:13,635::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135633::DEBUG::2014-10-29 11:10:13,635::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:10:13,646::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:13,647::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:13,647::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:13,647::__init__::232::IOProcess::(_processLogs) (199896) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:13,648::__init__::232::IOProcess::(_processLogs) (199896) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:13,649::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:13,649::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:13,649::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:13,650::__init__::232::IOProcess::(_processLogs) (199897) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:13,650::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:13,650::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:13,650::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:13,651::__init__::232::IOProcess::(_processLogs) (199898) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:13,652::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199897) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:13,653::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:13,655::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:13,656::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:13,658::__init__::232::IOProcess::(_processLogs) (199899) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:13,660::__init__::232::IOProcess::(_processLogs) (199898) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:13,662::__init__::232::IOProcess::(_processLogs) (199899) Queuing response >Thread-135633::DEBUG::2014-10-29 11:10:13,665::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:10:13,670::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:13,670::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:13,671::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:13,671::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199900) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:10:13,672::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199900) Queuing response >Thread-135633::DEBUG::2014-10-29 11:10:13,673::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:10:13,674::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:13,674::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:13,674::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:13,675::__init__::232::IOProcess::(_processLogs) (199901) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:10:13,675::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199901) Queuing response >Thread-135633::DEBUG::2014-10-29 11:10:13,676::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:10:13,677::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:13,678::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:13,678::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:13,679::__init__::232::IOProcess::(_processLogs) (199902) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:13,679::__init__::232::IOProcess::(_processLogs) (199902) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:13,680::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:13,680::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:13,681::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:13,681::__init__::232::IOProcess::(_processLogs) (199903) Got request for method 'glob' >Thread-135633::DEBUG::2014-10-29 11:10:13,682::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:10:13,682::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199903) Queuing response >Thread-135633::INFO::2014-10-29 11:10:13,683::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135633::INFO::2014-10-29 11:10:13,683::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135633::INFO::2014-10-29 11:10:13,684::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:10:13,685::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:13,685::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:13,685::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:13,685::__init__::232::IOProcess::(_processLogs) (199904) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:10:13,686::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199904) Queuing response >Thread-135633::DEBUG::2014-10-29 11:10:13,687::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135633::DEBUG::2014-10-29 11:10:13,689::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`0652bd96-ee58-435e-af89-63968e05154c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135633::DEBUG::2014-10-29 11:10:13,689::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135633::DEBUG::2014-10-29 11:10:13,690::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135633::DEBUG::2014-10-29 11:10:13,690::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`0652bd96-ee58-435e-af89-63968e05154c`::Granted request >Thread-135633::DEBUG::2014-10-29 11:10:13,691::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fe0274c7-520a-4964-8d88-f8e1a633e6f0`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135633::DEBUG::2014-10-29 11:10:13,691::task::993::Storage.TaskManager.Task::(_decref) Task=`fe0274c7-520a-4964-8d88-f8e1a633e6f0`::ref 1 aborting False >Thread-135633::INFO::2014-10-29 11:10:13,694::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135633::DEBUG::2014-10-29 11:10:13,694::task::1191::Storage.TaskManager.Task::(prepare) Task=`fe0274c7-520a-4964-8d88-f8e1a633e6f0`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135633::DEBUG::2014-10-29 11:10:13,694::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe0274c7-520a-4964-8d88-f8e1a633e6f0`::moving from state preparing -> state finished >Thread-135633::DEBUG::2014-10-29 11:10:13,695::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135633::DEBUG::2014-10-29 11:10:13,695::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135633::DEBUG::2014-10-29 11:10:13,695::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135633::DEBUG::2014-10-29 11:10:13,696::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135633::DEBUG::2014-10-29 11:10:13,696::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135633::DEBUG::2014-10-29 11:10:13,696::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135633::DEBUG::2014-10-29 11:10:13,697::task::993::Storage.TaskManager.Task::(_decref) Task=`fe0274c7-520a-4964-8d88-f8e1a633e6f0`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:10:13,730::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54021 >Detector thread::DEBUG::2014-10-29 11:10:13,730::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54021 >Detector thread::DEBUG::2014-10-29 11:10:13,731::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54021 >Detector thread::DEBUG::2014-10-29 11:10:13,731::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54021) >Thread-135638::DEBUG::2014-10-29 11:10:13,770::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135638::DEBUG::2014-10-29 11:10:13,771::task::595::Storage.TaskManager.Task::(_updateState) Task=`99e1079f-dbce-4f63-b5cd-0b8e80a6232c`::moving from state init -> state preparing >Thread-135638::INFO::2014-10-29 11:10:13,771::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135638::INFO::2014-10-29 11:10:13,772::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048953', 'lastCheck': '8.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485109', 'lastCheck': '8.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521393', 'lastCheck': '8.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000618378', 'lastCheck': '8.4', 'valid': True}} >Thread-135638::DEBUG::2014-10-29 11:10:13,772::task::1191::Storage.TaskManager.Task::(prepare) Task=`99e1079f-dbce-4f63-b5cd-0b8e80a6232c`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048953', 'lastCheck': '8.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485109', 'lastCheck': '8.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521393', 'lastCheck': '8.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000618378', 'lastCheck': '8.4', 'valid': True}} >Thread-135638::DEBUG::2014-10-29 11:10:13,772::task::595::Storage.TaskManager.Task::(_updateState) Task=`99e1079f-dbce-4f63-b5cd-0b8e80a6232c`::moving from state preparing -> state finished >Thread-135638::DEBUG::2014-10-29 11:10:13,773::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135638::DEBUG::2014-10-29 11:10:13,773::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135638::DEBUG::2014-10-29 11:10:13,773::task::993::Storage.TaskManager.Task::(_decref) Task=`99e1079f-dbce-4f63-b5cd-0b8e80a6232c`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:14,138::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:14,140::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135639::DEBUG::2014-10-29 11:10:14,146::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:14,148::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:14,150::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135640::DEBUG::2014-10-29 11:10:14,153::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135640::DEBUG::2014-10-29 11:10:14,156::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:14,181::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:14,182::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:14,183::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:10:15,415::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:15,416::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:15,416::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:15,417::__init__::232::IOProcess::(_processLogs) (199905) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:15,418::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199905) Queuing response >Thread-179::DEBUG::2014-10-29 11:10:15,419::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:10:15,442::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-179::DEBUG::2014-10-29 11:10:15,442::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000651861 s, 571 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:10:15,445::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:15,446::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:15,446::__init__::232::IOProcess::(_processLogs) (199906) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:15,448::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199906) Queuing response >Thread-10269::DEBUG::2014-10-29 11:10:15,449::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:10:15,464::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:15,466::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:15,466::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:15,467::__init__::232::IOProcess::(_processLogs) (199907) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:15,469::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199907) Queuing response >Thread-33::DEBUG::2014-10-29 11:10:15,472::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:10:15,473::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000492208 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:10:15,492::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-33::DEBUG::2014-10-29 11:10:15,497::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000589753 s, 826 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:10:15,496::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:15,499::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:15,499::__init__::232::IOProcess::(_processLogs) (199908) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:15,499::__init__::232::IOProcess::(_processLogs) (199908) Queuing response >Thread-178::DEBUG::2014-10-29 11:10:15,503::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:10:15,503::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:15,522::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-178::DEBUG::2014-10-29 11:10:15,526::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000982508 s, 517 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:10:15,530::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:15,531::__init__::232::IOProcess::(_processLogs) (199909) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:15,531::__init__::232::IOProcess::(_processLogs) (199909) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:15,532::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:15,532::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:15,534::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:15,534::__init__::232::IOProcess::(_processLogs) (199910) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:15,536::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199910) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:15,538::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:15,540::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:15,541::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:15,541::__init__::232::IOProcess::(_processLogs) (199911) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:15,542::__init__::232::IOProcess::(_processLogs) (199911) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:15,542::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:15,544::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:15,545::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:15,546::__init__::232::IOProcess::(_processLogs) (199912) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:15,546::__init__::232::IOProcess::(_processLogs) (199912) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:15,546::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:15,547::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:15,548::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:15,548::__init__::232::IOProcess::(_processLogs) (199913) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:15,549::__init__::232::IOProcess::(_processLogs) (199913) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:15,549::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:15,550::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:15,551::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:15,551::__init__::232::IOProcess::(_processLogs) (199914) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:15,552::__init__::232::IOProcess::(_processLogs) (199914) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:15,552::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:15,553::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:15,554::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:15,554::__init__::232::IOProcess::(_processLogs) (199915) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:15,554::__init__::232::IOProcess::(_processLogs) (199915) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:15,555::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:15,556::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:15,557::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:15,557::__init__::232::IOProcess::(_processLogs) (199916) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:15,557::__init__::232::IOProcess::(_processLogs) (199916) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:15,557::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:15,558::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:15,559::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:15,560::__init__::232::IOProcess::(_processLogs) (199917) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:15,560::__init__::232::IOProcess::(_processLogs) (199917) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:15,561::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:15,562::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:15,562::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:15,563::__init__::232::IOProcess::(_processLogs) (199918) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:15,563::__init__::232::IOProcess::(_processLogs) (199918) Queuing response >Thread-22::DEBUG::2014-10-29 11:10:16,925::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:17,171::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:17,174::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135641::DEBUG::2014-10-29 11:10:17,177::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:17,179::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:17,181::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135642::DEBUG::2014-10-29 11:10:17,184::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135642::DEBUG::2014-10-29 11:10:17,186::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:19,190::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:19,192::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:19,193::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:10:19,640::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54022 >Detector thread::DEBUG::2014-10-29 11:10:19,641::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54022 >Detector thread::DEBUG::2014-10-29 11:10:19,641::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54022 >Detector thread::DEBUG::2014-10-29 11:10:19,642::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54022) >Thread-135643::DEBUG::2014-10-29 11:10:19,681::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135643::DEBUG::2014-10-29 11:10:19,683::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135643::DEBUG::2014-10-29 11:10:19,703::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135643::DEBUG::2014-10-29 11:10:19,750::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '166', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '66', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:10:19,835::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54023 >Detector thread::DEBUG::2014-10-29 11:10:19,836::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54023 >Detector thread::DEBUG::2014-10-29 11:10:19,836::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54023 >Detector thread::DEBUG::2014-10-29 11:10:19,837::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54023) >Thread-135644::DEBUG::2014-10-29 11:10:19,876::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135644::DEBUG::2014-10-29 11:10:19,877::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135644::DEBUG::2014-10-29 11:10:19,878::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.74', 'elapsedTime': '513652', 'displayType': 'vnc', 'cpuSys': '1.06', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '52265398', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '68167', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '31436.06'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.95', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:20,205::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:20,208::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135645::DEBUG::2014-10-29 11:10:20,211::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:20,214::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:20,215::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135646::DEBUG::2014-10-29 11:10:20,219::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135646::DEBUG::2014-10-29 11:10:20,221::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:10:20,966::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54025 >Detector thread::DEBUG::2014-10-29 11:10:20,967::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54025 >Detector thread::DEBUG::2014-10-29 11:10:20,967::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54025 >Detector thread::DEBUG::2014-10-29 11:10:20,967::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54025) >Thread-135647::DEBUG::2014-10-29 11:10:21,007::task::595::Storage.TaskManager.Task::(_updateState) Task=`59dc3676-20f8-4044-9e08-a5b0c7174d1c`::moving from state init -> state preparing >Thread-135647::INFO::2014-10-29 11:10:21,007::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135647::INFO::2014-10-29 11:10:21,008::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000982508', 'lastCheck': '5.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589753', 'lastCheck': '5.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000651861', 'lastCheck': '5.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492208', 'lastCheck': '5.5', 'valid': True}} >Thread-135647::DEBUG::2014-10-29 11:10:21,008::task::1191::Storage.TaskManager.Task::(prepare) Task=`59dc3676-20f8-4044-9e08-a5b0c7174d1c`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000982508', 'lastCheck': '5.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589753', 'lastCheck': '5.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000651861', 'lastCheck': '5.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492208', 'lastCheck': '5.5', 'valid': True}} >Thread-135647::DEBUG::2014-10-29 11:10:21,009::task::595::Storage.TaskManager.Task::(_updateState) Task=`59dc3676-20f8-4044-9e08-a5b0c7174d1c`::moving from state preparing -> state finished >Thread-135647::DEBUG::2014-10-29 11:10:21,009::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135647::DEBUG::2014-10-29 11:10:21,009::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135647::DEBUG::2014-10-29 11:10:21,009::task::993::Storage.TaskManager.Task::(_decref) Task=`59dc3676-20f8-4044-9e08-a5b0c7174d1c`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:23,236::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:23,238::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135648::DEBUG::2014-10-29 11:10:23,242::task::595::Storage.TaskManager.Task::(_updateState) Task=`19358917-90cb-4cad-9e23-1a385a1e285d`::moving from state init -> state preparing >Thread-135648::INFO::2014-10-29 11:10:23,243::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135648::INFO::2014-10-29 11:10:23,244::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000982508', 'lastCheck': '7.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589753', 'lastCheck': '7.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000651861', 'lastCheck': '7.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492208', 'lastCheck': '7.7', 'valid': True}} >Thread-135648::DEBUG::2014-10-29 11:10:23,244::task::1191::Storage.TaskManager.Task::(prepare) Task=`19358917-90cb-4cad-9e23-1a385a1e285d`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000982508', 'lastCheck': '7.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589753', 'lastCheck': '7.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000651861', 'lastCheck': '7.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492208', 'lastCheck': '7.7', 'valid': True}} >Thread-135648::DEBUG::2014-10-29 11:10:23,244::task::595::Storage.TaskManager.Task::(_updateState) Task=`19358917-90cb-4cad-9e23-1a385a1e285d`::moving from state preparing -> state finished >Thread-135648::DEBUG::2014-10-29 11:10:23,244::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135648::DEBUG::2014-10-29 11:10:23,245::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135648::DEBUG::2014-10-29 11:10:23,245::task::993::Storage.TaskManager.Task::(_decref) Task=`19358917-90cb-4cad-9e23-1a385a1e285d`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:24,200::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:24,206::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:24,207::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135648::DEBUG::2014-10-29 11:10:24,305::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:24,334::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:24,336::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135649::DEBUG::2014-10-29 11:10:24,339::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135649::DEBUG::2014-10-29 11:10:24,342::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:10:24,650::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54027 >Detector thread::DEBUG::2014-10-29 11:10:24,651::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54027 >Detector thread::DEBUG::2014-10-29 11:10:24,651::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54027 >Detector thread::DEBUG::2014-10-29 11:10:24,652::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54027) >Thread-135650::DEBUG::2014-10-29 11:10:24,692::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135650::DEBUG::2014-10-29 11:10:24,693::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd649745-0266-4d26-abba-3f70c87f4f15`::moving from state init -> state preparing >Thread-135650::INFO::2014-10-29 11:10:24,693::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135650::DEBUG::2014-10-29 11:10:24,698::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:10:24,699::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:24,699::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:24,700::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:24,700::__init__::232::IOProcess::(_processLogs) (199919) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:24,701::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199919) Queuing response >Thread-135650::DEBUG::2014-10-29 11:10:24,702::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135650::DEBUG::2014-10-29 11:10:24,702::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135650::INFO::2014-10-29 11:10:24,702::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135650::DEBUG::2014-10-29 11:10:24,703::task::1191::Storage.TaskManager.Task::(prepare) Task=`fd649745-0266-4d26-abba-3f70c87f4f15`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135650::DEBUG::2014-10-29 11:10:24,703::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd649745-0266-4d26-abba-3f70c87f4f15`::moving from state preparing -> state finished >Thread-135650::DEBUG::2014-10-29 11:10:24,703::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135650::DEBUG::2014-10-29 11:10:24,703::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135650::DEBUG::2014-10-29 11:10:24,704::task::993::Storage.TaskManager.Task::(_decref) Task=`fd649745-0266-4d26-abba-3f70c87f4f15`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:10:24,747::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54028 >Detector thread::DEBUG::2014-10-29 11:10:24,749::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54028 >Detector thread::DEBUG::2014-10-29 11:10:24,749::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54028 >Detector thread::DEBUG::2014-10-29 11:10:24,749::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54028) >Thread-135651::DEBUG::2014-10-29 11:10:24,789::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135651::DEBUG::2014-10-29 11:10:24,790::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ed063e0-1637-40a9-ab6f-5e2e32a8657f`::moving from state init -> state preparing >Thread-135651::INFO::2014-10-29 11:10:24,790::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135651::DEBUG::2014-10-29 11:10:24,791::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135651::DEBUG::2014-10-29 11:10:24,791::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135651::DEBUG::2014-10-29 11:10:24,791::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135651::DEBUG::2014-10-29 11:10:24,791::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135651::DEBUG::2014-10-29 11:10:24,792::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135651::DEBUG::2014-10-29 11:10:24,792::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135651::DEBUG::2014-10-29 11:10:24,872::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135651::DEBUG::2014-10-29 11:10:24,873::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135651::DEBUG::2014-10-29 11:10:25,070::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135651::DEBUG::2014-10-29 11:10:25,071::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135651::DEBUG::2014-10-29 11:10:25,071::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135651::DEBUG::2014-10-29 11:10:25,072::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135651::DEBUG::2014-10-29 11:10:25,072::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135651::DEBUG::2014-10-29 11:10:25,073::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135651::DEBUG::2014-10-29 11:10:25,073::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135651::DEBUG::2014-10-29 11:10:25,073::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:10:25,080::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:25,081::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:25,081::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:25,082::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:25,082::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:25,083::__init__::232::IOProcess::(_processLogs) (199920) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:25,084::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199920) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:25,087::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:25,088::__init__::232::IOProcess::(_processLogs) (199921) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:25,088::__init__::232::IOProcess::(_processLogs) (199921) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:25,092::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:25,094::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:25,096::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:25,097::__init__::232::IOProcess::(_processLogs) (199922) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:25,102::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199922) Queuing response >Thread-135651::DEBUG::2014-10-29 11:10:25,102::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:10:25,104::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:25,105::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:25,106::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:25,106::__init__::232::IOProcess::(_processLogs) (199923) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:25,106::__init__::232::IOProcess::(_processLogs) (199923) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:25,108::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:25,108::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:25,108::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:25,109::__init__::232::IOProcess::(_processLogs) (199924) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:10:25,115::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199924) Queuing response >Thread-135651::DEBUG::2014-10-29 11:10:25,116::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:10:25,117::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:25,117::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:25,118::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:25,118::__init__::232::IOProcess::(_processLogs) (199925) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:10:25,119::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199925) Queuing response >Thread-135651::DEBUG::2014-10-29 11:10:25,120::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:10:25,121::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:25,122::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:25,123::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:25,123::__init__::232::IOProcess::(_processLogs) (199926) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:25,123::__init__::232::IOProcess::(_processLogs) (199926) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:25,124::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:25,124::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:25,124::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:25,125::__init__::232::IOProcess::(_processLogs) (199927) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:25,125::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199927) Queuing response >Thread-135651::DEBUG::2014-10-29 11:10:25,126::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-135651::INFO::2014-10-29 11:10:25,127::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135651::INFO::2014-10-29 11:10:25,127::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135651::INFO::2014-10-29 11:10:25,127::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:10:25,128::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:25,128::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:25,128::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:25,129::__init__::232::IOProcess::(_processLogs) (199928) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:10:25,129::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199928) Queuing response >Thread-135651::DEBUG::2014-10-29 11:10:25,130::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135651::DEBUG::2014-10-29 11:10:25,132::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`51ab888f-395b-473e-ac38-f84d4334fafb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135651::DEBUG::2014-10-29 11:10:25,132::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135651::DEBUG::2014-10-29 11:10:25,132::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135651::DEBUG::2014-10-29 11:10:25,132::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`51ab888f-395b-473e-ac38-f84d4334fafb`::Granted request >Thread-135651::DEBUG::2014-10-29 11:10:25,133::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2ed063e0-1637-40a9-ab6f-5e2e32a8657f`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135651::DEBUG::2014-10-29 11:10:25,133::task::993::Storage.TaskManager.Task::(_decref) Task=`2ed063e0-1637-40a9-ab6f-5e2e32a8657f`::ref 1 aborting False >Thread-135651::INFO::2014-10-29 11:10:25,136::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135651::DEBUG::2014-10-29 11:10:25,136::task::1191::Storage.TaskManager.Task::(prepare) Task=`2ed063e0-1637-40a9-ab6f-5e2e32a8657f`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135651::DEBUG::2014-10-29 11:10:25,137::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ed063e0-1637-40a9-ab6f-5e2e32a8657f`::moving from state preparing -> state finished >Thread-135651::DEBUG::2014-10-29 11:10:25,137::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135651::DEBUG::2014-10-29 11:10:25,137::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135651::DEBUG::2014-10-29 11:10:25,138::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135651::DEBUG::2014-10-29 11:10:25,138::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135651::DEBUG::2014-10-29 11:10:25,138::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135651::DEBUG::2014-10-29 11:10:25,138::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135651::DEBUG::2014-10-29 11:10:25,139::task::993::Storage.TaskManager.Task::(_decref) Task=`2ed063e0-1637-40a9-ab6f-5e2e32a8657f`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:10:25,162::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54029 >Detector thread::DEBUG::2014-10-29 11:10:25,163::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54029 >Detector thread::DEBUG::2014-10-29 11:10:25,163::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54029 >Detector thread::DEBUG::2014-10-29 11:10:25,163::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54029) >Thread-135656::DEBUG::2014-10-29 11:10:25,202::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135656::DEBUG::2014-10-29 11:10:25,202::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5595eee-c814-4c68-922f-cb64209be3c3`::moving from state init -> state preparing >Thread-135656::INFO::2014-10-29 11:10:25,203::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135656::INFO::2014-10-29 11:10:25,204::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000982508', 'lastCheck': '9.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589753', 'lastCheck': '9.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000651861', 'lastCheck': '9.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492208', 'lastCheck': '9.7', 'valid': True}} >Thread-135656::DEBUG::2014-10-29 11:10:25,204::task::1191::Storage.TaskManager.Task::(prepare) Task=`b5595eee-c814-4c68-922f-cb64209be3c3`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000982508', 'lastCheck': '9.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589753', 'lastCheck': '9.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000651861', 'lastCheck': '9.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492208', 'lastCheck': '9.7', 'valid': True}} >Thread-135656::DEBUG::2014-10-29 11:10:25,204::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5595eee-c814-4c68-922f-cb64209be3c3`::moving from state preparing -> state finished >Thread-135656::DEBUG::2014-10-29 11:10:25,204::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135656::DEBUG::2014-10-29 11:10:25,205::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135656::DEBUG::2014-10-29 11:10:25,205::task::993::Storage.TaskManager.Task::(_decref) Task=`b5595eee-c814-4c68-922f-cb64209be3c3`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:10:25,535::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:25,535::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:25,535::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:25,535::__init__::232::IOProcess::(_processLogs) (199929) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:25,536::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199929) Queuing response >Thread-179::DEBUG::2014-10-29 11:10:25,538::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:10:25,557::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-179::DEBUG::2014-10-29 11:10:25,558::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000537107 s, 693 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:10:25,559::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:25,562::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:25,562::__init__::232::IOProcess::(_processLogs) (199930) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:25,565::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199930) Queuing response >Thread-10269::DEBUG::2014-10-29 11:10:25,567::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:10:25,567::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:25,583::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:25,584::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:25,585::__init__::232::IOProcess::(_processLogs) (199931) Got request for method 'statvfs' >Thread-10269::DEBUG::2014-10-29 11:10:25,587::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000657154 s, 764 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:10:25,591::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199931) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:25,593::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:25,594::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:25,594::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:25,594::__init__::232::IOProcess::(_processLogs) (199932) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:25,597::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199932) Queuing response >Thread-33::DEBUG::2014-10-29 11:10:25,598::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:10:25,599::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:25,617::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:25,617::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:25,618::__init__::232::IOProcess::(_processLogs) (199933) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:25,619::__init__::232::IOProcess::(_processLogs) (199933) Queuing response >Thread-33::DEBUG::2014-10-29 11:10:25,620::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000662685 s, 735 kB/s\n'; <rc> = 0 >Thread-178::DEBUG::2014-10-29 11:10:25,625::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:10:25,626::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:25,641::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:25,641::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:25,641::__init__::232::IOProcess::(_processLogs) (199934) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:25,644::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199934) Queuing response >Thread-178::DEBUG::2014-10-29 11:10:25,646::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00113829 s, 446 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:10:25,649::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:25,650::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:25,650::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:25,650::__init__::232::IOProcess::(_processLogs) (199935) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:25,652::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199935) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:25,653::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:25,654::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:25,654::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:25,654::__init__::232::IOProcess::(_processLogs) (199936) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:25,656::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199936) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:25,657::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:25,657::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:25,657::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:25,657::__init__::232::IOProcess::(_processLogs) (199937) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:25,658::__init__::232::IOProcess::(_processLogs) (199937) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:25,659::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:25,660::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:25,661::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:25,661::__init__::232::IOProcess::(_processLogs) (199938) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:25,662::__init__::232::IOProcess::(_processLogs) (199938) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:25,662::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:25,663::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:25,664::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:25,664::__init__::232::IOProcess::(_processLogs) (199939) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:25,664::__init__::232::IOProcess::(_processLogs) (199939) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:25,665::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:25,666::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:25,667::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:25,667::__init__::232::IOProcess::(_processLogs) (199940) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:25,667::__init__::232::IOProcess::(_processLogs) (199940) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:25,667::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:25,668::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:25,669::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:25,670::__init__::232::IOProcess::(_processLogs) (199941) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:25,670::__init__::232::IOProcess::(_processLogs) (199941) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:25,670::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:25,671::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:25,672::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:25,673::__init__::232::IOProcess::(_processLogs) (199942) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:25,673::__init__::232::IOProcess::(_processLogs) (199942) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:27,424::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:27,427::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135657::DEBUG::2014-10-29 11:10:27,431::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:27,433::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:27,435::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135658::DEBUG::2014-10-29 11:10:27,438::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135658::DEBUG::2014-10-29 11:10:27,440::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:29,209::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:29,211::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:29,212::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:10:29,801::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54030 >Detector thread::DEBUG::2014-10-29 11:10:29,801::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54030 >Detector thread::DEBUG::2014-10-29 11:10:29,802::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54030 >Detector thread::DEBUG::2014-10-29 11:10:29,802::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54030) >Thread-135659::DEBUG::2014-10-29 11:10:29,841::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135659::DEBUG::2014-10-29 11:10:29,842::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135659::DEBUG::2014-10-29 11:10:29,860::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135659::DEBUG::2014-10-29 11:10:29,907::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '150', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '50', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:10:30,038::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54031 >Detector thread::DEBUG::2014-10-29 11:10:30,039::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54031 >Detector thread::DEBUG::2014-10-29 11:10:30,039::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54031 >Detector thread::DEBUG::2014-10-29 11:10:30,040::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54031) >Thread-135660::DEBUG::2014-10-29 11:10:30,079::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135660::DEBUG::2014-10-29 11:10:30,080::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135660::DEBUG::2014-10-29 11:10:30,081::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.74', 'elapsedTime': '513662', 'displayType': 'vnc', 'cpuSys': '1.06', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '52265398', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '68167', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '31436.06'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.15', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:30,463::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:30,466::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135661::DEBUG::2014-10-29 11:10:30,469::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:30,471::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:30,473::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135662::DEBUG::2014-10-29 11:10:30,476::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135662::DEBUG::2014-10-29 11:10:30,479::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:10:31,098::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54033 >Detector thread::DEBUG::2014-10-29 11:10:31,099::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54033 >Detector thread::DEBUG::2014-10-29 11:10:31,099::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54033 >Detector thread::DEBUG::2014-10-29 11:10:31,100::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54033) >Thread-135663::DEBUG::2014-10-29 11:10:31,140::task::595::Storage.TaskManager.Task::(_updateState) Task=`7e6026c2-1159-48d8-a7db-1565b755f7e4`::moving from state init -> state preparing >Thread-135663::INFO::2014-10-29 11:10:31,141::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135663::INFO::2014-10-29 11:10:31,142::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00113829', 'lastCheck': '5.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000662685', 'lastCheck': '5.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000537107', 'lastCheck': '5.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000657154', 'lastCheck': '5.5', 'valid': True}} >Thread-135663::DEBUG::2014-10-29 11:10:31,142::task::1191::Storage.TaskManager.Task::(prepare) Task=`7e6026c2-1159-48d8-a7db-1565b755f7e4`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00113829', 'lastCheck': '5.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000662685', 'lastCheck': '5.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000537107', 'lastCheck': '5.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000657154', 'lastCheck': '5.5', 'valid': True}} >Thread-135663::DEBUG::2014-10-29 11:10:31,142::task::595::Storage.TaskManager.Task::(_updateState) Task=`7e6026c2-1159-48d8-a7db-1565b755f7e4`::moving from state preparing -> state finished >Thread-135663::DEBUG::2014-10-29 11:10:31,142::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135663::DEBUG::2014-10-29 11:10:31,143::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135663::DEBUG::2014-10-29 11:10:31,143::task::993::Storage.TaskManager.Task::(_decref) Task=`7e6026c2-1159-48d8-a7db-1565b755f7e4`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:10:31,949::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >VM Channels Listener::DEBUG::2014-10-29 11:10:33,397::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:33,492::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:33,495::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135664::DEBUG::2014-10-29 11:10:33,498::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:33,501::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:33,502::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135665::DEBUG::2014-10-29 11:10:33,506::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135665::DEBUG::2014-10-29 11:10:33,508::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:34,219::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:34,220::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:34,222::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:10:35,598::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:35,598::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:35,599::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:35,599::__init__::232::IOProcess::(_processLogs) (199943) Got request for method 'statvfs' >Thread-10269::DEBUG::2014-10-29 11:10:35,650::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain de096187-36e2-44e5-b8db-a9b67c3960de >Thread-17::DEBUG::2014-10-29 11:10:35,661::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:35,661::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:35,662::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:35,662::__init__::232::IOProcess::(_processLogs) (199944) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:35,663::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:35,663::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:35,664::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:35,664::__init__::232::IOProcess::(_processLogs) (199945) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:35,665::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:35,665::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:35,666::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:35,666::__init__::232::IOProcess::(_processLogs) (199946) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:35,667::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:35,668::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:35,670::__init__::232::IOProcess::(_processLogs) (199943) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:35,672::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-179::DEBUG::2014-10-29 11:10:35,672::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:10:35,694::__init__::232::IOProcess::(_processLogs) (199947) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:35,696::__init__::232::IOProcess::(_processLogs) (199945) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:35,697::__init__::232::IOProcess::(_processLogs) (199946) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:35,697::__init__::232::IOProcess::(_processLogs) (199947) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:35,698::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199944) Queuing response >Thread-179::DEBUG::2014-10-29 11:10:35,701::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00200537 s, 186 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:10:35,708::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:35,708::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:35,708::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-10269::DEBUG::2014-10-29 11:10:35,713::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de >Thread-17::DEBUG::2014-10-29 11:10:35,714::__init__::232::IOProcess::(_processLogs) (199948) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:35,714::__init__::232::IOProcess::(_processLogs) (199948) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:35,718::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-33::DEBUG::2014-10-29 11:10:35,719::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:10:35,739::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:35,743::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-33::DEBUG::2014-10-29 11:10:35,743::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.0014077 s, 346 kB/s\n'; <rc> = 0 >Thread-178::DEBUG::2014-10-29 11:10:35,745::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:10:35,746::__init__::232::IOProcess::(_processLogs) (199949) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:35,769::__init__::232::IOProcess::(_processLogs) (199949) Queuing response >Thread-178::DEBUG::2014-10-29 11:10:35,771::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000761938 s, 667 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:10:35,774::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:35,777::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:35,778::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:35,778::__init__::232::IOProcess::(_processLogs) (199950) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:35,779::__init__::232::IOProcess::(_processLogs) (199950) Queuing response >Thread-10269::DEBUG::2014-10-29 11:10:35,793::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:10:35,794::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:35,796::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:35,798::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:35,798::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:35,798::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:35,798::__init__::232::IOProcess::(_processLogs) (199951) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:10:35,799::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:35,799::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:35,799::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:35,799::__init__::232::IOProcess::(_processLogs) (199952) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:35,800::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:35,800::__init__::232::IOProcess::(_processLogs) (199953) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:35,800::__init__::232::IOProcess::(_processLogs) (199952) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:35,800::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199953) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:35,801::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:35,801::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:35,801::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:35,801::__init__::232::IOProcess::(_processLogs) (199954) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:35,802::__init__::232::IOProcess::(_processLogs) (199954) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:35,802::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:35,802::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:35,802::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:35,803::__init__::232::IOProcess::(_processLogs) (199955) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:35,803::__init__::232::IOProcess::(_processLogs) (199955) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:35,803::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:35,803::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:35,804::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:35,804::__init__::232::IOProcess::(_processLogs) (199956) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:35,804::__init__::232::IOProcess::(_processLogs) (199956) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:35,804::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:35,807::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:35,808::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:35,808::__init__::232::IOProcess::(_processLogs) (199957) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:35,808::__init__::232::IOProcess::(_processLogs) (199957) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:35,808::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:35,809::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:35,809::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:35,809::__init__::232::IOProcess::(_processLogs) (199958) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:35,810::__init__::232::IOProcess::(_processLogs) (199958) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:35,810::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:35,810::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:35,810::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:35,811::__init__::232::IOProcess::(_processLogs) (199959) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:35,811::__init__::232::IOProcess::(_processLogs) (199959) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:35,811::__init__::232::IOProcess::(_processLogs) (199951) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:35,812::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:35,812::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:35,812::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:35,812::__init__::232::IOProcess::(_processLogs) (199960) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:10:35,814::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199960) Queuing response >Thread-10269::DEBUG::2014-10-29 11:10:35,814::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nsednev-iso-domain', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=00000002-0002-0002-0002-000000000324,00000002-0002-0002-0002-00000000002d,00000002-0002-0002-0002-0000000003d4,00000002-0002-0002-0002-000000000321', 'REMOTE_PATH=monster-nfs.scl.lab.tlv.redhat.com:/RHEV/nsednev-iso-domain', 'ROLE=Regular', 'SDUUID=de096187-36e2-44e5-b8db-a9b67c3960de', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=4fa36e197e83f2488bfc8aea7825ed34cc463260'] >Thread-17::DEBUG::2014-10-29 11:10:35,816::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:35,816::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:35,817::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:35,817::__init__::232::IOProcess::(_processLogs) (199961) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:35,817::__init__::232::IOProcess::(_processLogs) (199961) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:35,818::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:35,819::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:35,819::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:35,819::__init__::232::IOProcess::(_processLogs) (199962) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:35,820::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199962) Queuing response >Thread-10269::DEBUG::2014-10-29 11:10:35,820::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-10269::INFO::2014-10-29 11:10:35,822::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace de096187-36e2-44e5-b8db-a9b67c3960de_imageNS already registered >Thread-10269::INFO::2014-10-29 11:10:35,822::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace de096187-36e2-44e5-b8db-a9b67c3960de_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:10:35,823::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:35,823::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:35,823::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:35,823::__init__::232::IOProcess::(_processLogs) (199963) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:35,825::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199963) Queuing response >Thread-10269::DEBUG::2014-10-29 11:10:35,827::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:10:35,844::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000563018 s, 892 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:10:35,846::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:35,847::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Detector thread::DEBUG::2014-10-29 11:10:35,849::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54035 >Detector thread::DEBUG::2014-10-29 11:10:35,849::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54035 >Thread-17::DEBUG::2014-10-29 11:10:35,850::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Detector thread::DEBUG::2014-10-29 11:10:35,849::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54035 >Thread-17::DEBUG::2014-10-29 11:10:35,851::__init__::232::IOProcess::(_processLogs) (199964) Got request for method 'statvfs' >Detector thread::DEBUG::2014-10-29 11:10:35,852::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54035) >Thread-17::DEBUG::2014-10-29 11:10:35,859::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199964) Queuing response >Thread-135670::DEBUG::2014-10-29 11:10:35,890::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135670::DEBUG::2014-10-29 11:10:35,891::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7d617cf-bd1a-4b59-9963-e226961da8cc`::moving from state init -> state preparing >Thread-135670::INFO::2014-10-29 11:10:35,891::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135670::DEBUG::2014-10-29 11:10:35,894::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:10:35,895::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:35,895::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:35,895::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:35,896::__init__::232::IOProcess::(_processLogs) (199965) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:35,896::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199965) Queuing response >Thread-135670::DEBUG::2014-10-29 11:10:35,897::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135670::DEBUG::2014-10-29 11:10:35,897::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135670::INFO::2014-10-29 11:10:35,897::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135670::DEBUG::2014-10-29 11:10:35,898::task::1191::Storage.TaskManager.Task::(prepare) Task=`d7d617cf-bd1a-4b59-9963-e226961da8cc`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135670::DEBUG::2014-10-29 11:10:35,898::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7d617cf-bd1a-4b59-9963-e226961da8cc`::moving from state preparing -> state finished >Thread-135670::DEBUG::2014-10-29 11:10:35,898::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135670::DEBUG::2014-10-29 11:10:35,898::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135670::DEBUG::2014-10-29 11:10:35,899::task::993::Storage.TaskManager.Task::(_decref) Task=`d7d617cf-bd1a-4b59-9963-e226961da8cc`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:10:35,943::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54036 >Detector thread::DEBUG::2014-10-29 11:10:35,943::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54036 >Detector thread::DEBUG::2014-10-29 11:10:35,943::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54036 >Detector thread::DEBUG::2014-10-29 11:10:35,944::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54036) >Thread-135671::DEBUG::2014-10-29 11:10:35,983::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135671::DEBUG::2014-10-29 11:10:35,983::task::595::Storage.TaskManager.Task::(_updateState) Task=`77303397-2c86-47ed-968d-ae51bb8ed64e`::moving from state init -> state preparing >Thread-135671::INFO::2014-10-29 11:10:35,984::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135671::DEBUG::2014-10-29 11:10:35,984::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135671::DEBUG::2014-10-29 11:10:35,984::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135671::DEBUG::2014-10-29 11:10:35,985::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135671::DEBUG::2014-10-29 11:10:35,985::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135671::DEBUG::2014-10-29 11:10:35,985::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135671::DEBUG::2014-10-29 11:10:35,986::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135671::DEBUG::2014-10-29 11:10:36,060::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135671::DEBUG::2014-10-29 11:10:36,061::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135671::DEBUG::2014-10-29 11:10:36,231::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135671::DEBUG::2014-10-29 11:10:36,233::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135671::DEBUG::2014-10-29 11:10:36,234::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135671::DEBUG::2014-10-29 11:10:36,234::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135671::DEBUG::2014-10-29 11:10:36,235::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135671::DEBUG::2014-10-29 11:10:36,235::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135671::DEBUG::2014-10-29 11:10:36,235::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135671::DEBUG::2014-10-29 11:10:36,236::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:10:36,242::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:36,246::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:36,247::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:36,248::__init__::232::IOProcess::(_processLogs) (199966) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:36,248::__init__::232::IOProcess::(_processLogs) (199966) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:36,249::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:36,249::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:36,249::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:36,250::__init__::232::IOProcess::(_processLogs) (199967) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:36,250::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199967) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:36,250::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:36,251::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:36,251::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:36,251::__init__::232::IOProcess::(_processLogs) (199968) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:36,252::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:36,252::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:36,252::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:36,252::__init__::232::IOProcess::(_processLogs) (199969) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:36,253::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199968) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:36,259::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199969) Queuing response >Thread-135671::DEBUG::2014-10-29 11:10:36,263::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:10:36,264::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:36,264::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:36,265::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:36,265::__init__::232::IOProcess::(_processLogs) (199970) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:10:36,266::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199970) Queuing response >Thread-135671::DEBUG::2014-10-29 11:10:36,267::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:10:36,268::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:36,268::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:36,268::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:36,269::__init__::232::IOProcess::(_processLogs) (199971) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:10:36,269::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199971) Queuing response >Thread-135671::DEBUG::2014-10-29 11:10:36,270::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:10:36,272::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:36,272::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:36,273::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:36,273::__init__::232::IOProcess::(_processLogs) (199972) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:36,274::__init__::232::IOProcess::(_processLogs) (199972) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:36,274::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:36,274::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:36,275::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:36,275::__init__::232::IOProcess::(_processLogs) (199973) Got request for method 'glob' >Thread-135671::DEBUG::2014-10-29 11:10:36,276::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:10:36,276::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199973) Queuing response >Thread-135671::INFO::2014-10-29 11:10:36,277::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135671::INFO::2014-10-29 11:10:36,278::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135671::INFO::2014-10-29 11:10:36,278::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:10:36,279::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:36,279::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:36,279::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:36,280::__init__::232::IOProcess::(_processLogs) (199974) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:10:36,280::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199974) Queuing response >Thread-135671::DEBUG::2014-10-29 11:10:36,281::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135671::DEBUG::2014-10-29 11:10:36,283::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`80815020-ede0-48bb-b5f9-d5d15edb330b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135671::DEBUG::2014-10-29 11:10:36,283::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135671::DEBUG::2014-10-29 11:10:36,284::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135671::DEBUG::2014-10-29 11:10:36,284::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`80815020-ede0-48bb-b5f9-d5d15edb330b`::Granted request >Thread-135671::DEBUG::2014-10-29 11:10:36,285::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`77303397-2c86-47ed-968d-ae51bb8ed64e`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135671::DEBUG::2014-10-29 11:10:36,285::task::993::Storage.TaskManager.Task::(_decref) Task=`77303397-2c86-47ed-968d-ae51bb8ed64e`::ref 1 aborting False >Thread-135671::INFO::2014-10-29 11:10:36,288::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135671::DEBUG::2014-10-29 11:10:36,289::task::1191::Storage.TaskManager.Task::(prepare) Task=`77303397-2c86-47ed-968d-ae51bb8ed64e`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135671::DEBUG::2014-10-29 11:10:36,289::task::595::Storage.TaskManager.Task::(_updateState) Task=`77303397-2c86-47ed-968d-ae51bb8ed64e`::moving from state preparing -> state finished >Thread-135671::DEBUG::2014-10-29 11:10:36,289::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135671::DEBUG::2014-10-29 11:10:36,290::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135671::DEBUG::2014-10-29 11:10:36,290::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135671::DEBUG::2014-10-29 11:10:36,290::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135671::DEBUG::2014-10-29 11:10:36,291::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135671::DEBUG::2014-10-29 11:10:36,291::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135671::DEBUG::2014-10-29 11:10:36,292::task::993::Storage.TaskManager.Task::(_decref) Task=`77303397-2c86-47ed-968d-ae51bb8ed64e`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:10:36,323::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54037 >Detector thread::DEBUG::2014-10-29 11:10:36,324::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54037 >Detector thread::DEBUG::2014-10-29 11:10:36,324::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54037 >Detector thread::DEBUG::2014-10-29 11:10:36,325::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54037) >Thread-135676::DEBUG::2014-10-29 11:10:36,363::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135676::DEBUG::2014-10-29 11:10:36,364::task::595::Storage.TaskManager.Task::(_updateState) Task=`7a6fa3ad-3ac9-4529-9f88-d927aa8c59fa`::moving from state init -> state preparing >Thread-135676::INFO::2014-10-29 11:10:36,364::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135676::INFO::2014-10-29 11:10:36,365::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000761938', 'lastCheck': '0.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0014077', 'lastCheck': '0.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00200537', 'lastCheck': '0.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000563018', 'lastCheck': '0.5', 'valid': True}} >Thread-135676::DEBUG::2014-10-29 11:10:36,365::task::1191::Storage.TaskManager.Task::(prepare) Task=`7a6fa3ad-3ac9-4529-9f88-d927aa8c59fa`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000761938', 'lastCheck': '0.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0014077', 'lastCheck': '0.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00200537', 'lastCheck': '0.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000563018', 'lastCheck': '0.5', 'valid': True}} >Thread-135676::DEBUG::2014-10-29 11:10:36,365::task::595::Storage.TaskManager.Task::(_updateState) Task=`7a6fa3ad-3ac9-4529-9f88-d927aa8c59fa`::moving from state preparing -> state finished >Thread-135676::DEBUG::2014-10-29 11:10:36,365::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135676::DEBUG::2014-10-29 11:10:36,366::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135676::DEBUG::2014-10-29 11:10:36,366::task::993::Storage.TaskManager.Task::(_decref) Task=`7a6fa3ad-3ac9-4529-9f88-d927aa8c59fa`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:36,524::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:36,527::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135677::DEBUG::2014-10-29 11:10:36,531::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:36,533::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:36,535::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135678::DEBUG::2014-10-29 11:10:36,538::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135678::DEBUG::2014-10-29 11:10:36,540::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:39,228::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:39,230::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:39,233::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:10:39,240::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54038 >Detector thread::DEBUG::2014-10-29 11:10:39,241::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54038 >Detector thread::DEBUG::2014-10-29 11:10:39,242::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54038 >Detector thread::DEBUG::2014-10-29 11:10:39,242::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54038) >Thread-135679::DEBUG::2014-10-29 11:10:39,281::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135679::DEBUG::2014-10-29 11:10:39,282::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135679::DEBUG::2014-10-29 11:10:39,282::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.17', 'elapsedTime': '513671', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '52265398', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '68167', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '31436.06'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.33', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:39,554::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:39,556::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135680::DEBUG::2014-10-29 11:10:39,560::task::595::Storage.TaskManager.Task::(_updateState) Task=`88f29e60-1bc1-41c8-8240-cbcb564b81a2`::moving from state init -> state preparing >Thread-135680::INFO::2014-10-29 11:10:39,560::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135680::INFO::2014-10-29 11:10:39,561::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000761938', 'lastCheck': '3.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0014077', 'lastCheck': '3.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00200537', 'lastCheck': '3.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000563018', 'lastCheck': '3.7', 'valid': True}} >Thread-135680::DEBUG::2014-10-29 11:10:39,561::task::1191::Storage.TaskManager.Task::(prepare) Task=`88f29e60-1bc1-41c8-8240-cbcb564b81a2`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000761938', 'lastCheck': '3.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0014077', 'lastCheck': '3.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00200537', 'lastCheck': '3.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000563018', 'lastCheck': '3.7', 'valid': True}} >Thread-135680::DEBUG::2014-10-29 11:10:39,561::task::595::Storage.TaskManager.Task::(_updateState) Task=`88f29e60-1bc1-41c8-8240-cbcb564b81a2`::moving from state preparing -> state finished >Thread-135680::DEBUG::2014-10-29 11:10:39,562::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135680::DEBUG::2014-10-29 11:10:39,562::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135680::DEBUG::2014-10-29 11:10:39,562::task::993::Storage.TaskManager.Task::(_decref) Task=`88f29e60-1bc1-41c8-8240-cbcb564b81a2`::ref 0 aborting False >Thread-135680::DEBUG::2014-10-29 11:10:39,610::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:39,632::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:39,635::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135681::DEBUG::2014-10-29 11:10:39,638::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135681::DEBUG::2014-10-29 11:10:39,640::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:10:39,949::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54040 >Detector thread::DEBUG::2014-10-29 11:10:39,949::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54040 >Detector thread::DEBUG::2014-10-29 11:10:39,950::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54040 >Detector thread::DEBUG::2014-10-29 11:10:39,950::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54040) >Thread-135682::DEBUG::2014-10-29 11:10:39,989::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135682::DEBUG::2014-10-29 11:10:39,991::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135682::DEBUG::2014-10-29 11:10:40,010::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135682::DEBUG::2014-10-29 11:10:40,057::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '135', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '35', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:10:41,196::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54041 >Detector thread::DEBUG::2014-10-29 11:10:41,197::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54041 >Detector thread::DEBUG::2014-10-29 11:10:41,197::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54041 >Detector thread::DEBUG::2014-10-29 11:10:41,197::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54041) >Thread-135683::DEBUG::2014-10-29 11:10:41,237::task::595::Storage.TaskManager.Task::(_updateState) Task=`3791451c-21bb-489c-ae12-682406e77ad7`::moving from state init -> state preparing >Thread-135683::INFO::2014-10-29 11:10:41,237::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135683::INFO::2014-10-29 11:10:41,238::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000761938', 'lastCheck': '5.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0014077', 'lastCheck': '5.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00200537', 'lastCheck': '5.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000563018', 'lastCheck': '5.4', 'valid': True}} >Thread-135683::DEBUG::2014-10-29 11:10:41,238::task::1191::Storage.TaskManager.Task::(prepare) Task=`3791451c-21bb-489c-ae12-682406e77ad7`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000761938', 'lastCheck': '5.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0014077', 'lastCheck': '5.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00200537', 'lastCheck': '5.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000563018', 'lastCheck': '5.4', 'valid': True}} >Thread-135683::DEBUG::2014-10-29 11:10:41,239::task::595::Storage.TaskManager.Task::(_updateState) Task=`3791451c-21bb-489c-ae12-682406e77ad7`::moving from state preparing -> state finished >Thread-135683::DEBUG::2014-10-29 11:10:41,239::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135683::DEBUG::2014-10-29 11:10:41,239::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135683::DEBUG::2014-10-29 11:10:41,239::task::993::Storage.TaskManager.Task::(_decref) Task=`3791451c-21bb-489c-ae12-682406e77ad7`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:42,687::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:42,689::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135684::DEBUG::2014-10-29 11:10:42,693::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:42,696::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:42,698::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135685::DEBUG::2014-10-29 11:10:42,701::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135685::DEBUG::2014-10-29 11:10:42,703::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:44,236::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:44,238::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:44,239::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:45,720::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:45,724::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135686::DEBUG::2014-10-29 11:10:45,727::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:45,731::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:45,732::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135687::DEBUG::2014-10-29 11:10:45,736::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135687::DEBUG::2014-10-29 11:10:45,738::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:10:45,796::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:45,796::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:45,796::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:45,797::__init__::232::IOProcess::(_processLogs) (199975) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:45,798::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199975) Queuing response >Thread-179::DEBUG::2014-10-29 11:10:45,800::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:10:45,821::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000545165 s, 682 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:10:45,822::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:45,822::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:45,823::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:45,823::__init__::232::IOProcess::(_processLogs) (199976) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:45,824::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199976) Queuing response >Thread-178::DEBUG::2014-10-29 11:10:45,826::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:10:45,827::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:45,842::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:45,845::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-33::DEBUG::2014-10-29 11:10:45,847::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:10:45,848::__init__::232::IOProcess::(_processLogs) (199977) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:10:45,849::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00134909 s, 377 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:10:45,871::__init__::232::IOProcess::(_processLogs) (199977) Queuing response >Thread-33::DEBUG::2014-10-29 11:10:45,874::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00160916 s, 303 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:10:45,875::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:45,876::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:45,876::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:45,877::__init__::232::IOProcess::(_processLogs) (199978) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:45,878::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199978) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:45,880::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:45,880::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:45,880::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:45,881::__init__::232::IOProcess::(_processLogs) (199979) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:45,881::__init__::232::IOProcess::(_processLogs) (199979) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:45,884::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-10269::DEBUG::2014-10-29 11:10:45,885::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:10:45,887::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:45,904::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-10269::DEBUG::2014-10-29 11:10:45,906::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000508151 s, 988 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:10:45,906::__init__::232::IOProcess::(_processLogs) (199980) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:45,911::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199980) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:45,913::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:45,913::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:45,914::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:45,914::__init__::232::IOProcess::(_processLogs) (199981) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:45,915::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199981) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:45,917::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:45,917::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:45,917::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:45,918::__init__::232::IOProcess::(_processLogs) (199982) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:45,918::__init__::232::IOProcess::(_processLogs) (199982) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:45,922::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:45,922::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:45,922::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:45,923::__init__::232::IOProcess::(_processLogs) (199983) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:45,924::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199983) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:45,924::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:45,926::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:45,926::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:45,927::__init__::232::IOProcess::(_processLogs) (199984) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:45,927::__init__::232::IOProcess::(_processLogs) (199984) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:45,927::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:45,928::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:45,929::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:45,929::__init__::232::IOProcess::(_processLogs) (199985) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:45,929::__init__::232::IOProcess::(_processLogs) (199985) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:45,930::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:45,931::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:45,932::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:45,932::__init__::232::IOProcess::(_processLogs) (199986) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:45,932::__init__::232::IOProcess::(_processLogs) (199986) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:45,932::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:45,933::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:45,934::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:45,935::__init__::232::IOProcess::(_processLogs) (199987) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:45,936::__init__::232::IOProcess::(_processLogs) (199987) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:45,936::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:45,937::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:45,938::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:45,938::__init__::232::IOProcess::(_processLogs) (199988) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:45,939::__init__::232::IOProcess::(_processLogs) (199988) Queuing response >Detector thread::DEBUG::2014-10-29 11:10:46,935::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54043 >Detector thread::DEBUG::2014-10-29 11:10:46,950::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54043 >Detector thread::DEBUG::2014-10-29 11:10:46,950::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54043 >Detector thread::DEBUG::2014-10-29 11:10:46,951::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54043) >Thread-22::DEBUG::2014-10-29 11:10:46,959::task::595::Storage.TaskManager.Task::(_updateState) Task=`4d536105-09d0-411a-9df2-345f5382309f`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:10:46,961::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:10:46,965::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:46,971::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:46,973::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:46,974::__init__::232::IOProcess::(_processLogs) (199989) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:10:46,976::__init__::232::IOProcess::(_processLogs) (199989) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:46,978::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:46,980::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:46,981::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:46,983::__init__::232::IOProcess::(_processLogs) (199990) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:10:46,984::__init__::232::IOProcess::(_processLogs) (199990) Queuing response >Thread-22::INFO::2014-10-29 11:10:46,990::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010863616', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:10:46,994::task::1191::Storage.TaskManager.Task::(prepare) Task=`4d536105-09d0-411a-9df2-345f5382309f`::finished: {'truesize': '6010863616', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:10:46,997::task::595::Storage.TaskManager.Task::(_updateState) Task=`4d536105-09d0-411a-9df2-345f5382309f`::moving from state preparing -> state finished >Thread-135688::DEBUG::2014-10-29 11:10:46,998::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-22::DEBUG::2014-10-29 11:10:47,000::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-10-29 11:10:47,003::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135688::DEBUG::2014-10-29 11:10:47,004::task::595::Storage.TaskManager.Task::(_updateState) Task=`599bc5f8-9038-4dff-a348-34c6d92465a1`::moving from state init -> state preparing >Thread-22::DEBUG::2014-10-29 11:10:47,007::task::993::Storage.TaskManager.Task::(_decref) Task=`4d536105-09d0-411a-9df2-345f5382309f`::ref 0 aborting False >Thread-135688::INFO::2014-10-29 11:10:47,007::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135688::DEBUG::2014-10-29 11:10:47,025::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:10:47,030::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:47,032::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:47,034::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:47,037::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199991) Got request for method 'glob' >Thread-135688::DEBUG::2014-10-29 11:10:47,037::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:10:47,040::__init__::232::IOProcess::(_processLogs) (199991) Queuing response >Thread-135688::DEBUG::2014-10-29 11:10:47,041::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135688::INFO::2014-10-29 11:10:47,045::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135688::DEBUG::2014-10-29 11:10:47,046::task::1191::Storage.TaskManager.Task::(prepare) Task=`599bc5f8-9038-4dff-a348-34c6d92465a1`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135688::DEBUG::2014-10-29 11:10:47,046::task::595::Storage.TaskManager.Task::(_updateState) Task=`599bc5f8-9038-4dff-a348-34c6d92465a1`::moving from state preparing -> state finished >Thread-135688::DEBUG::2014-10-29 11:10:47,046::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135688::DEBUG::2014-10-29 11:10:47,047::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135688::DEBUG::2014-10-29 11:10:47,047::task::993::Storage.TaskManager.Task::(_decref) Task=`599bc5f8-9038-4dff-a348-34c6d92465a1`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:10:47,092::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54044 >Thread-22::DEBUG::2014-10-29 11:10:47,092::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Detector thread::DEBUG::2014-10-29 11:10:47,094::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54044 >Detector thread::DEBUG::2014-10-29 11:10:47,095::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54044 >Detector thread::DEBUG::2014-10-29 11:10:47,095::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54044) >Thread-135689::DEBUG::2014-10-29 11:10:47,132::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135689::DEBUG::2014-10-29 11:10:47,132::task::595::Storage.TaskManager.Task::(_updateState) Task=`45ce8edb-99cd-40e2-b70d-045e1498d2bf`::moving from state init -> state preparing >Thread-135689::INFO::2014-10-29 11:10:47,133::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135689::DEBUG::2014-10-29 11:10:47,133::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135689::DEBUG::2014-10-29 11:10:47,133::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135689::DEBUG::2014-10-29 11:10:47,134::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135689::DEBUG::2014-10-29 11:10:47,134::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135689::DEBUG::2014-10-29 11:10:47,134::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135689::DEBUG::2014-10-29 11:10:47,135::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135689::DEBUG::2014-10-29 11:10:47,211::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135689::DEBUG::2014-10-29 11:10:47,211::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135689::DEBUG::2014-10-29 11:10:47,381::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135689::DEBUG::2014-10-29 11:10:47,382::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135689::DEBUG::2014-10-29 11:10:47,383::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135689::DEBUG::2014-10-29 11:10:47,383::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135689::DEBUG::2014-10-29 11:10:47,383::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135689::DEBUG::2014-10-29 11:10:47,384::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135689::DEBUG::2014-10-29 11:10:47,384::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135689::DEBUG::2014-10-29 11:10:47,384::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:10:47,391::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:47,392::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:47,393::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:47,393::__init__::232::IOProcess::(_processLogs) (199992) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:47,394::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199992) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:47,396::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:47,397::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:47,397::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:47,397::__init__::232::IOProcess::(_processLogs) (199993) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:47,397::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:47,398::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:47,398::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:47,398::__init__::232::IOProcess::(_processLogs) (199994) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:47,398::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:47,399::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:47,399::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:47,399::__init__::232::IOProcess::(_processLogs) (199995) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:47,400::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199993) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:47,402::__init__::232::IOProcess::(_processLogs) (199994) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:47,404::__init__::232::IOProcess::(_processLogs) (199995) Queuing response >Thread-135689::DEBUG::2014-10-29 11:10:47,411::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:10:47,413::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:47,413::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:47,413::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:47,414::__init__::232::IOProcess::(_processLogs) (199996) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:10:47,414::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199996) Queuing response >Thread-135689::DEBUG::2014-10-29 11:10:47,415::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:10:47,416::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:47,416::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:47,416::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:47,417::__init__::232::IOProcess::(_processLogs) (199997) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:10:47,418::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199997) Queuing response >Thread-135689::DEBUG::2014-10-29 11:10:47,418::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:10:47,420::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:47,421::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:47,421::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:47,422::__init__::232::IOProcess::(_processLogs) (199998) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:47,422::__init__::232::IOProcess::(_processLogs) (199998) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:47,422::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:47,423::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:47,423::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:47,423::__init__::232::IOProcess::(_processLogs) (199999) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:47,424::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(199999) Queuing response >Thread-135689::DEBUG::2014-10-29 11:10:47,424::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-135689::INFO::2014-10-29 11:10:47,425::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135689::INFO::2014-10-29 11:10:47,425::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135689::INFO::2014-10-29 11:10:47,426::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:10:47,427::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:47,427::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:47,427::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:47,427::__init__::232::IOProcess::(_processLogs) (200000) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:10:47,429::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200000) Queuing response >Thread-135689::DEBUG::2014-10-29 11:10:47,429::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135689::DEBUG::2014-10-29 11:10:47,431::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`53191f4e-5143-47e3-aaa9-b0fcc3f6f359`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135689::DEBUG::2014-10-29 11:10:47,431::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135689::DEBUG::2014-10-29 11:10:47,432::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135689::DEBUG::2014-10-29 11:10:47,432::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`53191f4e-5143-47e3-aaa9-b0fcc3f6f359`::Granted request >Thread-135689::DEBUG::2014-10-29 11:10:47,433::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`45ce8edb-99cd-40e2-b70d-045e1498d2bf`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135689::DEBUG::2014-10-29 11:10:47,433::task::993::Storage.TaskManager.Task::(_decref) Task=`45ce8edb-99cd-40e2-b70d-045e1498d2bf`::ref 1 aborting False >Thread-135689::INFO::2014-10-29 11:10:47,436::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135689::DEBUG::2014-10-29 11:10:47,436::task::1191::Storage.TaskManager.Task::(prepare) Task=`45ce8edb-99cd-40e2-b70d-045e1498d2bf`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135689::DEBUG::2014-10-29 11:10:47,436::task::595::Storage.TaskManager.Task::(_updateState) Task=`45ce8edb-99cd-40e2-b70d-045e1498d2bf`::moving from state preparing -> state finished >Thread-135689::DEBUG::2014-10-29 11:10:47,437::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135689::DEBUG::2014-10-29 11:10:47,437::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135689::DEBUG::2014-10-29 11:10:47,437::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135689::DEBUG::2014-10-29 11:10:47,438::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135689::DEBUG::2014-10-29 11:10:47,438::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135689::DEBUG::2014-10-29 11:10:47,438::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135689::DEBUG::2014-10-29 11:10:47,438::task::993::Storage.TaskManager.Task::(_decref) Task=`45ce8edb-99cd-40e2-b70d-045e1498d2bf`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:10:47,462::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54045 >Detector thread::DEBUG::2014-10-29 11:10:47,462::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54045 >Detector thread::DEBUG::2014-10-29 11:10:47,462::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54045 >Detector thread::DEBUG::2014-10-29 11:10:47,463::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54045) >Thread-135694::DEBUG::2014-10-29 11:10:47,502::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135694::DEBUG::2014-10-29 11:10:47,502::task::595::Storage.TaskManager.Task::(_updateState) Task=`97cc4392-f0b6-46c7-9127-eaef979f7560`::moving from state init -> state preparing >Thread-135694::INFO::2014-10-29 11:10:47,503::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135694::INFO::2014-10-29 11:10:47,503::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00134909', 'lastCheck': '1.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00160916', 'lastCheck': '1.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000545165', 'lastCheck': '1.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000508151', 'lastCheck': '1.6', 'valid': True}} >Thread-135694::DEBUG::2014-10-29 11:10:47,504::task::1191::Storage.TaskManager.Task::(prepare) Task=`97cc4392-f0b6-46c7-9127-eaef979f7560`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00134909', 'lastCheck': '1.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00160916', 'lastCheck': '1.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000545165', 'lastCheck': '1.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000508151', 'lastCheck': '1.6', 'valid': True}} >Thread-135694::DEBUG::2014-10-29 11:10:47,504::task::595::Storage.TaskManager.Task::(_updateState) Task=`97cc4392-f0b6-46c7-9127-eaef979f7560`::moving from state preparing -> state finished >Thread-135694::DEBUG::2014-10-29 11:10:47,504::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135694::DEBUG::2014-10-29 11:10:47,505::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135694::DEBUG::2014-10-29 11:10:47,505::task::993::Storage.TaskManager.Task::(_decref) Task=`97cc4392-f0b6-46c7-9127-eaef979f7560`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:48,752::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:48,754::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135695::DEBUG::2014-10-29 11:10:48,758::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:48,760::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:48,762::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135696::DEBUG::2014-10-29 11:10:48,765::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135696::DEBUG::2014-10-29 11:10:48,768::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:49,246::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:49,247::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:49,250::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:10:49,435::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54046 >Detector thread::DEBUG::2014-10-29 11:10:49,435::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54046 >Detector thread::DEBUG::2014-10-29 11:10:49,436::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54046 >Detector thread::DEBUG::2014-10-29 11:10:49,436::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54046) >Thread-135697::DEBUG::2014-10-29 11:10:49,475::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135697::DEBUG::2014-10-29 11:10:49,476::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135697::DEBUG::2014-10-29 11:10:49,477::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.94', 'elapsedTime': '513681', 'displayType': 'vnc', 'cpuSys': '0.80', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '50418869', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57596', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '45813.43'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.38', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:10:50,106::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54048 >Detector thread::DEBUG::2014-10-29 11:10:50,107::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54048 >Detector thread::DEBUG::2014-10-29 11:10:50,107::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54048 >Detector thread::DEBUG::2014-10-29 11:10:50,108::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54048) >Thread-135698::DEBUG::2014-10-29 11:10:50,147::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135698::DEBUG::2014-10-29 11:10:50,148::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135698::DEBUG::2014-10-29 11:10:50,166::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135698::DEBUG::2014-10-29 11:10:50,213::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '119', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '19', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:10:50,296::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54049 >Detector thread::DEBUG::2014-10-29 11:10:50,296::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54049 >Detector thread::DEBUG::2014-10-29 11:10:50,297::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54049 >Detector thread::DEBUG::2014-10-29 11:10:50,298::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54049) >Thread-135699::DEBUG::2014-10-29 11:10:50,337::task::595::Storage.TaskManager.Task::(_updateState) Task=`746f9db3-aca2-4c73-bfb1-e96d6b03d046`::moving from state init -> state preparing >Thread-135699::INFO::2014-10-29 11:10:50,337::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135699::INFO::2014-10-29 11:10:50,338::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00134909', 'lastCheck': '4.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00160916', 'lastCheck': '4.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000545165', 'lastCheck': '4.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000508151', 'lastCheck': '4.4', 'valid': True}} >Thread-135699::DEBUG::2014-10-29 11:10:50,338::task::1191::Storage.TaskManager.Task::(prepare) Task=`746f9db3-aca2-4c73-bfb1-e96d6b03d046`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00134909', 'lastCheck': '4.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00160916', 'lastCheck': '4.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000545165', 'lastCheck': '4.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000508151', 'lastCheck': '4.4', 'valid': True}} >Thread-135699::DEBUG::2014-10-29 11:10:50,339::task::595::Storage.TaskManager.Task::(_updateState) Task=`746f9db3-aca2-4c73-bfb1-e96d6b03d046`::moving from state preparing -> state finished >Thread-135699::DEBUG::2014-10-29 11:10:50,339::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135699::DEBUG::2014-10-29 11:10:50,339::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135699::DEBUG::2014-10-29 11:10:50,339::task::993::Storage.TaskManager.Task::(_decref) Task=`746f9db3-aca2-4c73-bfb1-e96d6b03d046`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:51,780::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:51,782::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135700::DEBUG::2014-10-29 11:10:51,786::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:51,790::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:51,792::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135701::DEBUG::2014-10-29 11:10:51,795::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135701::DEBUG::2014-10-29 11:10:51,797::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:54,257::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:54,259::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:54,260::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:54,810::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:54,813::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135702::DEBUG::2014-10-29 11:10:54,816::task::595::Storage.TaskManager.Task::(_updateState) Task=`04511841-ccb6-4f15-8512-0b1f1777be60`::moving from state init -> state preparing >Thread-135702::INFO::2014-10-29 11:10:54,816::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135702::INFO::2014-10-29 11:10:54,817::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00134909', 'lastCheck': '8.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00160916', 'lastCheck': '8.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000545165', 'lastCheck': '8.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000508151', 'lastCheck': '8.9', 'valid': True}} >Thread-135702::DEBUG::2014-10-29 11:10:54,817::task::1191::Storage.TaskManager.Task::(prepare) Task=`04511841-ccb6-4f15-8512-0b1f1777be60`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00134909', 'lastCheck': '8.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00160916', 'lastCheck': '8.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000545165', 'lastCheck': '8.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000508151', 'lastCheck': '8.9', 'valid': True}} >Thread-135702::DEBUG::2014-10-29 11:10:54,818::task::595::Storage.TaskManager.Task::(_updateState) Task=`04511841-ccb6-4f15-8512-0b1f1777be60`::moving from state preparing -> state finished >Thread-135702::DEBUG::2014-10-29 11:10:54,818::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135702::DEBUG::2014-10-29 11:10:54,818::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135702::DEBUG::2014-10-29 11:10:54,818::task::993::Storage.TaskManager.Task::(_decref) Task=`04511841-ccb6-4f15-8512-0b1f1777be60`::ref 0 aborting False >Thread-135702::DEBUG::2014-10-29 11:10:54,840::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:54,862::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:54,864::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135703::DEBUG::2014-10-29 11:10:54,868::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135703::DEBUG::2014-10-29 11:10:54,870::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:10:55,883::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:55,884::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:55,884::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:55,884::__init__::232::IOProcess::(_processLogs) (200001) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:55,886::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200001) Queuing response >Thread-179::DEBUG::2014-10-29 11:10:55,888::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:10:55,906::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000440641 s, 844 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:10:55,907::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:55,908::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:55,908::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:55,909::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200002) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:55,911::__init__::232::IOProcess::(_processLogs) (200002) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:55,922::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:55,923::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:55,923::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:55,923::__init__::232::IOProcess::(_processLogs) (200003) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:55,925::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200003) Queuing response >Thread-10269::DEBUG::2014-10-29 11:10:55,926::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:10:55,947::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000432392 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:10:55,947::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:55,949::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:55,950::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:55,950::__init__::232::IOProcess::(_processLogs) (200004) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:55,952::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200004) Queuing response >Thread-178::DEBUG::2014-10-29 11:10:55,953::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:10:55,953::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:55,970::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:55,972::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-178::DEBUG::2014-10-29 11:10:55,972::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000613322 s, 828 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:10:55,974::__init__::232::IOProcess::(_processLogs) (200005) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:55,977::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200005) Queuing response >Thread-33::DEBUG::2014-10-29 11:10:55,979::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:10:55,980::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:55,996::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:55,996::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:55,996::__init__::232::IOProcess::(_processLogs) (200006) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:55,998::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200006) Queuing response >Thread-33::DEBUG::2014-10-29 11:10:56,003::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000587339 s, 829 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:10:56,004::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:56,006::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:56,006::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:56,006::__init__::232::IOProcess::(_processLogs) (200007) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:56,008::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200007) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:56,009::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:56,011::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:56,012::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:56,013::__init__::232::IOProcess::(_processLogs) (200008) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:10:56,013::__init__::232::IOProcess::(_processLogs) (200008) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:56,013::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:56,014::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:56,014::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:56,015::__init__::232::IOProcess::(_processLogs) (200009) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:56,016::__init__::232::IOProcess::(_processLogs) (200009) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:56,016::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:56,017::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:56,018::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:56,018::__init__::232::IOProcess::(_processLogs) (200010) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:56,018::__init__::232::IOProcess::(_processLogs) (200010) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:56,019::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:56,020::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:56,021::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:56,021::__init__::232::IOProcess::(_processLogs) (200011) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:56,021::__init__::232::IOProcess::(_processLogs) (200011) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:56,021::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:56,022::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:56,023::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:56,023::__init__::232::IOProcess::(_processLogs) (200012) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:56,024::__init__::232::IOProcess::(_processLogs) (200012) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:56,024::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:56,025::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:56,026::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:56,027::__init__::232::IOProcess::(_processLogs) (200013) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:56,027::__init__::232::IOProcess::(_processLogs) (200013) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:56,027::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:56,028::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:56,030::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:56,030::__init__::232::IOProcess::(_processLogs) (200014) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:56,030::__init__::232::IOProcess::(_processLogs) (200014) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:57,918::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:57,921::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135704::DEBUG::2014-10-29 11:10:57,925::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:10:57,928::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:10:57,930::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135705::DEBUG::2014-10-29 11:10:57,933::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135705::DEBUG::2014-10-29 11:10:57,936::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:10:59,165::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54051 >Detector thread::DEBUG::2014-10-29 11:10:59,166::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54051 >Detector thread::DEBUG::2014-10-29 11:10:59,166::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54051 >Detector thread::DEBUG::2014-10-29 11:10:59,166::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54051) >Thread-135706::DEBUG::2014-10-29 11:10:59,206::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135706::DEBUG::2014-10-29 11:10:59,206::task::595::Storage.TaskManager.Task::(_updateState) Task=`25107cfb-0ee6-4092-9e97-c052cbcae8eb`::moving from state init -> state preparing >Thread-135706::INFO::2014-10-29 11:10:59,207::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135706::DEBUG::2014-10-29 11:10:59,210::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:10:59,211::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:59,211::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:59,211::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:59,211::__init__::232::IOProcess::(_processLogs) (200015) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:59,212::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200015) Queuing response >Thread-135706::DEBUG::2014-10-29 11:10:59,213::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135706::DEBUG::2014-10-29 11:10:59,214::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135706::INFO::2014-10-29 11:10:59,214::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135706::DEBUG::2014-10-29 11:10:59,214::task::1191::Storage.TaskManager.Task::(prepare) Task=`25107cfb-0ee6-4092-9e97-c052cbcae8eb`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135706::DEBUG::2014-10-29 11:10:59,215::task::595::Storage.TaskManager.Task::(_updateState) Task=`25107cfb-0ee6-4092-9e97-c052cbcae8eb`::moving from state preparing -> state finished >Thread-135706::DEBUG::2014-10-29 11:10:59,215::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135706::DEBUG::2014-10-29 11:10:59,215::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135706::DEBUG::2014-10-29 11:10:59,215::task::993::Storage.TaskManager.Task::(_decref) Task=`25107cfb-0ee6-4092-9e97-c052cbcae8eb`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:10:59,259::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54052 >Detector thread::DEBUG::2014-10-29 11:10:59,260::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54052 >Detector thread::DEBUG::2014-10-29 11:10:59,265::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54052 >Detector thread::DEBUG::2014-10-29 11:10:59,265::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54052) >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:59,270::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:59,272::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:10:59,273::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:10:59,281::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54053 >Detector thread::DEBUG::2014-10-29 11:10:59,282::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54053 >Detector thread::DEBUG::2014-10-29 11:10:59,282::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54053 >Detector thread::DEBUG::2014-10-29 11:10:59,283::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54053) >Thread-135707::DEBUG::2014-10-29 11:10:59,300::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135707::DEBUG::2014-10-29 11:10:59,300::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b5b82f6-1287-4b8e-afe2-bddedb57d1af`::moving from state init -> state preparing >Thread-135707::INFO::2014-10-29 11:10:59,301::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135707::DEBUG::2014-10-29 11:10:59,301::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135707::DEBUG::2014-10-29 11:10:59,301::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135707::DEBUG::2014-10-29 11:10:59,302::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135707::DEBUG::2014-10-29 11:10:59,302::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135707::DEBUG::2014-10-29 11:10:59,302::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135707::DEBUG::2014-10-29 11:10:59,303::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135708::DEBUG::2014-10-29 11:10:59,322::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135708::DEBUG::2014-10-29 11:10:59,326::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135708::DEBUG::2014-10-29 11:10:59,344::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135708::DEBUG::2014-10-29 11:10:59,397::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '1', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '1', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-135707::DEBUG::2014-10-29 11:10:59,409::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135707::DEBUG::2014-10-29 11:10:59,409::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135707::DEBUG::2014-10-29 11:10:59,580::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135707::DEBUG::2014-10-29 11:10:59,582::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135707::DEBUG::2014-10-29 11:10:59,582::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135707::DEBUG::2014-10-29 11:10:59,583::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135707::DEBUG::2014-10-29 11:10:59,583::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135707::DEBUG::2014-10-29 11:10:59,584::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135707::DEBUG::2014-10-29 11:10:59,584::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135707::DEBUG::2014-10-29 11:10:59,584::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:10:59,590::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:59,590::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:59,591::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:59,591::__init__::232::IOProcess::(_processLogs) (200016) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:59,592::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:59,593::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:59,597::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:59,597::__init__::232::IOProcess::(_processLogs) (200017) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:59,597::__init__::232::IOProcess::(_processLogs) (200016) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:59,598::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200017) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:59,602::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:59,603::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:59,604::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:59,606::__init__::232::IOProcess::(_processLogs) (200018) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:59,610::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200018) Queuing response >Thread-135707::DEBUG::2014-10-29 11:10:59,612::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:10:59,614::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:59,614::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:59,615::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:59,615::__init__::232::IOProcess::(_processLogs) (200019) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:59,616::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200019) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:59,617::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:59,617::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:59,617::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:59,618::__init__::232::IOProcess::(_processLogs) (200020) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:10:59,619::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200020) Queuing response >Thread-135707::DEBUG::2014-10-29 11:10:59,619::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:10:59,620::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:59,620::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:59,621::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:59,621::__init__::232::IOProcess::(_processLogs) (200021) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:10:59,621::__init__::232::IOProcess::(_processLogs) (200021) Queuing response >Thread-135707::DEBUG::2014-10-29 11:10:59,622::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:10:59,623::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:59,624::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:59,624::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:59,625::__init__::232::IOProcess::(_processLogs) (200022) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:10:59,625::__init__::232::IOProcess::(_processLogs) (200022) Queuing response >Thread-17::DEBUG::2014-10-29 11:10:59,626::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:59,626::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:59,626::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:10:59,627::__init__::232::IOProcess::(_processLogs) (200023) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:10:59,627::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200023) Queuing response >Thread-135707::DEBUG::2014-10-29 11:10:59,628::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-135707::INFO::2014-10-29 11:10:59,628::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135707::INFO::2014-10-29 11:10:59,628::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135707::INFO::2014-10-29 11:10:59,629::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:10:59,629::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:10:59,630::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:10:59,631::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-135707::DEBUG::2014-10-29 11:10:59,632::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135707::DEBUG::2014-10-29 11:10:59,634::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`ab5deb5b-42a5-442f-9969-965d0eb059bf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135707::DEBUG::2014-10-29 11:10:59,635::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135707::DEBUG::2014-10-29 11:10:59,635::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135707::DEBUG::2014-10-29 11:10:59,636::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`ab5deb5b-42a5-442f-9969-965d0eb059bf`::Granted request >Thread-135707::DEBUG::2014-10-29 11:10:59,637::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0b5b82f6-1287-4b8e-afe2-bddedb57d1af`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135707::DEBUG::2014-10-29 11:10:59,637::task::993::Storage.TaskManager.Task::(_decref) Task=`0b5b82f6-1287-4b8e-afe2-bddedb57d1af`::ref 1 aborting False >Thread-17::DEBUG::2014-10-29 11:10:59,633::__init__::232::IOProcess::(_processLogs) (200024) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:10:59,640::__init__::232::IOProcess::(_processLogs) (200024) Queuing response >Thread-135707::INFO::2014-10-29 11:10:59,641::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135707::DEBUG::2014-10-29 11:10:59,642::task::1191::Storage.TaskManager.Task::(prepare) Task=`0b5b82f6-1287-4b8e-afe2-bddedb57d1af`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135707::DEBUG::2014-10-29 11:10:59,642::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b5b82f6-1287-4b8e-afe2-bddedb57d1af`::moving from state preparing -> state finished >Thread-135707::DEBUG::2014-10-29 11:10:59,642::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135707::DEBUG::2014-10-29 11:10:59,643::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135707::DEBUG::2014-10-29 11:10:59,643::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135707::DEBUG::2014-10-29 11:10:59,643::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135707::DEBUG::2014-10-29 11:10:59,644::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135707::DEBUG::2014-10-29 11:10:59,644::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135707::DEBUG::2014-10-29 11:10:59,644::task::993::Storage.TaskManager.Task::(_decref) Task=`0b5b82f6-1287-4b8e-afe2-bddedb57d1af`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:10:59,646::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54054 >Detector thread::DEBUG::2014-10-29 11:10:59,647::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54054 >Detector thread::DEBUG::2014-10-29 11:10:59,648::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54054 >Detector thread::DEBUG::2014-10-29 11:10:59,648::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54054) >Detector thread::DEBUG::2014-10-29 11:10:59,669::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54055 >Detector thread::DEBUG::2014-10-29 11:10:59,669::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54055 >Detector thread::DEBUG::2014-10-29 11:10:59,670::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54055 >Detector thread::DEBUG::2014-10-29 11:10:59,670::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54055) >Thread-135713::DEBUG::2014-10-29 11:10:59,687::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135713::DEBUG::2014-10-29 11:10:59,688::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135713::DEBUG::2014-10-29 11:10:59,689::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.94', 'elapsedTime': '513692', 'displayType': 'vnc', 'cpuSys': '0.80', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '50418869', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57596', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '45813.43'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.59', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-135714::DEBUG::2014-10-29 11:10:59,713::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135714::DEBUG::2014-10-29 11:10:59,714::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d529847-7eab-4b1f-9fee-ba620067d295`::moving from state init -> state preparing >Thread-135714::INFO::2014-10-29 11:10:59,714::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135714::INFO::2014-10-29 11:10:59,715::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000613322', 'lastCheck': '3.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000587339', 'lastCheck': '3.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440641', 'lastCheck': '3.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000432392', 'lastCheck': '3.7', 'valid': True}} >Thread-135714::DEBUG::2014-10-29 11:10:59,715::task::1191::Storage.TaskManager.Task::(prepare) Task=`1d529847-7eab-4b1f-9fee-ba620067d295`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000613322', 'lastCheck': '3.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000587339', 'lastCheck': '3.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440641', 'lastCheck': '3.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000432392', 'lastCheck': '3.7', 'valid': True}} >Thread-135714::DEBUG::2014-10-29 11:10:59,715::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d529847-7eab-4b1f-9fee-ba620067d295`::moving from state preparing -> state finished >Thread-135714::DEBUG::2014-10-29 11:10:59,715::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135714::DEBUG::2014-10-29 11:10:59,716::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135714::DEBUG::2014-10-29 11:10:59,716::task::993::Storage.TaskManager.Task::(_decref) Task=`1d529847-7eab-4b1f-9fee-ba620067d295`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:11:00,399::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54057 >Detector thread::DEBUG::2014-10-29 11:11:00,400::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54057 >Detector thread::DEBUG::2014-10-29 11:11:00,400::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54057 >Detector thread::DEBUG::2014-10-29 11:11:00,401::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54057) >Thread-135715::DEBUG::2014-10-29 11:11:00,441::task::595::Storage.TaskManager.Task::(_updateState) Task=`f070d27f-424b-4476-b2c6-52ca719376ab`::moving from state init -> state preparing >Thread-135715::INFO::2014-10-29 11:11:00,441::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135715::INFO::2014-10-29 11:11:00,442::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000613322', 'lastCheck': '4.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000587339', 'lastCheck': '4.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440641', 'lastCheck': '4.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000432392', 'lastCheck': '4.4', 'valid': True}} >Thread-135715::DEBUG::2014-10-29 11:11:00,442::task::1191::Storage.TaskManager.Task::(prepare) Task=`f070d27f-424b-4476-b2c6-52ca719376ab`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000613322', 'lastCheck': '4.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000587339', 'lastCheck': '4.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440641', 'lastCheck': '4.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000432392', 'lastCheck': '4.4', 'valid': True}} >Thread-135715::DEBUG::2014-10-29 11:11:00,442::task::595::Storage.TaskManager.Task::(_updateState) Task=`f070d27f-424b-4476-b2c6-52ca719376ab`::moving from state preparing -> state finished >Thread-135715::DEBUG::2014-10-29 11:11:00,442::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135715::DEBUG::2014-10-29 11:11:00,443::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135715::DEBUG::2014-10-29 11:11:00,443::task::993::Storage.TaskManager.Task::(_decref) Task=`f070d27f-424b-4476-b2c6-52ca719376ab`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:01,809::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:01,811::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135716::DEBUG::2014-10-29 11:11:01,815::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:01,817::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:01,819::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135717::DEBUG::2014-10-29 11:11:01,822::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135717::DEBUG::2014-10-29 11:11:01,825::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:11:02,119::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >VM Channels Listener::DEBUG::2014-10-29 11:11:03,430::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:04,281::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:04,283::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:04,284::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:04,838::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:04,840::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135718::DEBUG::2014-10-29 11:11:04,844::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:04,847::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:04,849::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135719::DEBUG::2014-10-29 11:11:04,852::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135719::DEBUG::2014-10-29 11:11:04,854::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:11:05,914::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:05,914::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:05,915::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:05,915::__init__::232::IOProcess::(_processLogs) (200025) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:05,915::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200025) Queuing response >Thread-179::DEBUG::2014-10-29 11:11:05,917::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:11:05,934::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000502963 s, 740 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:11:05,936::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:05,936::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:05,937::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:05,937::__init__::232::IOProcess::(_processLogs) (200026) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:05,937::__init__::232::IOProcess::(_processLogs) (200026) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:06,004::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:06,004::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:06,004::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:06,005::__init__::232::IOProcess::(_processLogs) (200027) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:06,006::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200027) Queuing response >Thread-10269::DEBUG::2014-10-29 11:11:06,007::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:11:06,025::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000485835 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:11:06,027::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:06,028::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:06,031::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:06,034::__init__::232::IOProcess::(_processLogs) (200028) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:06,034::__init__::232::IOProcess::(_processLogs) (200028) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:06,035::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:06,035::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:06,035::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:06,036::__init__::232::IOProcess::(_processLogs) (200029) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:06,037::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200029) Queuing response >Thread-178::DEBUG::2014-10-29 11:11:06,038::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:11:06,039::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:06,053::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:06,054::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:06,054::__init__::232::IOProcess::(_processLogs) (200030) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:06,055::__init__::232::IOProcess::(_processLogs) (200030) Queuing response >Thread-33::DEBUG::2014-10-29 11:11:06,059::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:11:06,060::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000439314 s, 1.2 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-10-29 11:11:06,080::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000661971 s, 736 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:11:06,081::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:06,081::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:06,082::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:06,082::__init__::232::IOProcess::(_processLogs) (200031) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:06,082::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200031) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:06,082::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:06,083::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:06,083::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:06,083::__init__::232::IOProcess::(_processLogs) (200032) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:06,084::__init__::232::IOProcess::(_processLogs) (200032) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:06,089::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:06,089::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:06,089::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:06,090::__init__::232::IOProcess::(_processLogs) (200033) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:06,091::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200033) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:06,091::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:06,091::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:06,092::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:06,092::__init__::232::IOProcess::(_processLogs) (200034) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:06,093::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200034) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:06,093::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:06,095::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:06,095::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:06,095::__init__::232::IOProcess::(_processLogs) (200035) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:06,096::__init__::232::IOProcess::(_processLogs) (200035) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:06,096::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:06,097::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:06,097::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:06,098::__init__::232::IOProcess::(_processLogs) (200036) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:06,098::__init__::232::IOProcess::(_processLogs) (200036) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:06,098::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:06,099::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:06,100::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:06,101::__init__::232::IOProcess::(_processLogs) (200037) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:06,101::__init__::232::IOProcess::(_processLogs) (200037) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:06,102::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:06,102::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:06,102::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:06,103::__init__::232::IOProcess::(_processLogs) (200038) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:06,103::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200038) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:07,870::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:07,872::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135720::DEBUG::2014-10-29 11:11:07,876::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:07,879::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:07,881::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135721::DEBUG::2014-10-29 11:11:07,884::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135721::DEBUG::2014-10-29 11:11:07,886::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:09,289::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:09,291::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:09,292::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:11:09,463::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54058 >Detector thread::DEBUG::2014-10-29 11:11:09,463::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54058 >Detector thread::DEBUG::2014-10-29 11:11:09,464::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54058 >Detector thread::DEBUG::2014-10-29 11:11:09,464::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54058) >Thread-135722::DEBUG::2014-10-29 11:11:09,503::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135722::DEBUG::2014-10-29 11:11:09,504::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135722::DEBUG::2014-10-29 11:11:09,523::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135722::DEBUG::2014-10-29 11:11:09,570::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '184', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '84', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:11:09,855::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54059 >Detector thread::DEBUG::2014-10-29 11:11:09,856::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54059 >Detector thread::DEBUG::2014-10-29 11:11:09,856::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54059 >Detector thread::DEBUG::2014-10-29 11:11:09,857::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54059) >Thread-135723::DEBUG::2014-10-29 11:11:09,897::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135723::DEBUG::2014-10-29 11:11:09,898::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135723::DEBUG::2014-10-29 11:11:09,899::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.74', 'elapsedTime': '513702', 'displayType': 'vnc', 'cpuSys': '1.06', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '50418869', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57596', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '45813.43'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.78', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:11:10,318::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54062 >Detector thread::DEBUG::2014-10-29 11:11:10,319::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54062 >Detector thread::DEBUG::2014-10-29 11:11:10,319::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54062 >Detector thread::DEBUG::2014-10-29 11:11:10,319::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54062) >Thread-135724::DEBUG::2014-10-29 11:11:10,359::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135724::DEBUG::2014-10-29 11:11:10,360::task::595::Storage.TaskManager.Task::(_updateState) Task=`b01d4370-edbe-4f64-8b62-239c9d187815`::moving from state init -> state preparing >Thread-135724::INFO::2014-10-29 11:11:10,360::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135724::DEBUG::2014-10-29 11:11:10,378::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:11:10,379::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:10,379::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:10,379::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:10,380::__init__::232::IOProcess::(_processLogs) (200039) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:10,381::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200039) Queuing response >Thread-135724::DEBUG::2014-10-29 11:11:10,381::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135724::DEBUG::2014-10-29 11:11:10,382::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135724::INFO::2014-10-29 11:11:10,382::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135724::DEBUG::2014-10-29 11:11:10,383::task::1191::Storage.TaskManager.Task::(prepare) Task=`b01d4370-edbe-4f64-8b62-239c9d187815`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135724::DEBUG::2014-10-29 11:11:10,383::task::595::Storage.TaskManager.Task::(_updateState) Task=`b01d4370-edbe-4f64-8b62-239c9d187815`::moving from state preparing -> state finished >Thread-135724::DEBUG::2014-10-29 11:11:10,383::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135724::DEBUG::2014-10-29 11:11:10,383::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135724::DEBUG::2014-10-29 11:11:10,384::task::993::Storage.TaskManager.Task::(_decref) Task=`b01d4370-edbe-4f64-8b62-239c9d187815`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:11:10,429::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54063 >Detector thread::DEBUG::2014-10-29 11:11:10,430::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54063 >Detector thread::DEBUG::2014-10-29 11:11:10,431::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54063 >Detector thread::DEBUG::2014-10-29 11:11:10,431::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54063) >Thread-135725::DEBUG::2014-10-29 11:11:10,470::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135725::DEBUG::2014-10-29 11:11:10,470::task::595::Storage.TaskManager.Task::(_updateState) Task=`04512c64-9dcc-48c8-a2a8-43565fb1e7a6`::moving from state init -> state preparing >Thread-135725::INFO::2014-10-29 11:11:10,471::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135725::DEBUG::2014-10-29 11:11:10,471::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135725::DEBUG::2014-10-29 11:11:10,471::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135725::DEBUG::2014-10-29 11:11:10,472::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135725::DEBUG::2014-10-29 11:11:10,472::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135725::DEBUG::2014-10-29 11:11:10,472::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135725::DEBUG::2014-10-29 11:11:10,473::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Detector thread::DEBUG::2014-10-29 11:11:10,523::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54064 >Detector thread::DEBUG::2014-10-29 11:11:10,533::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54064 >Detector thread::DEBUG::2014-10-29 11:11:10,533::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54064 >Detector thread::DEBUG::2014-10-29 11:11:10,534::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54064) >Thread-135725::DEBUG::2014-10-29 11:11:10,549::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135725::DEBUG::2014-10-29 11:11:10,550::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135726::DEBUG::2014-10-29 11:11:10,576::task::595::Storage.TaskManager.Task::(_updateState) Task=`7686e56e-cd3c-4191-ab82-d0cf086edc28`::moving from state init -> state preparing >Thread-135726::INFO::2014-10-29 11:11:10,577::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135726::INFO::2014-10-29 11:11:10,578::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000439314', 'lastCheck': '4.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661971', 'lastCheck': '4.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502963', 'lastCheck': '4.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000485835', 'lastCheck': '4.5', 'valid': True}} >Thread-135726::DEBUG::2014-10-29 11:11:10,578::task::1191::Storage.TaskManager.Task::(prepare) Task=`7686e56e-cd3c-4191-ab82-d0cf086edc28`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000439314', 'lastCheck': '4.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661971', 'lastCheck': '4.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502963', 'lastCheck': '4.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000485835', 'lastCheck': '4.5', 'valid': True}} >Thread-135726::DEBUG::2014-10-29 11:11:10,578::task::595::Storage.TaskManager.Task::(_updateState) Task=`7686e56e-cd3c-4191-ab82-d0cf086edc28`::moving from state preparing -> state finished >Thread-135726::DEBUG::2014-10-29 11:11:10,579::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135726::DEBUG::2014-10-29 11:11:10,579::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135726::DEBUG::2014-10-29 11:11:10,579::task::993::Storage.TaskManager.Task::(_decref) Task=`7686e56e-cd3c-4191-ab82-d0cf086edc28`::ref 0 aborting False >Thread-135725::DEBUG::2014-10-29 11:11:10,732::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135725::DEBUG::2014-10-29 11:11:10,733::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135725::DEBUG::2014-10-29 11:11:10,733::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135725::DEBUG::2014-10-29 11:11:10,734::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135725::DEBUG::2014-10-29 11:11:10,734::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135725::DEBUG::2014-10-29 11:11:10,734::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135725::DEBUG::2014-10-29 11:11:10,735::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135725::DEBUG::2014-10-29 11:11:10,735::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:11:10,742::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:10,745::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:10,745::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:10,745::__init__::232::IOProcess::(_processLogs) (200040) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:10,746::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200040) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:10,748::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:10,748::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:10,749::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:10,749::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:10,749::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:10,750::__init__::232::IOProcess::(_processLogs) (200041) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:10,750::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:10,750::__init__::232::IOProcess::(_processLogs) (200042) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:10,751::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200041) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:10,751::__init__::232::IOProcess::(_processLogs) (200042) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:10,752::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:10,756::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:10,758::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:10,759::__init__::232::IOProcess::(_processLogs) (200043) Got request for method 'glob' >Thread-135725::DEBUG::2014-10-29 11:11:10,761::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:11:10,763::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200043) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:10,765::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:10,765::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:10,765::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:10,765::__init__::232::IOProcess::(_processLogs) (200044) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:11:10,767::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200044) Queuing response >Thread-135725::DEBUG::2014-10-29 11:11:10,768::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:11:10,769::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:10,769::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:10,769::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:10,770::__init__::232::IOProcess::(_processLogs) (200045) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:11:10,770::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200045) Queuing response >Thread-135725::DEBUG::2014-10-29 11:11:10,771::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:11:10,773::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:10,773::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:10,774::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:10,774::__init__::232::IOProcess::(_processLogs) (200046) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:10,774::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200046) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:10,775::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:10,776::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:10,776::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:10,776::__init__::232::IOProcess::(_processLogs) (200047) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:10,777::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200047) Queuing response >Thread-135725::DEBUG::2014-10-29 11:11:10,777::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-135725::INFO::2014-10-29 11:11:10,778::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135725::INFO::2014-10-29 11:11:10,778::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135725::INFO::2014-10-29 11:11:10,778::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:11:10,779::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:10,779::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:10,780::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:10,780::__init__::232::IOProcess::(_processLogs) (200048) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:11:10,780::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200048) Queuing response >Thread-135725::DEBUG::2014-10-29 11:11:10,781::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135725::DEBUG::2014-10-29 11:11:10,782::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`b9bfbd03-00e8-4e0f-af5d-f872f09278c6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135725::DEBUG::2014-10-29 11:11:10,783::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135725::DEBUG::2014-10-29 11:11:10,783::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135725::DEBUG::2014-10-29 11:11:10,783::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`b9bfbd03-00e8-4e0f-af5d-f872f09278c6`::Granted request >Thread-135725::DEBUG::2014-10-29 11:11:10,784::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`04512c64-9dcc-48c8-a2a8-43565fb1e7a6`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135725::DEBUG::2014-10-29 11:11:10,784::task::993::Storage.TaskManager.Task::(_decref) Task=`04512c64-9dcc-48c8-a2a8-43565fb1e7a6`::ref 1 aborting False >Thread-135725::INFO::2014-10-29 11:11:10,787::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135725::DEBUG::2014-10-29 11:11:10,787::task::1191::Storage.TaskManager.Task::(prepare) Task=`04512c64-9dcc-48c8-a2a8-43565fb1e7a6`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135725::DEBUG::2014-10-29 11:11:10,788::task::595::Storage.TaskManager.Task::(_updateState) Task=`04512c64-9dcc-48c8-a2a8-43565fb1e7a6`::moving from state preparing -> state finished >Thread-135725::DEBUG::2014-10-29 11:11:10,788::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135725::DEBUG::2014-10-29 11:11:10,788::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135725::DEBUG::2014-10-29 11:11:10,789::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135725::DEBUG::2014-10-29 11:11:10,789::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135725::DEBUG::2014-10-29 11:11:10,789::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135725::DEBUG::2014-10-29 11:11:10,789::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135725::DEBUG::2014-10-29 11:11:10,790::task::993::Storage.TaskManager.Task::(_decref) Task=`04512c64-9dcc-48c8-a2a8-43565fb1e7a6`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:11:10,813::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54065 >Detector thread::DEBUG::2014-10-29 11:11:10,814::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54065 >Detector thread::DEBUG::2014-10-29 11:11:10,814::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54065 >Detector thread::DEBUG::2014-10-29 11:11:10,814::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54065) >Thread-135731::DEBUG::2014-10-29 11:11:10,853::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135731::DEBUG::2014-10-29 11:11:10,853::task::595::Storage.TaskManager.Task::(_updateState) Task=`574e634e-b806-4a31-a4c1-dff27cd754b2`::moving from state init -> state preparing >Thread-135731::INFO::2014-10-29 11:11:10,854::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135731::INFO::2014-10-29 11:11:10,854::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000439314', 'lastCheck': '4.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661971', 'lastCheck': '4.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502963', 'lastCheck': '4.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000485835', 'lastCheck': '4.8', 'valid': True}} >Thread-135731::DEBUG::2014-10-29 11:11:10,855::task::1191::Storage.TaskManager.Task::(prepare) Task=`574e634e-b806-4a31-a4c1-dff27cd754b2`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000439314', 'lastCheck': '4.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661971', 'lastCheck': '4.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502963', 'lastCheck': '4.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000485835', 'lastCheck': '4.8', 'valid': True}} >Thread-135731::DEBUG::2014-10-29 11:11:10,855::task::595::Storage.TaskManager.Task::(_updateState) Task=`574e634e-b806-4a31-a4c1-dff27cd754b2`::moving from state preparing -> state finished >Thread-135731::DEBUG::2014-10-29 11:11:10,855::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135731::DEBUG::2014-10-29 11:11:10,855::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135731::DEBUG::2014-10-29 11:11:10,856::task::993::Storage.TaskManager.Task::(_decref) Task=`574e634e-b806-4a31-a4c1-dff27cd754b2`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:10,901::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:10,903::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135732::DEBUG::2014-10-29 11:11:10,907::task::595::Storage.TaskManager.Task::(_updateState) Task=`a48f6817-a1a2-4ca3-8e7d-15f8acd34308`::moving from state init -> state preparing >Thread-135732::INFO::2014-10-29 11:11:10,907::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135732::INFO::2014-10-29 11:11:10,908::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000439314', 'lastCheck': '4.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661971', 'lastCheck': '4.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502963', 'lastCheck': '5.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000485835', 'lastCheck': '4.9', 'valid': True}} >Thread-135732::DEBUG::2014-10-29 11:11:10,908::task::1191::Storage.TaskManager.Task::(prepare) Task=`a48f6817-a1a2-4ca3-8e7d-15f8acd34308`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000439314', 'lastCheck': '4.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661971', 'lastCheck': '4.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502963', 'lastCheck': '5.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000485835', 'lastCheck': '4.9', 'valid': True}} >Thread-135732::DEBUG::2014-10-29 11:11:10,908::task::595::Storage.TaskManager.Task::(_updateState) Task=`a48f6817-a1a2-4ca3-8e7d-15f8acd34308`::moving from state preparing -> state finished >Thread-135732::DEBUG::2014-10-29 11:11:10,909::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135732::DEBUG::2014-10-29 11:11:10,909::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135732::DEBUG::2014-10-29 11:11:10,909::task::993::Storage.TaskManager.Task::(_decref) Task=`a48f6817-a1a2-4ca3-8e7d-15f8acd34308`::ref 0 aborting False >Thread-135732::DEBUG::2014-10-29 11:11:10,931::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:10,958::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:10,960::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135733::DEBUG::2014-10-29 11:11:10,964::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135733::DEBUG::2014-10-29 11:11:10,966::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:14,028::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:14,031::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135734::DEBUG::2014-10-29 11:11:14,035::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:14,037::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:14,039::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135735::DEBUG::2014-10-29 11:11:14,042::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135735::DEBUG::2014-10-29 11:11:14,044::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:14,298::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:14,299::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:14,303::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:11:15,941::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:15,942::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:15,942::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:15,942::__init__::232::IOProcess::(_processLogs) (200049) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:15,943::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200049) Queuing response >Thread-179::DEBUG::2014-10-29 11:11:15,945::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:11:15,965::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00185228 s, 201 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:11:15,967::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:15,968::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:15,970::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:15,971::__init__::232::IOProcess::(_processLogs) (200050) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:15,971::__init__::232::IOProcess::(_processLogs) (200050) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:16,035::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:16,035::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:16,036::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:16,036::__init__::232::IOProcess::(_processLogs) (200051) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:16,036::__init__::232::IOProcess::(_processLogs) (200051) Queuing response >Thread-10269::DEBUG::2014-10-29 11:11:16,038::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:11:16,071::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.0160581 s, 31.3 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:11:16,076::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:16,078::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:16,079::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:16,080::__init__::232::IOProcess::(_processLogs) (200052) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:16,086::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200052) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:16,104::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:16,106::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:16,108::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:16,109::__init__::232::IOProcess::(_processLogs) (200053) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:16,115::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200053) Queuing response >Thread-178::DEBUG::2014-10-29 11:11:16,118::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:11:16,118::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:16,137::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:16,139::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-178::DEBUG::2014-10-29 11:11:16,140::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00152272 s, 334 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:11:16,142::__init__::232::IOProcess::(_processLogs) (200054) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:16,149::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200054) Queuing response >Thread-33::DEBUG::2014-10-29 11:11:16,151::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:11:16,170::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-33::DEBUG::2014-10-29 11:11:16,175::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00120992 s, 403 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:11:16,175::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:16,179::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:16,181::__init__::232::IOProcess::(_processLogs) (200055) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:16,187::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200055) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:16,191::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:16,193::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:16,194::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:16,196::__init__::232::IOProcess::(_processLogs) (200056) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:16,203::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200056) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:16,206::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:16,207::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:16,209::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:16,210::__init__::232::IOProcess::(_processLogs) (200057) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:16,213::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200057) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:16,216::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:16,218::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:16,219::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:16,221::__init__::232::IOProcess::(_processLogs) (200058) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:16,224::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200058) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:16,227::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:16,228::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:16,230::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:16,231::__init__::232::IOProcess::(_processLogs) (200059) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:16,233::__init__::232::IOProcess::(_processLogs) (200059) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:16,239::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:16,242::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:16,243::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:16,244::__init__::232::IOProcess::(_processLogs) (200060) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:16,245::__init__::232::IOProcess::(_processLogs) (200060) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:16,250::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:16,252::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:16,254::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:16,255::__init__::232::IOProcess::(_processLogs) (200061) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:16,257::__init__::232::IOProcess::(_processLogs) (200061) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:16,261::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:16,264::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:16,265::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:16,266::__init__::232::IOProcess::(_processLogs) (200062) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:16,267::__init__::232::IOProcess::(_processLogs) (200062) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:17,089::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:17,091::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135736::DEBUG::2014-10-29 11:11:17,095::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:17,097::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:17,099::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135737::DEBUG::2014-10-29 11:11:17,102::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135737::DEBUG::2014-10-29 11:11:17,104::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:11:17,142::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:19,310::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:19,312::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:19,313::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:11:19,632::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54066 >Detector thread::DEBUG::2014-10-29 11:11:19,632::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54066 >Detector thread::DEBUG::2014-10-29 11:11:19,633::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54066 >Detector thread::DEBUG::2014-10-29 11:11:19,633::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54066) >Thread-135738::DEBUG::2014-10-29 11:11:19,672::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135738::DEBUG::2014-10-29 11:11:19,673::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135738::DEBUG::2014-10-29 11:11:19,692::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135738::DEBUG::2014-10-29 11:11:19,738::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '167', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '67', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:11:20,086::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54067 >Detector thread::DEBUG::2014-10-29 11:11:20,087::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54067 >Detector thread::DEBUG::2014-10-29 11:11:20,087::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54067 >Detector thread::DEBUG::2014-10-29 11:11:20,088::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54067) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:20,120::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:20,122::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135740::DEBUG::2014-10-29 11:11:20,125::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-135739::DEBUG::2014-10-29 11:11:20,128::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135739::DEBUG::2014-10-29 11:11:20,129::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:20,130::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-135739::DEBUG::2014-10-29 11:11:20,134::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.53', 'elapsedTime': '513712', 'displayType': 'vnc', 'cpuSys': '0.47', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '50418869', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57596', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '45813.43'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.99', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpcServer::DEBUG::2014-10-29 11:11:20,136::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135741::DEBUG::2014-10-29 11:11:20,145::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135741::DEBUG::2014-10-29 11:11:20,155::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:11:20,655::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54069 >Detector thread::DEBUG::2014-10-29 11:11:20,656::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54069 >Detector thread::DEBUG::2014-10-29 11:11:20,656::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54069 >Detector thread::DEBUG::2014-10-29 11:11:20,657::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54069) >Thread-135742::DEBUG::2014-10-29 11:11:20,697::task::595::Storage.TaskManager.Task::(_updateState) Task=`12304ed4-798c-4e98-862f-5f3c21a16d95`::moving from state init -> state preparing >Thread-135742::INFO::2014-10-29 11:11:20,697::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135742::INFO::2014-10-29 11:11:20,698::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00152272', 'lastCheck': '4.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00120992', 'lastCheck': '4.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00185228', 'lastCheck': '4.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0160581', 'lastCheck': '4.6', 'valid': True}} >Thread-135742::DEBUG::2014-10-29 11:11:20,698::task::1191::Storage.TaskManager.Task::(prepare) Task=`12304ed4-798c-4e98-862f-5f3c21a16d95`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00152272', 'lastCheck': '4.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00120992', 'lastCheck': '4.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00185228', 'lastCheck': '4.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0160581', 'lastCheck': '4.6', 'valid': True}} >Thread-135742::DEBUG::2014-10-29 11:11:20,699::task::595::Storage.TaskManager.Task::(_updateState) Task=`12304ed4-798c-4e98-862f-5f3c21a16d95`::moving from state preparing -> state finished >Thread-135742::DEBUG::2014-10-29 11:11:20,699::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135742::DEBUG::2014-10-29 11:11:20,699::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135742::DEBUG::2014-10-29 11:11:20,699::task::993::Storage.TaskManager.Task::(_decref) Task=`12304ed4-798c-4e98-862f-5f3c21a16d95`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:11:21,437::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54071 >Detector thread::DEBUG::2014-10-29 11:11:21,438::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54071 >Detector thread::DEBUG::2014-10-29 11:11:21,438::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54071 >Detector thread::DEBUG::2014-10-29 11:11:21,438::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54071) >Thread-135743::DEBUG::2014-10-29 11:11:21,478::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135743::DEBUG::2014-10-29 11:11:21,478::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc18e0e7-6090-436c-a3b1-3bc2eacc5ca3`::moving from state init -> state preparing >Thread-135743::INFO::2014-10-29 11:11:21,479::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135743::DEBUG::2014-10-29 11:11:21,482::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:11:21,482::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:21,483::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:21,483::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:21,483::__init__::232::IOProcess::(_processLogs) (200063) Got request for method 'glob' >Thread-135743::DEBUG::2014-10-29 11:11:21,485::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:11:21,485::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200063) Queuing response >Thread-135743::DEBUG::2014-10-29 11:11:21,487::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135743::INFO::2014-10-29 11:11:21,488::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135743::DEBUG::2014-10-29 11:11:21,488::task::1191::Storage.TaskManager.Task::(prepare) Task=`bc18e0e7-6090-436c-a3b1-3bc2eacc5ca3`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135743::DEBUG::2014-10-29 11:11:21,488::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc18e0e7-6090-436c-a3b1-3bc2eacc5ca3`::moving from state preparing -> state finished >Thread-135743::DEBUG::2014-10-29 11:11:21,488::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135743::DEBUG::2014-10-29 11:11:21,489::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135743::DEBUG::2014-10-29 11:11:21,489::task::993::Storage.TaskManager.Task::(_decref) Task=`bc18e0e7-6090-436c-a3b1-3bc2eacc5ca3`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:11:21,532::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54072 >Detector thread::DEBUG::2014-10-29 11:11:21,533::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54072 >Detector thread::DEBUG::2014-10-29 11:11:21,533::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54072 >Detector thread::DEBUG::2014-10-29 11:11:21,534::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54072) >Thread-135744::DEBUG::2014-10-29 11:11:21,573::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135744::DEBUG::2014-10-29 11:11:21,573::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a2079ee-42a0-4c6d-97cb-4e85f393dad4`::moving from state init -> state preparing >Thread-135744::INFO::2014-10-29 11:11:21,574::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135744::DEBUG::2014-10-29 11:11:21,574::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135744::DEBUG::2014-10-29 11:11:21,574::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135744::DEBUG::2014-10-29 11:11:21,575::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135744::DEBUG::2014-10-29 11:11:21,575::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135744::DEBUG::2014-10-29 11:11:21,575::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135744::DEBUG::2014-10-29 11:11:21,576::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135744::DEBUG::2014-10-29 11:11:21,670::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135744::DEBUG::2014-10-29 11:11:21,672::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135744::DEBUG::2014-10-29 11:11:21,848::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135744::DEBUG::2014-10-29 11:11:21,849::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135744::DEBUG::2014-10-29 11:11:21,850::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135744::DEBUG::2014-10-29 11:11:21,850::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135744::DEBUG::2014-10-29 11:11:21,850::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135744::DEBUG::2014-10-29 11:11:21,851::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135744::DEBUG::2014-10-29 11:11:21,851::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135744::DEBUG::2014-10-29 11:11:21,851::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:11:21,858::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:21,859::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:21,860::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:21,860::__init__::232::IOProcess::(_processLogs) (200064) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:21,862::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200064) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:21,864::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:21,864::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:21,865::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:21,865::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:21,865::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:21,866::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:21,866::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:21,866::__init__::232::IOProcess::(_processLogs) (200065) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:21,866::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:21,867::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:21,867::__init__::232::IOProcess::(_processLogs) (200066) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:21,867::__init__::232::IOProcess::(_processLogs) (200067) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:21,867::__init__::232::IOProcess::(_processLogs) (200066) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:21,868::__init__::232::IOProcess::(_processLogs) (200067) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:21,868::__init__::232::IOProcess::(_processLogs) (200065) Queuing response >Thread-135744::DEBUG::2014-10-29 11:11:21,874::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:11:21,875::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:21,876::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:21,876::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:21,876::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200068) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:11:21,879::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200068) Queuing response >Thread-135744::DEBUG::2014-10-29 11:11:21,880::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:11:21,881::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:21,881::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:21,882::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:21,882::__init__::232::IOProcess::(_processLogs) (200069) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:11:21,882::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200069) Queuing response >Thread-135744::DEBUG::2014-10-29 11:11:21,883::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:11:21,884::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:21,884::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:21,885::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:21,885::__init__::232::IOProcess::(_processLogs) (200070) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:21,885::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200070) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:21,886::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:21,887::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:21,887::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:21,887::__init__::232::IOProcess::(_processLogs) (200071) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:21,887::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200071) Queuing response >Thread-135744::DEBUG::2014-10-29 11:11:21,888::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-135744::INFO::2014-10-29 11:11:21,888::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135744::INFO::2014-10-29 11:11:21,889::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135744::INFO::2014-10-29 11:11:21,889::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:11:21,890::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:21,890::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:21,890::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:21,891::__init__::232::IOProcess::(_processLogs) (200072) Got request for method 'readfile' >Thread-135744::DEBUG::2014-10-29 11:11:21,892::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:11:21,892::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200072) Queuing response >Thread-135744::DEBUG::2014-10-29 11:11:21,895::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`3a042af0-46e3-4413-b5a6-cf2d43c864c6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135744::DEBUG::2014-10-29 11:11:21,895::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135744::DEBUG::2014-10-29 11:11:21,895::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135744::DEBUG::2014-10-29 11:11:21,896::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`3a042af0-46e3-4413-b5a6-cf2d43c864c6`::Granted request >Thread-135744::DEBUG::2014-10-29 11:11:21,896::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5a2079ee-42a0-4c6d-97cb-4e85f393dad4`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135744::DEBUG::2014-10-29 11:11:21,897::task::993::Storage.TaskManager.Task::(_decref) Task=`5a2079ee-42a0-4c6d-97cb-4e85f393dad4`::ref 1 aborting False >Thread-135744::INFO::2014-10-29 11:11:21,899::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135744::DEBUG::2014-10-29 11:11:21,900::task::1191::Storage.TaskManager.Task::(prepare) Task=`5a2079ee-42a0-4c6d-97cb-4e85f393dad4`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135744::DEBUG::2014-10-29 11:11:21,900::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a2079ee-42a0-4c6d-97cb-4e85f393dad4`::moving from state preparing -> state finished >Thread-135744::DEBUG::2014-10-29 11:11:21,900::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135744::DEBUG::2014-10-29 11:11:21,900::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135744::DEBUG::2014-10-29 11:11:21,901::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135744::DEBUG::2014-10-29 11:11:21,901::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135744::DEBUG::2014-10-29 11:11:21,901::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135744::DEBUG::2014-10-29 11:11:21,902::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135744::DEBUG::2014-10-29 11:11:21,902::task::993::Storage.TaskManager.Task::(_decref) Task=`5a2079ee-42a0-4c6d-97cb-4e85f393dad4`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:11:21,934::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54073 >Detector thread::DEBUG::2014-10-29 11:11:21,936::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54073 >Detector thread::DEBUG::2014-10-29 11:11:21,937::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54073 >Detector thread::DEBUG::2014-10-29 11:11:21,937::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54073) >Thread-135749::DEBUG::2014-10-29 11:11:21,975::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135749::DEBUG::2014-10-29 11:11:21,976::task::595::Storage.TaskManager.Task::(_updateState) Task=`f660000d-9e8e-4859-8d66-bdb0285b78c3`::moving from state init -> state preparing >Thread-135749::INFO::2014-10-29 11:11:21,976::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135749::INFO::2014-10-29 11:11:21,977::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00152272', 'lastCheck': '5.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00120992', 'lastCheck': '5.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00185228', 'lastCheck': '6.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0160581', 'lastCheck': '5.9', 'valid': True}} >Thread-135749::DEBUG::2014-10-29 11:11:21,977::task::1191::Storage.TaskManager.Task::(prepare) Task=`f660000d-9e8e-4859-8d66-bdb0285b78c3`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00152272', 'lastCheck': '5.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00120992', 'lastCheck': '5.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00185228', 'lastCheck': '6.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0160581', 'lastCheck': '5.9', 'valid': True}} >Thread-135749::DEBUG::2014-10-29 11:11:21,977::task::595::Storage.TaskManager.Task::(_updateState) Task=`f660000d-9e8e-4859-8d66-bdb0285b78c3`::moving from state preparing -> state finished >Thread-135749::DEBUG::2014-10-29 11:11:21,977::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135749::DEBUG::2014-10-29 11:11:21,978::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135749::DEBUG::2014-10-29 11:11:21,978::task::993::Storage.TaskManager.Task::(_decref) Task=`f660000d-9e8e-4859-8d66-bdb0285b78c3`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:23,174::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:23,177::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135750::DEBUG::2014-10-29 11:11:23,181::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:23,183::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:23,185::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135751::DEBUG::2014-10-29 11:11:23,189::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135751::DEBUG::2014-10-29 11:11:23,191::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:24,320::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:24,321::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:24,324::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:11:25,973::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:25,974::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:25,974::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:25,974::__init__::232::IOProcess::(_processLogs) (200073) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:25,975::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200073) Queuing response >Thread-179::DEBUG::2014-10-29 11:11:25,976::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:11:25,993::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000455236 s, 817 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:11:25,995::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:25,998::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:25,999::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:25,999::__init__::232::IOProcess::(_processLogs) (200074) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:25,999::__init__::232::IOProcess::(_processLogs) (200074) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:26,090::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:26,090::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:26,091::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:26,093::__init__::232::IOProcess::(_processLogs) (200075) Got request for method 'statvfs' >Thread-10269::DEBUG::2014-10-29 11:11:26,093::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:11:26,094::__init__::232::IOProcess::(_processLogs) (200075) Queuing response >Thread-10269::DEBUG::2014-10-29 11:11:26,112::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000500046 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:11:26,113::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:26,113::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:26,114::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:26,114::__init__::232::IOProcess::(_processLogs) (200076) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:26,116::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200076) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:26,207::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:26,209::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135752::DEBUG::2014-10-29 11:11:26,214::task::595::Storage.TaskManager.Task::(_updateState) Task=`662d4d2b-b0f8-4dbb-b028-dab9fd1f79f0`::moving from state init -> state preparing >Thread-135752::INFO::2014-10-29 11:11:26,214::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135752::INFO::2014-10-29 11:11:26,215::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00152272', 'lastCheck': '10.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00120992', 'lastCheck': '10.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455236', 'lastCheck': '0.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000500046', 'lastCheck': '0.1', 'valid': True}} >Thread-135752::DEBUG::2014-10-29 11:11:26,215::task::1191::Storage.TaskManager.Task::(prepare) Task=`662d4d2b-b0f8-4dbb-b028-dab9fd1f79f0`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00152272', 'lastCheck': '10.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00120992', 'lastCheck': '10.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455236', 'lastCheck': '0.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000500046', 'lastCheck': '0.1', 'valid': True}} >Thread-135752::DEBUG::2014-10-29 11:11:26,215::task::595::Storage.TaskManager.Task::(_updateState) Task=`662d4d2b-b0f8-4dbb-b028-dab9fd1f79f0`::moving from state preparing -> state finished >Thread-135752::DEBUG::2014-10-29 11:11:26,216::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135752::DEBUG::2014-10-29 11:11:26,216::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135752::DEBUG::2014-10-29 11:11:26,216::task::993::Storage.TaskManager.Task::(_decref) Task=`662d4d2b-b0f8-4dbb-b028-dab9fd1f79f0`::ref 0 aborting False >Thread-135752::DEBUG::2014-10-29 11:11:26,250::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:11:26,253::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:26,254::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:26,254::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:26,254::__init__::232::IOProcess::(_processLogs) (200077) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:26,256::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200077) Queuing response >Thread-178::DEBUG::2014-10-29 11:11:26,256::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:11:26,280::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-178::DEBUG::2014-10-29 11:11:26,282::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00120692 s, 421 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:11:26,282::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:26,286::__init__::232::IOProcess::(_processLogs) Extracting request information... >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:26,286::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-17::DEBUG::2014-10-29 11:11:26,288::__init__::232::IOProcess::(_processLogs) (200078) Got request for method 'statvfs' >JsonRpcServer::DEBUG::2014-10-29 11:11:26,294::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:11:26,301::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200078) Queuing response >Thread-33::DEBUG::2014-10-29 11:11:26,305::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-135753::DEBUG::2014-10-29 11:11:26,325::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:11:26,325::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:26,328::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:26,331::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-33::DEBUG::2014-10-29 11:11:26,333::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.0011242 s, 433 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:11:26,335::__init__::232::IOProcess::(_processLogs) (200079) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:26,342::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200079) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:26,345::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:26,346::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:26,348::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:26,349::__init__::232::IOProcess::(_processLogs) (200080) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:26,353::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200080) Queuing response >Thread-135753::DEBUG::2014-10-29 11:11:26,355::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:11:26,360::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:26,360::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:26,360::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:26,361::__init__::232::IOProcess::(_processLogs) (200081) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:26,361::__init__::232::IOProcess::(_processLogs) (200081) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:26,362::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:26,362::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:26,362::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:26,362::__init__::232::IOProcess::(_processLogs) (200082) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:26,363::__init__::232::IOProcess::(_processLogs) (200082) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:26,365::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:26,365::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:26,366::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:26,366::__init__::232::IOProcess::(_processLogs) (200083) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:26,366::__init__::232::IOProcess::(_processLogs) (200083) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:26,367::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:26,368::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:26,368::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:26,369::__init__::232::IOProcess::(_processLogs) (200084) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:26,369::__init__::232::IOProcess::(_processLogs) (200084) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:26,369::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:26,370::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:26,371::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:26,372::__init__::232::IOProcess::(_processLogs) (200085) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:26,372::__init__::232::IOProcess::(_processLogs) (200085) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:26,373::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:26,374::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:26,374::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:26,376::__init__::232::IOProcess::(_processLogs) (200086) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:26,376::__init__::232::IOProcess::(_processLogs) (200086) Queuing response >Detector thread::DEBUG::2014-10-29 11:11:29,311::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54074 >Detector thread::DEBUG::2014-10-29 11:11:29,312::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54074 >Detector thread::DEBUG::2014-10-29 11:11:29,312::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54074 >Detector thread::DEBUG::2014-10-29 11:11:29,313::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54074) >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:29,331::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:29,332::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:29,333::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135754::DEBUG::2014-10-29 11:11:29,352::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135754::DEBUG::2014-10-29 11:11:29,353::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135754::DEBUG::2014-10-29 11:11:29,354::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.53', 'elapsedTime': '513721', 'displayType': 'vnc', 'cpuSys': '0.47', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '50418869', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57596', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '45813.43'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.21', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:29,422::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:29,426::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135755::DEBUG::2014-10-29 11:11:29,429::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:29,432::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:29,433::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135756::DEBUG::2014-10-29 11:11:29,437::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135756::DEBUG::2014-10-29 11:11:29,439::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:11:29,788::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54076 >Detector thread::DEBUG::2014-10-29 11:11:29,788::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54076 >Detector thread::DEBUG::2014-10-29 11:11:29,789::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54076 >Detector thread::DEBUG::2014-10-29 11:11:29,789::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54076) >Thread-135757::DEBUG::2014-10-29 11:11:29,828::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135757::DEBUG::2014-10-29 11:11:29,830::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135757::DEBUG::2014-10-29 11:11:29,849::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135757::DEBUG::2014-10-29 11:11:29,895::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '151', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '51', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:11:30,759::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54077 >Detector thread::DEBUG::2014-10-29 11:11:30,760::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54077 >Detector thread::DEBUG::2014-10-29 11:11:30,760::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54077 >Detector thread::DEBUG::2014-10-29 11:11:30,761::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54077) >Thread-135758::DEBUG::2014-10-29 11:11:30,801::task::595::Storage.TaskManager.Task::(_updateState) Task=`f94522bf-4c03-490e-ba01-e3302cdb4b9e`::moving from state init -> state preparing >Thread-135758::INFO::2014-10-29 11:11:30,801::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135758::INFO::2014-10-29 11:11:30,802::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00120692', 'lastCheck': '4.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0011242', 'lastCheck': '4.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455236', 'lastCheck': '4.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000500046', 'lastCheck': '4.7', 'valid': True}} >Thread-135758::DEBUG::2014-10-29 11:11:30,802::task::1191::Storage.TaskManager.Task::(prepare) Task=`f94522bf-4c03-490e-ba01-e3302cdb4b9e`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00120692', 'lastCheck': '4.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0011242', 'lastCheck': '4.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455236', 'lastCheck': '4.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000500046', 'lastCheck': '4.7', 'valid': True}} >Thread-135758::DEBUG::2014-10-29 11:11:30,803::task::595::Storage.TaskManager.Task::(_updateState) Task=`f94522bf-4c03-490e-ba01-e3302cdb4b9e`::moving from state preparing -> state finished >Thread-135758::DEBUG::2014-10-29 11:11:30,803::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135758::DEBUG::2014-10-29 11:11:30,803::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135758::DEBUG::2014-10-29 11:11:30,803::task::993::Storage.TaskManager.Task::(_decref) Task=`f94522bf-4c03-490e-ba01-e3302cdb4b9e`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:11:32,177::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:32,457::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:32,460::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135759::DEBUG::2014-10-29 11:11:32,464::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:32,466::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:32,468::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135760::DEBUG::2014-10-29 11:11:32,471::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135760::DEBUG::2014-10-29 11:11:32,474::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:11:32,542::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54079 >Detector thread::DEBUG::2014-10-29 11:11:32,543::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54079 >Detector thread::DEBUG::2014-10-29 11:11:32,543::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54079 >Detector thread::DEBUG::2014-10-29 11:11:32,544::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54079) >Thread-135761::DEBUG::2014-10-29 11:11:32,584::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135761::DEBUG::2014-10-29 11:11:32,585::task::595::Storage.TaskManager.Task::(_updateState) Task=`08dfb4da-5194-4689-9f82-e301d6c53537`::moving from state init -> state preparing >Thread-135761::INFO::2014-10-29 11:11:32,585::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135761::DEBUG::2014-10-29 11:11:32,592::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:11:32,593::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:32,594::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:32,594::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:32,594::__init__::232::IOProcess::(_processLogs) (200087) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:32,595::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200087) Queuing response >Thread-135761::DEBUG::2014-10-29 11:11:32,596::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135761::DEBUG::2014-10-29 11:11:32,597::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135761::INFO::2014-10-29 11:11:32,597::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135761::DEBUG::2014-10-29 11:11:32,597::task::1191::Storage.TaskManager.Task::(prepare) Task=`08dfb4da-5194-4689-9f82-e301d6c53537`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135761::DEBUG::2014-10-29 11:11:32,598::task::595::Storage.TaskManager.Task::(_updateState) Task=`08dfb4da-5194-4689-9f82-e301d6c53537`::moving from state preparing -> state finished >Thread-135761::DEBUG::2014-10-29 11:11:32,598::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135761::DEBUG::2014-10-29 11:11:32,598::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135761::DEBUG::2014-10-29 11:11:32,598::task::993::Storage.TaskManager.Task::(_decref) Task=`08dfb4da-5194-4689-9f82-e301d6c53537`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:11:32,646::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54080 >Detector thread::DEBUG::2014-10-29 11:11:32,649::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54080 >Detector thread::DEBUG::2014-10-29 11:11:32,650::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54080 >Detector thread::DEBUG::2014-10-29 11:11:32,653::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54080) >Thread-135762::DEBUG::2014-10-29 11:11:32,687::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135762::DEBUG::2014-10-29 11:11:32,688::task::595::Storage.TaskManager.Task::(_updateState) Task=`8874e62e-ced8-48a2-a0ab-47b266ee56c7`::moving from state init -> state preparing >Thread-135762::INFO::2014-10-29 11:11:32,689::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135762::DEBUG::2014-10-29 11:11:32,689::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135762::DEBUG::2014-10-29 11:11:32,690::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135762::DEBUG::2014-10-29 11:11:32,690::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135762::DEBUG::2014-10-29 11:11:32,690::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135762::DEBUG::2014-10-29 11:11:32,690::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135762::DEBUG::2014-10-29 11:11:32,691::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135762::DEBUG::2014-10-29 11:11:32,780::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135762::DEBUG::2014-10-29 11:11:32,781::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135762::DEBUG::2014-10-29 11:11:32,965::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135762::DEBUG::2014-10-29 11:11:32,966::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135762::DEBUG::2014-10-29 11:11:32,967::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135762::DEBUG::2014-10-29 11:11:32,967::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135762::DEBUG::2014-10-29 11:11:32,967::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135762::DEBUG::2014-10-29 11:11:32,968::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135762::DEBUG::2014-10-29 11:11:32,968::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135762::DEBUG::2014-10-29 11:11:32,969::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:11:32,977::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:32,979::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:32,979::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:32,979::__init__::232::IOProcess::(_processLogs) (200088) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:32,981::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200088) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:32,982::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:32,982::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:32,983::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:32,983::__init__::232::IOProcess::(_processLogs) (200089) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:32,984::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200089) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:32,984::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:32,985::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:32,985::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:32,985::__init__::232::IOProcess::(_processLogs) (200090) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:32,986::__init__::232::IOProcess::(_processLogs) (200090) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:32,987::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:32,988::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:32,991::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:32,993::__init__::232::IOProcess::(_processLogs) (200091) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:32,997::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200091) Queuing response >Thread-135762::DEBUG::2014-10-29 11:11:32,999::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:11:33,000::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:33,001::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:33,001::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:33,001::__init__::232::IOProcess::(_processLogs) (200092) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:11:33,002::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200092) Queuing response >Thread-135762::DEBUG::2014-10-29 11:11:33,002::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:11:33,003::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:33,004::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:33,004::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:33,004::__init__::232::IOProcess::(_processLogs) (200093) Got request for method 'readfile' >Thread-135762::DEBUG::2014-10-29 11:11:33,005::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:11:33,005::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200093) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:33,008::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:33,009::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:33,009::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:33,010::__init__::232::IOProcess::(_processLogs) (200094) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:33,010::__init__::232::IOProcess::(_processLogs) (200094) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:33,010::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:33,011::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:33,011::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:33,011::__init__::232::IOProcess::(_processLogs) (200095) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:33,012::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200095) Queuing response >Thread-135762::DEBUG::2014-10-29 11:11:33,012::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-135762::INFO::2014-10-29 11:11:33,013::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135762::INFO::2014-10-29 11:11:33,013::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135762::INFO::2014-10-29 11:11:33,014::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:11:33,014::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:33,015::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:33,015::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:33,015::__init__::232::IOProcess::(_processLogs) (200096) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:11:33,016::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200096) Queuing response >Thread-135762::DEBUG::2014-10-29 11:11:33,016::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135762::DEBUG::2014-10-29 11:11:33,019::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`f22ef739-a427-43ba-b8f4-bb2adcee87d3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135762::DEBUG::2014-10-29 11:11:33,019::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135762::DEBUG::2014-10-29 11:11:33,019::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135762::DEBUG::2014-10-29 11:11:33,020::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`f22ef739-a427-43ba-b8f4-bb2adcee87d3`::Granted request >Thread-135762::DEBUG::2014-10-29 11:11:33,020::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8874e62e-ced8-48a2-a0ab-47b266ee56c7`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135762::DEBUG::2014-10-29 11:11:33,021::task::993::Storage.TaskManager.Task::(_decref) Task=`8874e62e-ced8-48a2-a0ab-47b266ee56c7`::ref 1 aborting False >Thread-135762::INFO::2014-10-29 11:11:33,023::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135762::DEBUG::2014-10-29 11:11:33,024::task::1191::Storage.TaskManager.Task::(prepare) Task=`8874e62e-ced8-48a2-a0ab-47b266ee56c7`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135762::DEBUG::2014-10-29 11:11:33,024::task::595::Storage.TaskManager.Task::(_updateState) Task=`8874e62e-ced8-48a2-a0ab-47b266ee56c7`::moving from state preparing -> state finished >Thread-135762::DEBUG::2014-10-29 11:11:33,024::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135762::DEBUG::2014-10-29 11:11:33,024::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135762::DEBUG::2014-10-29 11:11:33,025::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135762::DEBUG::2014-10-29 11:11:33,025::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135762::DEBUG::2014-10-29 11:11:33,025::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135762::DEBUG::2014-10-29 11:11:33,026::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135762::DEBUG::2014-10-29 11:11:33,026::task::993::Storage.TaskManager.Task::(_decref) Task=`8874e62e-ced8-48a2-a0ab-47b266ee56c7`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:11:33,048::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54081 >Detector thread::DEBUG::2014-10-29 11:11:33,049::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54081 >Detector thread::DEBUG::2014-10-29 11:11:33,049::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54081 >Detector thread::DEBUG::2014-10-29 11:11:33,050::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54081) >Thread-135767::DEBUG::2014-10-29 11:11:33,088::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135767::DEBUG::2014-10-29 11:11:33,088::task::595::Storage.TaskManager.Task::(_updateState) Task=`715265e5-8cfe-46ac-a102-71bc97419549`::moving from state init -> state preparing >Thread-135767::INFO::2014-10-29 11:11:33,089::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135767::INFO::2014-10-29 11:11:33,089::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00120692', 'lastCheck': '6.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0011242', 'lastCheck': '6.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455236', 'lastCheck': '7.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000500046', 'lastCheck': '7.0', 'valid': True}} >Thread-135767::DEBUG::2014-10-29 11:11:33,090::task::1191::Storage.TaskManager.Task::(prepare) Task=`715265e5-8cfe-46ac-a102-71bc97419549`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00120692', 'lastCheck': '6.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0011242', 'lastCheck': '6.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455236', 'lastCheck': '7.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000500046', 'lastCheck': '7.0', 'valid': True}} >Thread-135767::DEBUG::2014-10-29 11:11:33,090::task::595::Storage.TaskManager.Task::(_updateState) Task=`715265e5-8cfe-46ac-a102-71bc97419549`::moving from state preparing -> state finished >Thread-135767::DEBUG::2014-10-29 11:11:33,090::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135767::DEBUG::2014-10-29 11:11:33,090::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135767::DEBUG::2014-10-29 11:11:33,091::task::993::Storage.TaskManager.Task::(_decref) Task=`715265e5-8cfe-46ac-a102-71bc97419549`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-10-29 11:11:33,466::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:34,341::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:34,342::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:34,345::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:35,487::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:35,491::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135768::DEBUG::2014-10-29 11:11:35,494::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:35,497::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:35,499::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135769::DEBUG::2014-10-29 11:11:35,502::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135769::DEBUG::2014-10-29 11:11:35,504::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-179::DEBUG::2014-10-29 11:11:36,000::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 38dc6c98-2b6a-45c0-b765-c5ce685415f9 >Thread-17::DEBUG::2014-10-29 11:11:36,007::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,007::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,008::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:36,008::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200097) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:36,009::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200097) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:36,011::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,011::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,011::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:36,011::__init__::232::IOProcess::(_processLogs) (200098) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:36,012::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200098) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:36,013::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,014::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,014::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:36,014::__init__::232::IOProcess::(_processLogs) (200099) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:36,015::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200099) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:36,018::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,020::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,021::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:36,023::__init__::232::IOProcess::(_processLogs) (200100) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:36,027::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200100) Queuing response >Thread-179::DEBUG::2014-10-29 11:11:36,028::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9 >Thread-17::DEBUG::2014-10-29 11:11:36,030::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,030::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,031::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:36,031::__init__::232::IOProcess::(_processLogs) (200101) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:11:36,031::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200101) Queuing response >Thread-179::DEBUG::2014-10-29 11:11:36,032::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:11:36,033::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,033::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,034::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:36,034::__init__::232::IOProcess::(_processLogs) (200102) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:11:36,035::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200102) Queuing response >Thread-179::DEBUG::2014-10-29 11:11:36,035::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nsednev_rhevm_3_5_second_SD', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=00000002-0002-0002-0002-000000000321', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_rhevm_3_5_second_SD', 'ROLE=Regular', 'SDUUID=38dc6c98-2b6a-45c0-b765-c5ce685415f9', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ea5c54387b91bc1e37853d7501f0d1b2d7d233e7'] >Thread-17::DEBUG::2014-10-29 11:11:36,037::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,038::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,038::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:36,039::__init__::232::IOProcess::(_processLogs) (200103) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:36,039::__init__::232::IOProcess::(_processLogs) (200103) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:36,039::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,040::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,040::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:36,040::__init__::232::IOProcess::(_processLogs) (200104) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:36,041::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200104) Queuing response >Thread-179::DEBUG::2014-10-29 11:11:36,041::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-179::INFO::2014-10-29 11:11:36,042::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 38dc6c98-2b6a-45c0-b765-c5ce685415f9_imageNS already registered >Thread-179::INFO::2014-10-29 11:11:36,042::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 38dc6c98-2b6a-45c0-b765-c5ce685415f9_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:11:36,043::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,043::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,044::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:36,044::__init__::232::IOProcess::(_processLogs) (200105) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:36,045::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200105) Queuing response >Thread-179::DEBUG::2014-10-29 11:11:36,047::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:11:36,064::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000584956 s, 636 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:11:36,066::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,066::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,066::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:36,067::__init__::232::IOProcess::(_processLogs) (200106) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:36,068::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200106) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:36,118::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,119::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,119::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:36,119::__init__::232::IOProcess::(_processLogs) (200107) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:36,120::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200107) Queuing response >Thread-10269::DEBUG::2014-10-29 11:11:36,122::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:11:36,142::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00200501 s, 250 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:11:36,144::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,144::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,145::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:36,145::__init__::232::IOProcess::(_processLogs) (200108) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:36,147::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200108) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:36,373::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,373::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,373::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:36,374::__init__::232::IOProcess::(_processLogs) (200109) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:36,375::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200109) Queuing response >Thread-33::DEBUG::2014-10-29 11:11:36,377::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-178::DEBUG::2014-10-29 11:11:36,377::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:11:36,399::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000639612 s, 794 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:11:36,406::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,409::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,410::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:36,410::__init__::232::IOProcess::(_processLogs) (200110) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:36,411::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200110) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:36,412::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,413::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,413::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:36,413::__init__::232::IOProcess::(_processLogs) (200111) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:36,414::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200111) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:36,415::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,417::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,419::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:36,420::__init__::232::IOProcess::(_processLogs) (200112) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:36,428::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200112) Queuing response >Thread-33::DEBUG::2014-10-29 11:11:36,430::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:11:36,432::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,433::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,433::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:36,433::__init__::232::IOProcess::(_processLogs) (200113) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:36,434::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200113) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:36,435::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,435::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,435::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:36,435::__init__::232::IOProcess::(_processLogs) (200114) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:36,436::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200114) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:36,437::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,438::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,438::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:36,439::__init__::232::IOProcess::(_processLogs) (200115) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:36,439::__init__::232::IOProcess::(_processLogs) (200115) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:36,440::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,440::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,441::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:36,441::__init__::232::IOProcess::(_processLogs) (200116) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:11:36,441::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,442::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,443::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:36,443::__init__::232::IOProcess::(_processLogs) (200117) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:36,443::__init__::232::IOProcess::(_processLogs) (200117) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:36,444::__init__::232::IOProcess::(_processLogs) (200116) Queuing response >Thread-33::DEBUG::2014-10-29 11:11:36,445::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:11:36,447::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,448::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,448::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:36,448::__init__::232::IOProcess::(_processLogs) (200118) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:36,449::__init__::232::IOProcess::(_processLogs) (200118) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:36,449::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,451::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,452::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-33::DEBUG::2014-10-29 11:11:36,453::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:11:36,454::__init__::232::IOProcess::(_processLogs) (200119) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:11:36,456::__init__::232::IOProcess::(_processLogs) (200119) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:36,458::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,459::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,459::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:36,460::__init__::232::IOProcess::(_processLogs) (200120) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:36,460::__init__::232::IOProcess::(_processLogs) (200120) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:36,460::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,461::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,461::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:36,461::__init__::232::IOProcess::(_processLogs) (200121) Got request for method 'glob' >Thread-33::DEBUG::2014-10-29 11:11:36,462::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:11:36,462::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200121) Queuing response >Thread-33::INFO::2014-10-29 11:11:36,463::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-33::INFO::2014-10-29 11:11:36,464::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:11:36,465::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,465::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,466::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:36,466::__init__::232::IOProcess::(_processLogs) (200122) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:36,468::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200122) Queuing response >Thread-33::DEBUG::2014-10-29 11:11:36,470::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:11:36,487::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000585302 s, 832 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:11:36,489::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,490::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,490::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:36,490::__init__::232::IOProcess::(_processLogs) (200123) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:36,492::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200123) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:36,493::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,494::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,495::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:36,495::__init__::232::IOProcess::(_processLogs) (200124) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:36,495::__init__::232::IOProcess::(_processLogs) (200124) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:36,496::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,497::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,498::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:36,498::__init__::232::IOProcess::(_processLogs) (200125) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:36,498::__init__::232::IOProcess::(_processLogs) (200125) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:36,498::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:36,499::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:36,500::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:36,501::__init__::232::IOProcess::(_processLogs) (200126) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:36,501::__init__::232::IOProcess::(_processLogs) (200126) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:38,519::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:38,522::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135778::DEBUG::2014-10-29 11:11:38,527::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:38,529::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:38,531::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135779::DEBUG::2014-10-29 11:11:38,534::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135779::DEBUG::2014-10-29 11:11:38,537::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:39,352::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:39,353::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:39,355::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:11:39,501::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54082 >Detector thread::DEBUG::2014-10-29 11:11:39,501::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54082 >Detector thread::DEBUG::2014-10-29 11:11:39,502::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54082 >Detector thread::DEBUG::2014-10-29 11:11:39,502::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54082) >Thread-135780::DEBUG::2014-10-29 11:11:39,541::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135780::DEBUG::2014-10-29 11:11:39,542::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135780::DEBUG::2014-10-29 11:11:39,543::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.60', 'elapsedTime': '513732', 'displayType': 'vnc', 'cpuSys': '0.80', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '50418869', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57596', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '45813.43'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.36', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:11:39,945::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54084 >Detector thread::DEBUG::2014-10-29 11:11:39,946::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54084 >Detector thread::DEBUG::2014-10-29 11:11:39,946::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54084 >Detector thread::DEBUG::2014-10-29 11:11:39,946::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54084) >Thread-135781::DEBUG::2014-10-29 11:11:39,985::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135781::DEBUG::2014-10-29 11:11:39,986::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135781::DEBUG::2014-10-29 11:11:40,004::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135781::DEBUG::2014-10-29 11:11:40,051::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '136', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '35', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:11:40,857::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54085 >Detector thread::DEBUG::2014-10-29 11:11:40,857::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54085 >Detector thread::DEBUG::2014-10-29 11:11:40,858::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54085 >Detector thread::DEBUG::2014-10-29 11:11:40,858::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54085) >Thread-135782::DEBUG::2014-10-29 11:11:40,898::task::595::Storage.TaskManager.Task::(_updateState) Task=`cbf81a68-1c74-406b-a356-c7be4803c673`::moving from state init -> state preparing >Thread-135782::INFO::2014-10-29 11:11:40,898::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135782::INFO::2014-10-29 11:11:40,899::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000639612', 'lastCheck': '4.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585302', 'lastCheck': '4.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000584956', 'lastCheck': '4.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00200501', 'lastCheck': '4.8', 'valid': True}} >Thread-135782::DEBUG::2014-10-29 11:11:40,899::task::1191::Storage.TaskManager.Task::(prepare) Task=`cbf81a68-1c74-406b-a356-c7be4803c673`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000639612', 'lastCheck': '4.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585302', 'lastCheck': '4.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000584956', 'lastCheck': '4.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00200501', 'lastCheck': '4.8', 'valid': True}} >Thread-135782::DEBUG::2014-10-29 11:11:40,900::task::595::Storage.TaskManager.Task::(_updateState) Task=`cbf81a68-1c74-406b-a356-c7be4803c673`::moving from state preparing -> state finished >Thread-135782::DEBUG::2014-10-29 11:11:40,900::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135782::DEBUG::2014-10-29 11:11:40,900::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135782::DEBUG::2014-10-29 11:11:40,900::task::993::Storage.TaskManager.Task::(_decref) Task=`cbf81a68-1c74-406b-a356-c7be4803c673`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:41,552::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:41,555::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135783::DEBUG::2014-10-29 11:11:41,559::task::595::Storage.TaskManager.Task::(_updateState) Task=`f9eb5b53-9e27-4b23-b78c-4ee1f2b02449`::moving from state init -> state preparing >Thread-135783::INFO::2014-10-29 11:11:41,559::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135783::INFO::2014-10-29 11:11:41,559::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000639612', 'lastCheck': '5.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585302', 'lastCheck': '5.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000584956', 'lastCheck': '5.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00200501', 'lastCheck': '5.4', 'valid': True}} >Thread-135783::DEBUG::2014-10-29 11:11:41,560::task::1191::Storage.TaskManager.Task::(prepare) Task=`f9eb5b53-9e27-4b23-b78c-4ee1f2b02449`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000639612', 'lastCheck': '5.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585302', 'lastCheck': '5.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000584956', 'lastCheck': '5.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00200501', 'lastCheck': '5.4', 'valid': True}} >Thread-135783::DEBUG::2014-10-29 11:11:41,560::task::595::Storage.TaskManager.Task::(_updateState) Task=`f9eb5b53-9e27-4b23-b78c-4ee1f2b02449`::moving from state preparing -> state finished >Thread-135783::DEBUG::2014-10-29 11:11:41,560::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135783::DEBUG::2014-10-29 11:11:41,561::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135783::DEBUG::2014-10-29 11:11:41,561::task::993::Storage.TaskManager.Task::(_decref) Task=`f9eb5b53-9e27-4b23-b78c-4ee1f2b02449`::ref 0 aborting False >Thread-135783::DEBUG::2014-10-29 11:11:42,323::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:42,349::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:42,351::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135784::DEBUG::2014-10-29 11:11:42,354::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135784::DEBUG::2014-10-29 11:11:42,356::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:11:43,674::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54087 >Detector thread::DEBUG::2014-10-29 11:11:43,675::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54087 >Detector thread::DEBUG::2014-10-29 11:11:43,675::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54087 >Detector thread::DEBUG::2014-10-29 11:11:43,676::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54087) >Thread-135785::DEBUG::2014-10-29 11:11:43,715::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135785::DEBUG::2014-10-29 11:11:43,716::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ea4f7bc-9992-41e7-9e80-5ac5fe2e1334`::moving from state init -> state preparing >Thread-135785::INFO::2014-10-29 11:11:43,716::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135785::DEBUG::2014-10-29 11:11:43,719::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:11:43,720::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:43,721::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:43,721::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:43,721::__init__::232::IOProcess::(_processLogs) (200127) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:43,723::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200127) Queuing response >Thread-135785::DEBUG::2014-10-29 11:11:43,724::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135785::DEBUG::2014-10-29 11:11:43,724::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135785::INFO::2014-10-29 11:11:43,725::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135785::DEBUG::2014-10-29 11:11:43,725::task::1191::Storage.TaskManager.Task::(prepare) Task=`6ea4f7bc-9992-41e7-9e80-5ac5fe2e1334`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135785::DEBUG::2014-10-29 11:11:43,725::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ea4f7bc-9992-41e7-9e80-5ac5fe2e1334`::moving from state preparing -> state finished >Thread-135785::DEBUG::2014-10-29 11:11:43,726::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135785::DEBUG::2014-10-29 11:11:43,726::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135785::DEBUG::2014-10-29 11:11:43,726::task::993::Storage.TaskManager.Task::(_decref) Task=`6ea4f7bc-9992-41e7-9e80-5ac5fe2e1334`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:11:43,770::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54088 >Detector thread::DEBUG::2014-10-29 11:11:43,770::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54088 >Detector thread::DEBUG::2014-10-29 11:11:43,771::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54088 >Detector thread::DEBUG::2014-10-29 11:11:43,771::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54088) >Thread-135786::DEBUG::2014-10-29 11:11:43,810::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135786::DEBUG::2014-10-29 11:11:43,810::task::595::Storage.TaskManager.Task::(_updateState) Task=`5e900053-e54d-4037-96e6-a8e3833ed99d`::moving from state init -> state preparing >Thread-135786::INFO::2014-10-29 11:11:43,811::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135786::DEBUG::2014-10-29 11:11:43,811::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135786::DEBUG::2014-10-29 11:11:43,811::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135786::DEBUG::2014-10-29 11:11:43,812::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135786::DEBUG::2014-10-29 11:11:43,812::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135786::DEBUG::2014-10-29 11:11:43,812::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135786::DEBUG::2014-10-29 11:11:43,813::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135786::DEBUG::2014-10-29 11:11:43,903::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135786::DEBUG::2014-10-29 11:11:43,904::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135786::DEBUG::2014-10-29 11:11:44,080::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135786::DEBUG::2014-10-29 11:11:44,082::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135786::DEBUG::2014-10-29 11:11:44,082::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135786::DEBUG::2014-10-29 11:11:44,083::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135786::DEBUG::2014-10-29 11:11:44,083::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135786::DEBUG::2014-10-29 11:11:44,083::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135786::DEBUG::2014-10-29 11:11:44,084::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135786::DEBUG::2014-10-29 11:11:44,084::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:11:44,090::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:44,093::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:44,093::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:44,094::__init__::232::IOProcess::(_processLogs) (200128) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:44,095::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200128) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:44,096::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:44,097::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:44,097::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:44,097::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:44,098::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:44,098::__init__::232::IOProcess::(_processLogs) (200129) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:44,098::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:44,098::__init__::232::IOProcess::(_processLogs) (200130) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:44,100::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:44,100::__init__::232::IOProcess::(_processLogs) (200130) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:44,101::__init__::232::IOProcess::(_processLogs) (200129) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:44,101::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:44,102::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:44,103::__init__::232::IOProcess::(_processLogs) (200131) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:44,105::__init__::232::IOProcess::(_processLogs) (200131) Queuing response >Thread-135786::DEBUG::2014-10-29 11:11:44,110::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:11:44,111::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:44,112::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:44,112::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:44,112::__init__::232::IOProcess::(_processLogs) (200132) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:11:44,113::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200132) Queuing response >Thread-135786::DEBUG::2014-10-29 11:11:44,114::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:11:44,115::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:44,116::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:44,116::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:44,116::__init__::232::IOProcess::(_processLogs) (200133) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:11:44,117::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200133) Queuing response >Thread-135786::DEBUG::2014-10-29 11:11:44,117::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:11:44,119::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:44,120::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:44,121::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:44,121::__init__::232::IOProcess::(_processLogs) (200134) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:44,121::__init__::232::IOProcess::(_processLogs) (200134) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:44,122::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:44,122::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:44,122::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:44,123::__init__::232::IOProcess::(_processLogs) (200135) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:44,124::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200135) Queuing response >Thread-135786::DEBUG::2014-10-29 11:11:44,124::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-135786::INFO::2014-10-29 11:11:44,125::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135786::INFO::2014-10-29 11:11:44,125::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135786::INFO::2014-10-29 11:11:44,125::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:11:44,126::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:44,126::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:44,127::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:44,127::__init__::232::IOProcess::(_processLogs) (200136) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:11:44,128::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200136) Queuing response >Thread-135786::DEBUG::2014-10-29 11:11:44,128::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135786::DEBUG::2014-10-29 11:11:44,130::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`c648909b-69bf-4a0f-98d6-93c618ff6316`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135786::DEBUG::2014-10-29 11:11:44,131::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135786::DEBUG::2014-10-29 11:11:44,131::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135786::DEBUG::2014-10-29 11:11:44,131::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`c648909b-69bf-4a0f-98d6-93c618ff6316`::Granted request >Thread-135786::DEBUG::2014-10-29 11:11:44,132::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5e900053-e54d-4037-96e6-a8e3833ed99d`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135786::DEBUG::2014-10-29 11:11:44,132::task::993::Storage.TaskManager.Task::(_decref) Task=`5e900053-e54d-4037-96e6-a8e3833ed99d`::ref 1 aborting False >Thread-135786::INFO::2014-10-29 11:11:44,135::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135786::DEBUG::2014-10-29 11:11:44,135::task::1191::Storage.TaskManager.Task::(prepare) Task=`5e900053-e54d-4037-96e6-a8e3833ed99d`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135786::DEBUG::2014-10-29 11:11:44,136::task::595::Storage.TaskManager.Task::(_updateState) Task=`5e900053-e54d-4037-96e6-a8e3833ed99d`::moving from state preparing -> state finished >Thread-135786::DEBUG::2014-10-29 11:11:44,136::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135786::DEBUG::2014-10-29 11:11:44,136::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135786::DEBUG::2014-10-29 11:11:44,137::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135786::DEBUG::2014-10-29 11:11:44,137::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135786::DEBUG::2014-10-29 11:11:44,137::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135786::DEBUG::2014-10-29 11:11:44,137::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135786::DEBUG::2014-10-29 11:11:44,138::task::993::Storage.TaskManager.Task::(_decref) Task=`5e900053-e54d-4037-96e6-a8e3833ed99d`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:11:44,159::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54089 >Detector thread::DEBUG::2014-10-29 11:11:44,160::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54089 >Detector thread::DEBUG::2014-10-29 11:11:44,160::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54089 >Detector thread::DEBUG::2014-10-29 11:11:44,161::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54089) >Thread-135791::DEBUG::2014-10-29 11:11:44,200::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135791::DEBUG::2014-10-29 11:11:44,200::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac31d1d6-ac4d-44ea-91a3-d4670328890e`::moving from state init -> state preparing >Thread-135791::INFO::2014-10-29 11:11:44,201::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135791::INFO::2014-10-29 11:11:44,201::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000639612', 'lastCheck': '7.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585302', 'lastCheck': '7.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000584956', 'lastCheck': '8.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00200501', 'lastCheck': '8.1', 'valid': True}} >Thread-135791::DEBUG::2014-10-29 11:11:44,202::task::1191::Storage.TaskManager.Task::(prepare) Task=`ac31d1d6-ac4d-44ea-91a3-d4670328890e`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000639612', 'lastCheck': '7.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585302', 'lastCheck': '7.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000584956', 'lastCheck': '8.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00200501', 'lastCheck': '8.1', 'valid': True}} >Thread-135791::DEBUG::2014-10-29 11:11:44,202::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac31d1d6-ac4d-44ea-91a3-d4670328890e`::moving from state preparing -> state finished >Thread-135791::DEBUG::2014-10-29 11:11:44,202::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135791::DEBUG::2014-10-29 11:11:44,202::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135791::DEBUG::2014-10-29 11:11:44,203::task::993::Storage.TaskManager.Task::(_decref) Task=`ac31d1d6-ac4d-44ea-91a3-d4670328890e`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:44,363::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:44,365::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:44,369::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:45,410::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:45,413::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135792::DEBUG::2014-10-29 11:11:45,416::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:45,419::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:45,421::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135793::DEBUG::2014-10-29 11:11:45,425::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135793::DEBUG::2014-10-29 11:11:45,427::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:11:46,074::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:46,075::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:46,080::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-179::DEBUG::2014-10-29 11:11:46,082::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:11:46,082::__init__::232::IOProcess::(_processLogs) (200137) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:46,102::__init__::232::IOProcess::(_processLogs) (200137) Queuing response >Thread-179::DEBUG::2014-10-29 11:11:46,106::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000677888 s, 549 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:11:46,110::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:46,112::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:46,113::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:46,115::__init__::232::IOProcess::(_processLogs) (200138) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:46,121::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200138) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:46,151::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:46,152::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:46,157::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-10269::DEBUG::2014-10-29 11:11:46,159::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:11:46,159::__init__::232::IOProcess::(_processLogs) (200139) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:46,175::__init__::232::IOProcess::(_processLogs) (200139) Queuing response >Thread-10269::DEBUG::2014-10-29 11:11:46,179::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000600509 s, 836 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:11:46,184::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:46,190::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:46,193::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:46,194::__init__::232::IOProcess::(_processLogs) (200140) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:46,196::__init__::232::IOProcess::(_processLogs) (200140) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:46,454::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:46,456::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:46,461::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:46,464::__init__::232::IOProcess::(_processLogs) (200141) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:11:46,464::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:11:46,480::__init__::232::IOProcess::(_processLogs) (200141) Queuing response >Thread-178::DEBUG::2014-10-29 11:11:46,486::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000562959 s, 902 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:11:46,491::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:46,492::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:46,494::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:46,495::__init__::232::IOProcess::(_processLogs) (200142) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:46,501::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200142) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:46,506::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:46,508::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:46,509::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:46,510::__init__::232::IOProcess::(_processLogs) (200143) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:46,519::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200143) Queuing response >Thread-33::DEBUG::2014-10-29 11:11:46,521::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:11:46,523::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:46,543::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-33::DEBUG::2014-10-29 11:11:46,544::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000578493 s, 842 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:11:46,547::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:46,549::__init__::232::IOProcess::(_processLogs) (200144) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:46,551::__init__::232::IOProcess::(_processLogs) (200144) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:46,556::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:46,557::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:46,559::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:46,560::__init__::232::IOProcess::(_processLogs) (200145) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:46,567::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200145) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:46,571::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:46,573::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:46,574::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:46,576::__init__::232::IOProcess::(_processLogs) (200146) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:46,577::__init__::232::IOProcess::(_processLogs) (200146) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:46,581::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:46,583::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:46,585::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:46,586::__init__::232::IOProcess::(_processLogs) (200147) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:46,587::__init__::232::IOProcess::(_processLogs) (200147) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:46,590::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:46,592::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:46,593::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:46,595::__init__::232::IOProcess::(_processLogs) (200148) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:46,596::__init__::232::IOProcess::(_processLogs) (200148) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:46,604::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:46,606::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:46,607::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:46,609::__init__::232::IOProcess::(_processLogs) (200149) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:46,610::__init__::232::IOProcess::(_processLogs) (200149) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:46,613::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:46,614::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:46,615::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:46,617::__init__::232::IOProcess::(_processLogs) (200150) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:46,620::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200150) Queuing response >Thread-22::DEBUG::2014-10-29 11:11:47,182::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d87322c-30e5-4687-9a73-1bee7dea9e6b`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:11:47,182::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:11:47,183::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:47,183::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:47,184::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:47,184::__init__::232::IOProcess::(_processLogs) (200151) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:11:47,184::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200151) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:47,186::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:47,186::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:47,187::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:47,187::__init__::232::IOProcess::(_processLogs) (200152) Got request for method 'stat' >Thread-22::INFO::2014-10-29 11:11:47,188::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010863616', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:11:47,188::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200152) Queuing response >Thread-22::DEBUG::2014-10-29 11:11:47,189::task::1191::Storage.TaskManager.Task::(prepare) Task=`9d87322c-30e5-4687-9a73-1bee7dea9e6b`::finished: {'truesize': '6010863616', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:11:47,190::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d87322c-30e5-4687-9a73-1bee7dea9e6b`::moving from state preparing -> state finished >Thread-22::DEBUG::2014-10-29 11:11:47,191::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-10-29 11:11:47,191::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2014-10-29 11:11:47,191::task::993::Storage.TaskManager.Task::(_decref) Task=`9d87322c-30e5-4687-9a73-1bee7dea9e6b`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:11:47,268::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:48,452::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:48,455::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135794::DEBUG::2014-10-29 11:11:48,459::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:48,462::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:48,464::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135795::DEBUG::2014-10-29 11:11:48,467::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135795::DEBUG::2014-10-29 11:11:48,469::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:49,374::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:49,375::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:49,377::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:11:49,705::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54090 >Detector thread::DEBUG::2014-10-29 11:11:49,706::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54090 >Detector thread::DEBUG::2014-10-29 11:11:49,706::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54090 >Detector thread::DEBUG::2014-10-29 11:11:49,707::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54090) >Thread-135796::DEBUG::2014-10-29 11:11:49,745::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135796::DEBUG::2014-10-29 11:11:49,746::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135796::DEBUG::2014-10-29 11:11:49,747::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.81', 'elapsedTime': '513742', 'displayType': 'vnc', 'cpuSys': '0.66', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '15964534', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '63520', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '33898.43'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.48', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:11:50,101::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54092 >Detector thread::DEBUG::2014-10-29 11:11:50,102::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54092 >Detector thread::DEBUG::2014-10-29 11:11:50,102::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54092 >Detector thread::DEBUG::2014-10-29 11:11:50,102::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54092) >Thread-135797::DEBUG::2014-10-29 11:11:50,141::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135797::DEBUG::2014-10-29 11:11:50,143::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135797::DEBUG::2014-10-29 11:11:50,162::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135797::DEBUG::2014-10-29 11:11:50,210::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '120', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '20', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:11:50,356::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54093 >Detector thread::DEBUG::2014-10-29 11:11:50,357::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54093 >Detector thread::DEBUG::2014-10-29 11:11:50,357::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54093 >Detector thread::DEBUG::2014-10-29 11:11:50,357::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54093) >Thread-135798::DEBUG::2014-10-29 11:11:50,397::task::595::Storage.TaskManager.Task::(_updateState) Task=`61ccecd8-3641-4482-a809-5f6cefbb2585`::moving from state init -> state preparing >Thread-135798::INFO::2014-10-29 11:11:50,397::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135798::INFO::2014-10-29 11:11:50,398::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000562959', 'lastCheck': '3.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000578493', 'lastCheck': '3.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677888', 'lastCheck': '4.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000600509', 'lastCheck': '4.2', 'valid': True}} >Thread-135798::DEBUG::2014-10-29 11:11:50,398::task::1191::Storage.TaskManager.Task::(prepare) Task=`61ccecd8-3641-4482-a809-5f6cefbb2585`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000562959', 'lastCheck': '3.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000578493', 'lastCheck': '3.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677888', 'lastCheck': '4.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000600509', 'lastCheck': '4.2', 'valid': True}} >Thread-135798::DEBUG::2014-10-29 11:11:50,399::task::595::Storage.TaskManager.Task::(_updateState) Task=`61ccecd8-3641-4482-a809-5f6cefbb2585`::moving from state preparing -> state finished >Thread-135798::DEBUG::2014-10-29 11:11:50,399::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135798::DEBUG::2014-10-29 11:11:50,399::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135798::DEBUG::2014-10-29 11:11:50,400::task::993::Storage.TaskManager.Task::(_decref) Task=`61ccecd8-3641-4482-a809-5f6cefbb2585`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:51,483::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:51,485::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135799::DEBUG::2014-10-29 11:11:51,489::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:51,491::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:51,493::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135800::DEBUG::2014-10-29 11:11:51,495::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135800::DEBUG::2014-10-29 11:11:51,498::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:54,385::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:54,388::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:54,392::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:54,513::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:54,517::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135801::DEBUG::2014-10-29 11:11:54,521::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:54,523::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:54,525::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135802::DEBUG::2014-10-29 11:11:54,528::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135802::DEBUG::2014-10-29 11:11:54,531::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:11:54,774::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54095 >Detector thread::DEBUG::2014-10-29 11:11:54,775::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54095 >Detector thread::DEBUG::2014-10-29 11:11:54,775::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54095 >Detector thread::DEBUG::2014-10-29 11:11:54,776::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54095) >Thread-135803::DEBUG::2014-10-29 11:11:54,815::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135803::DEBUG::2014-10-29 11:11:54,816::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad4a2833-3419-4d87-b513-17551af209c5`::moving from state init -> state preparing >Thread-135803::INFO::2014-10-29 11:11:54,816::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135803::DEBUG::2014-10-29 11:11:54,821::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:11:54,821::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:54,822::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:54,822::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:54,823::__init__::232::IOProcess::(_processLogs) (200153) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:54,824::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200153) Queuing response >Thread-135803::DEBUG::2014-10-29 11:11:54,825::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135803::DEBUG::2014-10-29 11:11:54,826::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135803::INFO::2014-10-29 11:11:54,826::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135803::DEBUG::2014-10-29 11:11:54,826::task::1191::Storage.TaskManager.Task::(prepare) Task=`ad4a2833-3419-4d87-b513-17551af209c5`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135803::DEBUG::2014-10-29 11:11:54,827::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad4a2833-3419-4d87-b513-17551af209c5`::moving from state preparing -> state finished >Thread-135803::DEBUG::2014-10-29 11:11:54,827::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135803::DEBUG::2014-10-29 11:11:54,827::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135803::DEBUG::2014-10-29 11:11:54,827::task::993::Storage.TaskManager.Task::(_decref) Task=`ad4a2833-3419-4d87-b513-17551af209c5`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:11:54,871::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54096 >Detector thread::DEBUG::2014-10-29 11:11:54,872::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54096 >Detector thread::DEBUG::2014-10-29 11:11:54,872::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54096 >Detector thread::DEBUG::2014-10-29 11:11:54,872::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54096) >Thread-135804::DEBUG::2014-10-29 11:11:54,911::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135804::DEBUG::2014-10-29 11:11:54,912::task::595::Storage.TaskManager.Task::(_updateState) Task=`ee8025f4-fb25-43d4-b9c9-8a0e7864bff4`::moving from state init -> state preparing >Thread-135804::INFO::2014-10-29 11:11:54,912::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135804::DEBUG::2014-10-29 11:11:54,912::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135804::DEBUG::2014-10-29 11:11:54,913::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135804::DEBUG::2014-10-29 11:11:54,913::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135804::DEBUG::2014-10-29 11:11:54,913::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135804::DEBUG::2014-10-29 11:11:54,913::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135804::DEBUG::2014-10-29 11:11:54,914::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135804::DEBUG::2014-10-29 11:11:55,003::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135804::DEBUG::2014-10-29 11:11:55,004::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135804::DEBUG::2014-10-29 11:11:55,189::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135804::DEBUG::2014-10-29 11:11:55,190::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135804::DEBUG::2014-10-29 11:11:55,190::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135804::DEBUG::2014-10-29 11:11:55,191::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135804::DEBUG::2014-10-29 11:11:55,191::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135804::DEBUG::2014-10-29 11:11:55,192::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135804::DEBUG::2014-10-29 11:11:55,192::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135804::DEBUG::2014-10-29 11:11:55,192::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:11:55,197::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:55,198::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:55,198::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:55,200::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200154) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:55,204::__init__::232::IOProcess::(_processLogs) (200154) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:55,206::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:55,207::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:55,209::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:55,211::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:55,213::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:55,214::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:55,216::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:55,218::__init__::232::IOProcess::(_processLogs) (200155) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:55,219::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-135804::DEBUG::2014-10-29 11:11:55,219::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:11:55,220::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:55,221::__init__::232::IOProcess::(_processLogs) (200156) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:55,222::__init__::232::IOProcess::(_processLogs) (200157) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:11:55,222::__init__::232::IOProcess::(_processLogs) (200155) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:55,222::__init__::232::IOProcess::(_processLogs) (200156) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:55,222::__init__::232::IOProcess::(_processLogs) (200157) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:55,225::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:55,226::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:55,226::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:55,226::__init__::232::IOProcess::(_processLogs) (200158) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:11:55,227::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200158) Queuing response >Thread-135804::DEBUG::2014-10-29 11:11:55,227::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:11:55,230::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:55,230::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:55,230::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:55,230::__init__::232::IOProcess::(_processLogs) (200159) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:11:55,231::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200159) Queuing response >Thread-135804::DEBUG::2014-10-29 11:11:55,232::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:11:55,233::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:55,234::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:55,235::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:55,235::__init__::232::IOProcess::(_processLogs) (200160) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:55,235::__init__::232::IOProcess::(_processLogs) (200160) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:55,235::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:55,236::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:55,236::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:55,236::__init__::232::IOProcess::(_processLogs) (200161) Got request for method 'glob' >Thread-135804::DEBUG::2014-10-29 11:11:55,237::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:11:55,237::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200161) Queuing response >Thread-135804::INFO::2014-10-29 11:11:55,238::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135804::INFO::2014-10-29 11:11:55,239::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135804::INFO::2014-10-29 11:11:55,239::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:11:55,240::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:55,241::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:55,241::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:55,241::__init__::232::IOProcess::(_processLogs) (200162) Got request for method 'readfile' >Thread-135804::DEBUG::2014-10-29 11:11:55,242::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:11:55,242::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200162) Queuing response >Thread-135804::DEBUG::2014-10-29 11:11:55,245::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`13cf4e40-9344-423d-919e-6136d71f5f67`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135804::DEBUG::2014-10-29 11:11:55,245::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135804::DEBUG::2014-10-29 11:11:55,245::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135804::DEBUG::2014-10-29 11:11:55,246::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`13cf4e40-9344-423d-919e-6136d71f5f67`::Granted request >Thread-135804::DEBUG::2014-10-29 11:11:55,246::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ee8025f4-fb25-43d4-b9c9-8a0e7864bff4`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135804::DEBUG::2014-10-29 11:11:55,247::task::993::Storage.TaskManager.Task::(_decref) Task=`ee8025f4-fb25-43d4-b9c9-8a0e7864bff4`::ref 1 aborting False >Thread-135804::INFO::2014-10-29 11:11:55,249::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135804::DEBUG::2014-10-29 11:11:55,250::task::1191::Storage.TaskManager.Task::(prepare) Task=`ee8025f4-fb25-43d4-b9c9-8a0e7864bff4`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135804::DEBUG::2014-10-29 11:11:55,250::task::595::Storage.TaskManager.Task::(_updateState) Task=`ee8025f4-fb25-43d4-b9c9-8a0e7864bff4`::moving from state preparing -> state finished >Thread-135804::DEBUG::2014-10-29 11:11:55,250::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135804::DEBUG::2014-10-29 11:11:55,250::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135804::DEBUG::2014-10-29 11:11:55,251::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135804::DEBUG::2014-10-29 11:11:55,251::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135804::DEBUG::2014-10-29 11:11:55,251::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135804::DEBUG::2014-10-29 11:11:55,252::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135804::DEBUG::2014-10-29 11:11:55,252::task::993::Storage.TaskManager.Task::(_decref) Task=`ee8025f4-fb25-43d4-b9c9-8a0e7864bff4`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:11:55,275::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54097 >Detector thread::DEBUG::2014-10-29 11:11:55,275::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54097 >Detector thread::DEBUG::2014-10-29 11:11:55,275::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54097 >Detector thread::DEBUG::2014-10-29 11:11:55,276::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54097) >Thread-135809::DEBUG::2014-10-29 11:11:55,315::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135809::DEBUG::2014-10-29 11:11:55,316::task::595::Storage.TaskManager.Task::(_updateState) Task=`91c3a300-dce2-4064-a100-90ad95450075`::moving from state init -> state preparing >Thread-135809::INFO::2014-10-29 11:11:55,316::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135809::INFO::2014-10-29 11:11:55,317::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000562959', 'lastCheck': '8.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000578493', 'lastCheck': '8.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677888', 'lastCheck': '9.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000600509', 'lastCheck': '9.1', 'valid': True}} >Thread-135809::DEBUG::2014-10-29 11:11:55,317::task::1191::Storage.TaskManager.Task::(prepare) Task=`91c3a300-dce2-4064-a100-90ad95450075`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000562959', 'lastCheck': '8.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000578493', 'lastCheck': '8.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677888', 'lastCheck': '9.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000600509', 'lastCheck': '9.1', 'valid': True}} >Thread-135809::DEBUG::2014-10-29 11:11:55,317::task::595::Storage.TaskManager.Task::(_updateState) Task=`91c3a300-dce2-4064-a100-90ad95450075`::moving from state preparing -> state finished >Thread-135809::DEBUG::2014-10-29 11:11:55,317::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135809::DEBUG::2014-10-29 11:11:55,318::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135809::DEBUG::2014-10-29 11:11:55,318::task::993::Storage.TaskManager.Task::(_decref) Task=`91c3a300-dce2-4064-a100-90ad95450075`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:11:56,126::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:56,126::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:56,126::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:56,127::__init__::232::IOProcess::(_processLogs) (200163) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:56,127::__init__::232::IOProcess::(_processLogs) (200163) Queuing response >Thread-179::DEBUG::2014-10-29 11:11:56,128::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:11:56,146::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00047318 s, 786 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:11:56,147::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:56,148::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:56,148::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:56,148::__init__::232::IOProcess::(_processLogs) (200164) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:56,150::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200164) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:56,193::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:56,194::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:56,194::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:56,194::__init__::232::IOProcess::(_processLogs) (200165) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:56,195::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200165) Queuing response >Thread-10269::DEBUG::2014-10-29 11:11:56,197::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:11:56,214::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000491842 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:11:56,216::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:56,216::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:56,217::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:56,217::__init__::232::IOProcess::(_processLogs) (200166) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:56,217::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200166) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:56,605::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:56,605::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:56,606::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:56,608::__init__::232::IOProcess::(_processLogs) (200167) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:11:56,608::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:11:56,609::__init__::232::IOProcess::(_processLogs) (200167) Queuing response >Thread-178::DEBUG::2014-10-29 11:11:56,631::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000893425 s, 569 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:11:56,633::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:56,634::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:56,634::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:56,635::__init__::232::IOProcess::(_processLogs) (200168) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:56,636::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200168) Queuing response >Thread-33::DEBUG::2014-10-29 11:11:56,638::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:11:56,638::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:56,657::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:56,661::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-33::DEBUG::2014-10-29 11:11:56,662::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000502377 s, 969 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:11:56,663::__init__::232::IOProcess::(_processLogs) (200169) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:56,664::__init__::232::IOProcess::(_processLogs) (200169) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:56,666::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:56,666::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:56,667::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:56,667::__init__::232::IOProcess::(_processLogs) (200170) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:56,667::__init__::232::IOProcess::(_processLogs) (200170) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:56,667::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:56,668::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:56,668::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:56,668::__init__::232::IOProcess::(_processLogs) (200171) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:11:56,669::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200171) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:56,671::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:56,672::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:56,672::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:56,672::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:56,673::__init__::232::IOProcess::(_processLogs) (200172) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:56,673::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:56,675::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200172) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:56,676::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:56,676::__init__::232::IOProcess::(_processLogs) (200173) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:56,676::__init__::232::IOProcess::(_processLogs) (200173) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:56,677::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:56,677::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:56,677::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:56,678::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:56,679::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:56,679::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:56,681::__init__::232::IOProcess::(_processLogs) (200174) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:56,681::__init__::232::IOProcess::(_processLogs) (200175) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:56,681::__init__::232::IOProcess::(_processLogs) (200174) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:56,681::__init__::232::IOProcess::(_processLogs) (200175) Queuing response >Thread-17::DEBUG::2014-10-29 11:11:56,683::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:11:56,683::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:11:56,684::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:11:56,685::__init__::232::IOProcess::(_processLogs) (200176) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:11:56,686::__init__::232::IOProcess::(_processLogs) (200176) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:57,553::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:57,555::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135810::DEBUG::2014-10-29 11:11:57,559::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ff60b95-a1e6-4bd8-9488-6006e998e0cb`::moving from state init -> state preparing >Thread-135810::INFO::2014-10-29 11:11:57,560::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135810::INFO::2014-10-29 11:11:57,560::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000893425', 'lastCheck': '0.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502377', 'lastCheck': '0.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047318', 'lastCheck': '1.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000491842', 'lastCheck': '1.3', 'valid': True}} >Thread-135810::DEBUG::2014-10-29 11:11:57,561::task::1191::Storage.TaskManager.Task::(prepare) Task=`2ff60b95-a1e6-4bd8-9488-6006e998e0cb`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000893425', 'lastCheck': '0.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502377', 'lastCheck': '0.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047318', 'lastCheck': '1.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000491842', 'lastCheck': '1.3', 'valid': True}} >Thread-135810::DEBUG::2014-10-29 11:11:57,561::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ff60b95-a1e6-4bd8-9488-6006e998e0cb`::moving from state preparing -> state finished >Thread-135810::DEBUG::2014-10-29 11:11:57,561::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135810::DEBUG::2014-10-29 11:11:57,562::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135810::DEBUG::2014-10-29 11:11:57,562::task::993::Storage.TaskManager.Task::(_decref) Task=`2ff60b95-a1e6-4bd8-9488-6006e998e0cb`::ref 0 aborting False >Thread-135810::DEBUG::2014-10-29 11:11:57,588::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:11:57,611::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:11:57,613::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135811::DEBUG::2014-10-29 11:11:57,616::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135811::DEBUG::2014-10-29 11:11:57,619::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:11:59,261::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54098 >Detector thread::DEBUG::2014-10-29 11:11:59,262::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54098 >Detector thread::DEBUG::2014-10-29 11:11:59,262::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54098 >Detector thread::DEBUG::2014-10-29 11:11:59,263::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54098) >Thread-135812::DEBUG::2014-10-29 11:11:59,301::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135812::DEBUG::2014-10-29 11:11:59,303::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135812::DEBUG::2014-10-29 11:11:59,321::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135812::DEBUG::2014-10-29 11:11:59,368::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '4', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '4', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:59,399::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:59,400::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:11:59,401::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:11:59,897::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54099 >Detector thread::DEBUG::2014-10-29 11:11:59,897::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54099 >Detector thread::DEBUG::2014-10-29 11:11:59,898::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54099 >Detector thread::DEBUG::2014-10-29 11:11:59,898::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54099) >Thread-135813::DEBUG::2014-10-29 11:11:59,938::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135813::DEBUG::2014-10-29 11:11:59,939::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135813::DEBUG::2014-10-29 11:11:59,939::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.81', 'elapsedTime': '513752', 'displayType': 'vnc', 'cpuSys': '0.66', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '15964534', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '63520', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '33898.43'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.67', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:00,666::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:00,669::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135814::DEBUG::2014-10-29 11:12:00,672::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:00,675::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:00,676::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135815::DEBUG::2014-10-29 11:12:00,679::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135815::DEBUG::2014-10-29 11:12:00,682::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:12:00,855::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54101 >Detector thread::DEBUG::2014-10-29 11:12:00,855::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54101 >Detector thread::DEBUG::2014-10-29 11:12:00,855::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54101 >Detector thread::DEBUG::2014-10-29 11:12:00,856::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54101) >Thread-135816::DEBUG::2014-10-29 11:12:00,896::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8187125-798b-4a68-b753-77d8e7b157c2`::moving from state init -> state preparing >Thread-135816::INFO::2014-10-29 11:12:00,896::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135816::INFO::2014-10-29 11:12:00,897::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000893425', 'lastCheck': '4.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502377', 'lastCheck': '4.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047318', 'lastCheck': '4.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000491842', 'lastCheck': '4.7', 'valid': True}} >Thread-135816::DEBUG::2014-10-29 11:12:00,897::task::1191::Storage.TaskManager.Task::(prepare) Task=`d8187125-798b-4a68-b753-77d8e7b157c2`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000893425', 'lastCheck': '4.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502377', 'lastCheck': '4.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047318', 'lastCheck': '4.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000491842', 'lastCheck': '4.7', 'valid': True}} >Thread-135816::DEBUG::2014-10-29 11:12:00,897::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8187125-798b-4a68-b753-77d8e7b157c2`::moving from state preparing -> state finished >Thread-135816::DEBUG::2014-10-29 11:12:00,898::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135816::DEBUG::2014-10-29 11:12:00,898::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135816::DEBUG::2014-10-29 11:12:00,898::task::993::Storage.TaskManager.Task::(_decref) Task=`d8187125-798b-4a68-b753-77d8e7b157c2`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:12:02,289::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >VM Channels Listener::DEBUG::2014-10-29 11:12:03,502::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:03,699::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:03,702::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135817::DEBUG::2014-10-29 11:12:03,706::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:03,709::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:03,711::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135818::DEBUG::2014-10-29 11:12:03,714::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135818::DEBUG::2014-10-29 11:12:03,717::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:04,408::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:04,410::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:04,412::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:12:05,900::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54103 >Detector thread::DEBUG::2014-10-29 11:12:05,901::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54103 >Detector thread::DEBUG::2014-10-29 11:12:05,901::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54103 >Detector thread::DEBUG::2014-10-29 11:12:05,901::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54103) >Thread-135819::DEBUG::2014-10-29 11:12:05,941::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135819::DEBUG::2014-10-29 11:12:05,942::task::595::Storage.TaskManager.Task::(_updateState) Task=`a8ee25ec-2a65-4e13-bbe7-1c9603495535`::moving from state init -> state preparing >Thread-135819::INFO::2014-10-29 11:12:05,942::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135819::DEBUG::2014-10-29 11:12:05,945::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:12:05,946::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:05,946::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:05,947::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:05,947::__init__::232::IOProcess::(_processLogs) (200177) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:05,948::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200177) Queuing response >Thread-135819::DEBUG::2014-10-29 11:12:05,949::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135819::DEBUG::2014-10-29 11:12:05,950::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135819::INFO::2014-10-29 11:12:05,950::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135819::DEBUG::2014-10-29 11:12:05,950::task::1191::Storage.TaskManager.Task::(prepare) Task=`a8ee25ec-2a65-4e13-bbe7-1c9603495535`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135819::DEBUG::2014-10-29 11:12:05,950::task::595::Storage.TaskManager.Task::(_updateState) Task=`a8ee25ec-2a65-4e13-bbe7-1c9603495535`::moving from state preparing -> state finished >Thread-135819::DEBUG::2014-10-29 11:12:05,951::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135819::DEBUG::2014-10-29 11:12:05,951::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135819::DEBUG::2014-10-29 11:12:05,951::task::993::Storage.TaskManager.Task::(_decref) Task=`a8ee25ec-2a65-4e13-bbe7-1c9603495535`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:12:05,995::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54104 >Detector thread::DEBUG::2014-10-29 11:12:05,995::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54104 >Detector thread::DEBUG::2014-10-29 11:12:05,996::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54104 >Detector thread::DEBUG::2014-10-29 11:12:05,996::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54104) >Thread-135820::DEBUG::2014-10-29 11:12:06,035::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135820::DEBUG::2014-10-29 11:12:06,036::task::595::Storage.TaskManager.Task::(_updateState) Task=`7cd05102-ecb6-4b54-9860-6aa1392d695f`::moving from state init -> state preparing >Thread-135820::INFO::2014-10-29 11:12:06,036::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135820::DEBUG::2014-10-29 11:12:06,037::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135820::DEBUG::2014-10-29 11:12:06,037::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135820::DEBUG::2014-10-29 11:12:06,037::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135820::DEBUG::2014-10-29 11:12:06,037::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135820::DEBUG::2014-10-29 11:12:06,038::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135820::DEBUG::2014-10-29 11:12:06,038::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135820::DEBUG::2014-10-29 11:12:06,133::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135820::DEBUG::2014-10-29 11:12:06,134::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-17::DEBUG::2014-10-29 11:12:06,155::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:06,156::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:06,156::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:06,156::__init__::232::IOProcess::(_processLogs) (200178) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:06,159::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200178) Queuing response >Thread-179::DEBUG::2014-10-29 11:12:06,160::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:12:06,179::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000517449 s, 719 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:12:06,181::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:06,182::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:06,183::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:06,185::__init__::232::IOProcess::(_processLogs) (200179) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:06,185::__init__::232::IOProcess::(_processLogs) (200179) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:06,222::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:06,222::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:06,222::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:06,223::__init__::232::IOProcess::(_processLogs) (200180) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:06,223::__init__::232::IOProcess::(_processLogs) (200180) Queuing response >Thread-10269::DEBUG::2014-10-29 11:12:06,224::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:12:06,244::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000510115 s, 984 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:12:06,246::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:06,247::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:06,247::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:06,247::__init__::232::IOProcess::(_processLogs) (200181) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:06,249::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200181) Queuing response >Thread-135820::DEBUG::2014-10-29 11:12:06,303::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135820::DEBUG::2014-10-29 11:12:06,305::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135820::DEBUG::2014-10-29 11:12:06,305::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135820::DEBUG::2014-10-29 11:12:06,305::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135820::DEBUG::2014-10-29 11:12:06,306::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135820::DEBUG::2014-10-29 11:12:06,306::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135820::DEBUG::2014-10-29 11:12:06,306::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135820::DEBUG::2014-10-29 11:12:06,307::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:12:06,315::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:06,317::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:06,318::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:06,319::__init__::232::IOProcess::(_processLogs) (200182) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:06,320::__init__::232::IOProcess::(_processLogs) (200182) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:06,320::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:06,321::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:06,323::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:06,325::__init__::232::IOProcess::(_processLogs) (200183) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:06,327::__init__::232::IOProcess::(_processLogs) (200183) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:06,329::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:06,331::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:06,332::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-135820::DEBUG::2014-10-29 11:12:06,334::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:12:06,337::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200184) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:06,337::__init__::232::IOProcess::(_processLogs) (200184) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:06,338::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:06,338::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:06,339::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:06,339::__init__::232::IOProcess::(_processLogs) (200185) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:06,339::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:06,339::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:06,340::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:06,340::__init__::232::IOProcess::(_processLogs) (200186) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:12:06,341::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200185) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:06,347::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200186) Queuing response >Thread-135820::DEBUG::2014-10-29 11:12:06,348::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:12:06,349::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:06,349::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:06,349::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:06,349::__init__::232::IOProcess::(_processLogs) (200187) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:12:06,350::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200187) Queuing response >Thread-135820::DEBUG::2014-10-29 11:12:06,350::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:12:06,352::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:06,353::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:06,354::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:06,354::__init__::232::IOProcess::(_processLogs) (200188) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:06,355::__init__::232::IOProcess::(_processLogs) (200188) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:06,355::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:06,355::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:06,356::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:06,356::__init__::232::IOProcess::(_processLogs) (200189) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:06,357::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200189) Queuing response >Thread-135820::DEBUG::2014-10-29 11:12:06,358::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-135820::INFO::2014-10-29 11:12:06,358::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135820::INFO::2014-10-29 11:12:06,358::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135820::INFO::2014-10-29 11:12:06,358::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:12:06,359::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:06,360::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:06,360::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:06,360::__init__::232::IOProcess::(_processLogs) (200190) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:12:06,362::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200190) Queuing response >Thread-135820::DEBUG::2014-10-29 11:12:06,363::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135820::DEBUG::2014-10-29 11:12:06,364::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`5d37ebb9-abd1-4f33-bb1e-f41b8e5d2770`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135820::DEBUG::2014-10-29 11:12:06,365::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135820::DEBUG::2014-10-29 11:12:06,365::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135820::DEBUG::2014-10-29 11:12:06,365::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`5d37ebb9-abd1-4f33-bb1e-f41b8e5d2770`::Granted request >Thread-135820::DEBUG::2014-10-29 11:12:06,366::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7cd05102-ecb6-4b54-9860-6aa1392d695f`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135820::DEBUG::2014-10-29 11:12:06,366::task::993::Storage.TaskManager.Task::(_decref) Task=`7cd05102-ecb6-4b54-9860-6aa1392d695f`::ref 1 aborting False >Thread-135820::INFO::2014-10-29 11:12:06,369::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135820::DEBUG::2014-10-29 11:12:06,369::task::1191::Storage.TaskManager.Task::(prepare) Task=`7cd05102-ecb6-4b54-9860-6aa1392d695f`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135820::DEBUG::2014-10-29 11:12:06,370::task::595::Storage.TaskManager.Task::(_updateState) Task=`7cd05102-ecb6-4b54-9860-6aa1392d695f`::moving from state preparing -> state finished >Thread-135820::DEBUG::2014-10-29 11:12:06,370::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135820::DEBUG::2014-10-29 11:12:06,370::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135820::DEBUG::2014-10-29 11:12:06,371::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135820::DEBUG::2014-10-29 11:12:06,371::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135820::DEBUG::2014-10-29 11:12:06,371::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135820::DEBUG::2014-10-29 11:12:06,371::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135820::DEBUG::2014-10-29 11:12:06,372::task::993::Storage.TaskManager.Task::(_decref) Task=`7cd05102-ecb6-4b54-9860-6aa1392d695f`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:12:06,405::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54105 >Detector thread::DEBUG::2014-10-29 11:12:06,405::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54105 >Detector thread::DEBUG::2014-10-29 11:12:06,406::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54105 >Detector thread::DEBUG::2014-10-29 11:12:06,406::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54105) >Thread-135825::DEBUG::2014-10-29 11:12:06,445::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135825::DEBUG::2014-10-29 11:12:06,446::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e076679-a0ad-412b-8647-2eee98062847`::moving from state init -> state preparing >Thread-135825::INFO::2014-10-29 11:12:06,446::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135825::INFO::2014-10-29 11:12:06,447::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000893425', 'lastCheck': '9.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502377', 'lastCheck': '9.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517449', 'lastCheck': '0.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000510115', 'lastCheck': '0.2', 'valid': True}} >Thread-135825::DEBUG::2014-10-29 11:12:06,447::task::1191::Storage.TaskManager.Task::(prepare) Task=`0e076679-a0ad-412b-8647-2eee98062847`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000893425', 'lastCheck': '9.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502377', 'lastCheck': '9.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517449', 'lastCheck': '0.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000510115', 'lastCheck': '0.2', 'valid': True}} >Thread-135825::DEBUG::2014-10-29 11:12:06,447::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e076679-a0ad-412b-8647-2eee98062847`::moving from state preparing -> state finished >Thread-135825::DEBUG::2014-10-29 11:12:06,448::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135825::DEBUG::2014-10-29 11:12:06,448::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135825::DEBUG::2014-10-29 11:12:06,448::task::993::Storage.TaskManager.Task::(_decref) Task=`0e076679-a0ad-412b-8647-2eee98062847`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:12:06,681::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:06,682::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:06,683::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:06,683::__init__::232::IOProcess::(_processLogs) (200191) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:06,684::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200191) Queuing response >Thread-178::DEBUG::2014-10-29 11:12:06,686::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:12:06,705::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:06,707::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:06,709::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-33::DEBUG::2014-10-29 11:12:06,710::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:12:06,712::__init__::232::IOProcess::(_processLogs) (200192) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:06,732::__init__::232::IOProcess::(_processLogs) (200192) Queuing response >Thread-178::DEBUG::2014-10-29 11:12:06,734::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000473702 s, 1.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:06,736::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-33::DEBUG::2014-10-29 11:12:06,736::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000466491 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:12:06,744::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >JsonRpcServer::DEBUG::2014-10-29 11:12:06,746::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:12:06,748::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:06,751::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:06,753::__init__::232::IOProcess::(_processLogs) (200193) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:06,754::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200193) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:06,756::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-135826::DEBUG::2014-10-29 11:12:06,758::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:12:06,759::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:06,759::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:06,760::__init__::232::IOProcess::(_processLogs) (200194) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:06,761::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200194) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:06,766::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:06,767::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:06,767::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:06,767::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:06,768::__init__::232::IOProcess::(_processLogs) Extracting request information... >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:06,769::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-17::DEBUG::2014-10-29 11:12:06,769::__init__::232::IOProcess::(_processLogs) (200195) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:06,773::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200195) Queuing response >JsonRpcServer::DEBUG::2014-10-29 11:12:06,774::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:12:06,776::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:06,778::__init__::232::IOProcess::(_processLogs) (200196) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:06,780::__init__::232::IOProcess::(_processLogs) (200196) Queuing response >Thread-135827::DEBUG::2014-10-29 11:12:06,785::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:12:06,788::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:06,790::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:06,794::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:06,796::__init__::232::IOProcess::(_processLogs) (200197) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:06,797::__init__::232::IOProcess::(_processLogs) (200197) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:06,799::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:06,801::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:06,803::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:06,804::__init__::232::IOProcess::(_processLogs) (200198) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:06,808::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200198) Queuing response >Thread-135827::DEBUG::2014-10-29 11:12:06,808::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:12:06,810::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:06,813::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:06,813::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:06,814::__init__::232::IOProcess::(_processLogs) (200199) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:06,815::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200199) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:06,815::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:06,816::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:06,818::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:06,818::__init__::232::IOProcess::(_processLogs) (200200) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:06,819::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200200) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:09,416::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:09,418::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:12:09,418::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54106 >Detector thread::DEBUG::2014-10-29 11:12:09,422::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54106 >Detector thread::DEBUG::2014-10-29 11:12:09,424::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54106 >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:09,425::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:12:09,426::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54106) >Thread-135828::DEBUG::2014-10-29 11:12:09,459::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135828::DEBUG::2014-10-29 11:12:09,461::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135828::DEBUG::2014-10-29 11:12:09,481::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135828::DEBUG::2014-10-29 11:12:09,530::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '188', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '88', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:09,827::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:09,830::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135829::DEBUG::2014-10-29 11:12:09,834::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:09,836::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:09,839::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135830::DEBUG::2014-10-29 11:12:09,842::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135830::DEBUG::2014-10-29 11:12:09,844::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:12:10,099::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54107 >Detector thread::DEBUG::2014-10-29 11:12:10,100::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54107 >Detector thread::DEBUG::2014-10-29 11:12:10,100::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54107 >Detector thread::DEBUG::2014-10-29 11:12:10,101::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54107) >Thread-135831::DEBUG::2014-10-29 11:12:10,139::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135831::DEBUG::2014-10-29 11:12:10,140::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135831::DEBUG::2014-10-29 11:12:10,141::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.00', 'elapsedTime': '513762', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '15964534', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '63520', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '33898.43'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.85', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:12:10,960::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54109 >Detector thread::DEBUG::2014-10-29 11:12:10,961::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54109 >Detector thread::DEBUG::2014-10-29 11:12:10,961::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54109 >Detector thread::DEBUG::2014-10-29 11:12:10,961::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54109) >Thread-135832::DEBUG::2014-10-29 11:12:11,002::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8db9db6-bcd0-48d0-a01f-91ab0d3cfe19`::moving from state init -> state preparing >Thread-135832::INFO::2014-10-29 11:12:11,002::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135832::INFO::2014-10-29 11:12:11,003::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473702', 'lastCheck': '4.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466491', 'lastCheck': '4.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517449', 'lastCheck': '4.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000510115', 'lastCheck': '4.8', 'valid': True}} >Thread-135832::DEBUG::2014-10-29 11:12:11,003::task::1191::Storage.TaskManager.Task::(prepare) Task=`f8db9db6-bcd0-48d0-a01f-91ab0d3cfe19`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473702', 'lastCheck': '4.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466491', 'lastCheck': '4.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517449', 'lastCheck': '4.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000510115', 'lastCheck': '4.8', 'valid': True}} >Thread-135832::DEBUG::2014-10-29 11:12:11,004::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8db9db6-bcd0-48d0-a01f-91ab0d3cfe19`::moving from state preparing -> state finished >Thread-135832::DEBUG::2014-10-29 11:12:11,004::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135832::DEBUG::2014-10-29 11:12:11,004::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135832::DEBUG::2014-10-29 11:12:11,004::task::993::Storage.TaskManager.Task::(_decref) Task=`f8db9db6-bcd0-48d0-a01f-91ab0d3cfe19`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:12,857::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:12,860::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135833::DEBUG::2014-10-29 11:12:12,863::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c956fac-3e08-42d4-a83f-d1805435432d`::moving from state init -> state preparing >Thread-135833::INFO::2014-10-29 11:12:12,863::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135833::INFO::2014-10-29 11:12:12,864::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473702', 'lastCheck': '6.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466491', 'lastCheck': '6.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517449', 'lastCheck': '6.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000510115', 'lastCheck': '6.6', 'valid': True}} >Thread-135833::DEBUG::2014-10-29 11:12:12,864::task::1191::Storage.TaskManager.Task::(prepare) Task=`1c956fac-3e08-42d4-a83f-d1805435432d`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473702', 'lastCheck': '6.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466491', 'lastCheck': '6.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517449', 'lastCheck': '6.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000510115', 'lastCheck': '6.6', 'valid': True}} >Thread-135833::DEBUG::2014-10-29 11:12:12,865::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c956fac-3e08-42d4-a83f-d1805435432d`::moving from state preparing -> state finished >Thread-135833::DEBUG::2014-10-29 11:12:12,865::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135833::DEBUG::2014-10-29 11:12:12,865::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135833::DEBUG::2014-10-29 11:12:12,865::task::993::Storage.TaskManager.Task::(_decref) Task=`1c956fac-3e08-42d4-a83f-d1805435432d`::ref 0 aborting False >Thread-135833::DEBUG::2014-10-29 11:12:12,885::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:12,907::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:12,909::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135834::DEBUG::2014-10-29 11:12:12,912::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135834::DEBUG::2014-10-29 11:12:12,914::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:14,436::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:14,438::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:14,440::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:15,965::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:15,968::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135835::DEBUG::2014-10-29 11:12:15,971::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:15,974::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:15,976::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135836::DEBUG::2014-10-29 11:12:15,979::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135836::DEBUG::2014-10-29 11:12:15,981::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:12:16,188::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:16,190::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:16,191::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:16,192::__init__::232::IOProcess::(_processLogs) (200201) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:16,197::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200201) Queuing response >Thread-179::DEBUG::2014-10-29 11:12:16,198::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:12:16,232::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.0145504 s, 25.6 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:12:16,236::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:16,238::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:16,243::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:16,246::__init__::232::IOProcess::(_processLogs) (200202) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:16,248::__init__::232::IOProcess::(_processLogs) (200202) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:16,253::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:16,259::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-10269::DEBUG::2014-10-29 11:12:16,261::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:12:16,262::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:16,281::__init__::232::IOProcess::(_processLogs) (200203) Got request for method 'statvfs' >Thread-10269::DEBUG::2014-10-29 11:12:16,284::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00123382 s, 407 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:12:16,285::__init__::232::IOProcess::(_processLogs) (200203) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:16,291::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:16,294::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:16,296::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:16,298::__init__::232::IOProcess::(_processLogs) (200204) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:16,303::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200204) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:16,821::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:16,825::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:16,830::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:16,832::__init__::232::IOProcess::(_processLogs) (200205) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:12:16,832::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:12:16,850::__init__::232::IOProcess::(_processLogs) (200205) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:16,854::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-178::DEBUG::2014-10-29 11:12:16,855::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00132847 s, 382 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:12:16,857::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:16,859::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:16,860::__init__::232::IOProcess::(_processLogs) (200206) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:16,866::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200206) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:16,871::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-33::DEBUG::2014-10-29 11:12:16,872::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:12:16,874::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:16,895::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:16,898::__init__::232::IOProcess::(_processLogs) (200207) Got request for method 'statvfs' >Thread-33::DEBUG::2014-10-29 11:12:16,898::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000945247 s, 515 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:12:16,912::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200207) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:16,918::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:16,920::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:16,923::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:16,933::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200208) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:16,936::__init__::232::IOProcess::(_processLogs) (200208) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:16,941::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:16,944::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:16,946::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:16,949::__init__::232::IOProcess::(_processLogs) (200209) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:16,951::__init__::232::IOProcess::(_processLogs) (200209) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:16,954::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:16,954::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:16,955::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:16,955::__init__::232::IOProcess::(_processLogs) (200210) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:16,956::__init__::232::IOProcess::(_processLogs) (200210) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:16,965::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:16,969::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:16,970::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:16,972::__init__::232::IOProcess::(_processLogs) (200211) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:16,973::__init__::232::IOProcess::(_processLogs) (200211) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:16,979::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:16,980::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:16,981::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:16,983::__init__::232::IOProcess::(_processLogs) (200212) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:16,987::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200212) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:16,989::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:16,991::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:16,992::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:16,994::__init__::232::IOProcess::(_processLogs) (200213) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:16,997::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200213) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:17,001::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:17,003::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:17,004::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:17,008::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200214) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:17,011::__init__::232::IOProcess::(_processLogs) (200214) Queuing response >Detector thread::DEBUG::2014-10-29 11:12:17,032::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54111 >Detector thread::DEBUG::2014-10-29 11:12:17,033::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54111 >Detector thread::DEBUG::2014-10-29 11:12:17,033::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54111 >Detector thread::DEBUG::2014-10-29 11:12:17,034::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54111) >Thread-135837::DEBUG::2014-10-29 11:12:17,074::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135837::DEBUG::2014-10-29 11:12:17,075::task::595::Storage.TaskManager.Task::(_updateState) Task=`39fa3c1e-9bc6-495f-9b9c-b8f2e19cb902`::moving from state init -> state preparing >Thread-135837::INFO::2014-10-29 11:12:17,075::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135837::DEBUG::2014-10-29 11:12:17,079::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:12:17,080::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:17,080::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:17,081::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:17,081::__init__::232::IOProcess::(_processLogs) (200215) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:17,082::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200215) Queuing response >Thread-135837::DEBUG::2014-10-29 11:12:17,082::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135837::DEBUG::2014-10-29 11:12:17,083::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135837::INFO::2014-10-29 11:12:17,084::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135837::DEBUG::2014-10-29 11:12:17,084::task::1191::Storage.TaskManager.Task::(prepare) Task=`39fa3c1e-9bc6-495f-9b9c-b8f2e19cb902`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135837::DEBUG::2014-10-29 11:12:17,084::task::595::Storage.TaskManager.Task::(_updateState) Task=`39fa3c1e-9bc6-495f-9b9c-b8f2e19cb902`::moving from state preparing -> state finished >Thread-135837::DEBUG::2014-10-29 11:12:17,085::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135837::DEBUG::2014-10-29 11:12:17,085::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135837::DEBUG::2014-10-29 11:12:17,085::task::993::Storage.TaskManager.Task::(_decref) Task=`39fa3c1e-9bc6-495f-9b9c-b8f2e19cb902`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:12:17,129::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54112 >Detector thread::DEBUG::2014-10-29 11:12:17,129::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54112 >Detector thread::DEBUG::2014-10-29 11:12:17,130::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54112 >Detector thread::DEBUG::2014-10-29 11:12:17,130::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54112) >Thread-135838::DEBUG::2014-10-29 11:12:17,169::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135838::DEBUG::2014-10-29 11:12:17,169::task::595::Storage.TaskManager.Task::(_updateState) Task=`02740c65-c81c-4851-bf7f-087889903e3b`::moving from state init -> state preparing >Thread-135838::INFO::2014-10-29 11:12:17,170::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135838::DEBUG::2014-10-29 11:12:17,170::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135838::DEBUG::2014-10-29 11:12:17,170::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135838::DEBUG::2014-10-29 11:12:17,171::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135838::DEBUG::2014-10-29 11:12:17,171::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135838::DEBUG::2014-10-29 11:12:17,171::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135838::DEBUG::2014-10-29 11:12:17,172::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135838::DEBUG::2014-10-29 11:12:17,258::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135838::DEBUG::2014-10-29 11:12:17,259::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-22::DEBUG::2014-10-29 11:12:17,315::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-135838::DEBUG::2014-10-29 11:12:17,434::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135838::DEBUG::2014-10-29 11:12:17,435::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135838::DEBUG::2014-10-29 11:12:17,435::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135838::DEBUG::2014-10-29 11:12:17,435::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135838::DEBUG::2014-10-29 11:12:17,436::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135838::DEBUG::2014-10-29 11:12:17,436::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135838::DEBUG::2014-10-29 11:12:17,436::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135838::DEBUG::2014-10-29 11:12:17,437::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:12:17,444::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:17,446::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:17,447::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:17,447::__init__::232::IOProcess::(_processLogs) (200216) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:17,448::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200216) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:17,449::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:17,450::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:17,450::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:17,450::__init__::232::IOProcess::(_processLogs) (200217) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:17,451::__init__::232::IOProcess::(_processLogs) (200217) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:17,452::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:17,454::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:17,456::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:17,458::__init__::232::IOProcess::(_processLogs) (200218) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:17,463::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200218) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:17,465::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-135838::DEBUG::2014-10-29 11:12:17,466::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:12:17,467::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:17,469::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:17,470::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200219) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:17,470::__init__::232::IOProcess::(_processLogs) (200219) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:17,471::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:17,471::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:17,471::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:17,472::__init__::232::IOProcess::(_processLogs) (200220) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:12:17,473::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200220) Queuing response >Thread-135838::DEBUG::2014-10-29 11:12:17,474::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:12:17,475::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:17,476::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:17,476::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:17,476::__init__::232::IOProcess::(_processLogs) (200221) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:12:17,477::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200221) Queuing response >Thread-135838::DEBUG::2014-10-29 11:12:17,477::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:12:17,480::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:17,480::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:17,481::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:17,481::__init__::232::IOProcess::(_processLogs) (200222) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:17,482::__init__::232::IOProcess::(_processLogs) (200222) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:17,482::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:17,482::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:17,483::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:17,483::__init__::232::IOProcess::(_processLogs) (200223) Got request for method 'glob' >Thread-135838::DEBUG::2014-10-29 11:12:17,484::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:12:17,484::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200223) Queuing response >Thread-135838::INFO::2014-10-29 11:12:17,485::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135838::INFO::2014-10-29 11:12:17,486::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135838::INFO::2014-10-29 11:12:17,487::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:12:17,487::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:17,488::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:17,488::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:17,488::__init__::232::IOProcess::(_processLogs) (200224) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:12:17,489::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200224) Queuing response >Thread-135838::DEBUG::2014-10-29 11:12:17,489::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135838::DEBUG::2014-10-29 11:12:17,492::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`7ff58277-a3c9-41d2-b519-2222382b7aab`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135838::DEBUG::2014-10-29 11:12:17,492::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135838::DEBUG::2014-10-29 11:12:17,492::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135838::DEBUG::2014-10-29 11:12:17,493::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`7ff58277-a3c9-41d2-b519-2222382b7aab`::Granted request >Thread-135838::DEBUG::2014-10-29 11:12:17,493::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`02740c65-c81c-4851-bf7f-087889903e3b`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135838::DEBUG::2014-10-29 11:12:17,494::task::993::Storage.TaskManager.Task::(_decref) Task=`02740c65-c81c-4851-bf7f-087889903e3b`::ref 1 aborting False >Thread-135838::INFO::2014-10-29 11:12:17,498::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135838::DEBUG::2014-10-29 11:12:17,498::task::1191::Storage.TaskManager.Task::(prepare) Task=`02740c65-c81c-4851-bf7f-087889903e3b`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135838::DEBUG::2014-10-29 11:12:17,498::task::595::Storage.TaskManager.Task::(_updateState) Task=`02740c65-c81c-4851-bf7f-087889903e3b`::moving from state preparing -> state finished >Thread-135838::DEBUG::2014-10-29 11:12:17,499::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135838::DEBUG::2014-10-29 11:12:17,499::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135838::DEBUG::2014-10-29 11:12:17,499::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135838::DEBUG::2014-10-29 11:12:17,500::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135838::DEBUG::2014-10-29 11:12:17,500::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135838::DEBUG::2014-10-29 11:12:17,500::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135838::DEBUG::2014-10-29 11:12:17,500::task::993::Storage.TaskManager.Task::(_decref) Task=`02740c65-c81c-4851-bf7f-087889903e3b`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:12:17,521::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54113 >Detector thread::DEBUG::2014-10-29 11:12:17,522::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54113 >Detector thread::DEBUG::2014-10-29 11:12:17,522::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54113 >Detector thread::DEBUG::2014-10-29 11:12:17,523::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54113) >Thread-135843::DEBUG::2014-10-29 11:12:17,561::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135843::DEBUG::2014-10-29 11:12:17,561::task::595::Storage.TaskManager.Task::(_updateState) Task=`507f5cc1-8fde-4529-8b2c-428e358bc45f`::moving from state init -> state preparing >Thread-135843::INFO::2014-10-29 11:12:17,562::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135843::INFO::2014-10-29 11:12:17,562::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00132847', 'lastCheck': '0.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000945247', 'lastCheck': '0.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0145504', 'lastCheck': '1.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00123382', 'lastCheck': '1.3', 'valid': True}} >Thread-135843::DEBUG::2014-10-29 11:12:17,563::task::1191::Storage.TaskManager.Task::(prepare) Task=`507f5cc1-8fde-4529-8b2c-428e358bc45f`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00132847', 'lastCheck': '0.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000945247', 'lastCheck': '0.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0145504', 'lastCheck': '1.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00123382', 'lastCheck': '1.3', 'valid': True}} >Thread-135843::DEBUG::2014-10-29 11:12:17,563::task::595::Storage.TaskManager.Task::(_updateState) Task=`507f5cc1-8fde-4529-8b2c-428e358bc45f`::moving from state preparing -> state finished >Thread-135843::DEBUG::2014-10-29 11:12:17,563::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135843::DEBUG::2014-10-29 11:12:17,563::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135843::DEBUG::2014-10-29 11:12:17,564::task::993::Storage.TaskManager.Task::(_decref) Task=`507f5cc1-8fde-4529-8b2c-428e358bc45f`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:19,020::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:19,023::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135844::DEBUG::2014-10-29 11:12:19,027::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:19,029::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:19,031::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135845::DEBUG::2014-10-29 11:12:19,034::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135845::DEBUG::2014-10-29 11:12:19,037::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:12:19,288::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54114 >Detector thread::DEBUG::2014-10-29 11:12:19,289::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54114 >Detector thread::DEBUG::2014-10-29 11:12:19,289::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54114 >Detector thread::DEBUG::2014-10-29 11:12:19,290::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54114) >Thread-135846::DEBUG::2014-10-29 11:12:19,328::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135846::DEBUG::2014-10-29 11:12:19,329::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135846::DEBUG::2014-10-29 11:12:19,330::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.32', 'elapsedTime': '513771', 'displayType': 'vnc', 'cpuSys': '0.80', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '15964534', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '63520', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '33898.43'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.01', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:19,446::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:19,447::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:19,473::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:12:19,580::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54116 >Detector thread::DEBUG::2014-10-29 11:12:19,581::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54116 >Detector thread::DEBUG::2014-10-29 11:12:19,581::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54116 >Detector thread::DEBUG::2014-10-29 11:12:19,582::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54116) >Thread-135847::DEBUG::2014-10-29 11:12:19,621::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135847::DEBUG::2014-10-29 11:12:19,622::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135847::DEBUG::2014-10-29 11:12:19,640::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135847::DEBUG::2014-10-29 11:12:19,687::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '172', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '72', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:12:21,069::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54117 >Detector thread::DEBUG::2014-10-29 11:12:21,070::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54117 >Detector thread::DEBUG::2014-10-29 11:12:21,070::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54117 >Detector thread::DEBUG::2014-10-29 11:12:21,071::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54117) >Thread-135848::DEBUG::2014-10-29 11:12:21,111::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f5c63b8-f8cd-48db-92c5-8a35f62303d7`::moving from state init -> state preparing >Thread-135848::INFO::2014-10-29 11:12:21,111::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135848::INFO::2014-10-29 11:12:21,112::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00132847', 'lastCheck': '4.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000945247', 'lastCheck': '4.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0145504', 'lastCheck': '4.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00123382', 'lastCheck': '4.8', 'valid': True}} >Thread-135848::DEBUG::2014-10-29 11:12:21,112::task::1191::Storage.TaskManager.Task::(prepare) Task=`2f5c63b8-f8cd-48db-92c5-8a35f62303d7`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00132847', 'lastCheck': '4.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000945247', 'lastCheck': '4.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0145504', 'lastCheck': '4.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00123382', 'lastCheck': '4.8', 'valid': True}} >Thread-135848::DEBUG::2014-10-29 11:12:21,112::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f5c63b8-f8cd-48db-92c5-8a35f62303d7`::moving from state preparing -> state finished >Thread-135848::DEBUG::2014-10-29 11:12:21,113::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135848::DEBUG::2014-10-29 11:12:21,113::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135848::DEBUG::2014-10-29 11:12:21,113::task::993::Storage.TaskManager.Task::(_decref) Task=`2f5c63b8-f8cd-48db-92c5-8a35f62303d7`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:22,054::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:22,057::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135849::DEBUG::2014-10-29 11:12:22,060::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:22,062::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:22,064::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135850::DEBUG::2014-10-29 11:12:22,067::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135850::DEBUG::2014-10-29 11:12:22,069::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:24,480::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:24,482::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:24,483::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:25,084::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:25,086::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135851::DEBUG::2014-10-29 11:12:25,090::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:25,092::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:25,094::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135852::DEBUG::2014-10-29 11:12:25,097::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135852::DEBUG::2014-10-29 11:12:25,099::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:12:26,249::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:26,249::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:26,250::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:26,250::__init__::232::IOProcess::(_processLogs) (200225) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:26,251::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200225) Queuing response >Thread-179::DEBUG::2014-10-29 11:12:26,252::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:12:26,270::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000582459 s, 639 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:12:26,272::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:26,272::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:26,273::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:26,273::__init__::232::IOProcess::(_processLogs) (200226) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:26,274::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200226) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:26,307::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:26,307::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:26,308::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:26,308::__init__::232::IOProcess::(_processLogs) (200227) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:26,309::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200227) Queuing response >Thread-10269::DEBUG::2014-10-29 11:12:26,311::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:12:26,329::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000442335 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:12:26,331::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:26,331::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:26,332::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:26,332::__init__::232::IOProcess::(_processLogs) (200228) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:26,334::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200228) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:27,000::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:27,001::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:27,001::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:27,002::__init__::232::IOProcess::(_processLogs) (200229) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:27,002::__init__::232::IOProcess::(_processLogs) (200229) Queuing response >Thread-178::DEBUG::2014-10-29 11:12:27,003::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:12:27,027::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000475124 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:12:27,027::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:27,031::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:27,039::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-33::DEBUG::2014-10-29 11:12:27,042::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:12:27,042::__init__::232::IOProcess::(_processLogs) (200230) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:27,063::__init__::232::IOProcess::(_processLogs) (200230) Queuing response >Thread-33::DEBUG::2014-10-29 11:12:27,066::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.0004524 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:12:27,071::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:27,073::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:27,075::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:27,076::__init__::232::IOProcess::(_processLogs) (200231) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:27,078::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200231) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:27,080::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:27,080::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:27,081::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:27,081::__init__::232::IOProcess::(_processLogs) (200232) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:27,082::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200232) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:27,084::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:27,084::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:27,084::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:27,084::__init__::232::IOProcess::(_processLogs) (200233) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:27,085::__init__::232::IOProcess::(_processLogs) (200233) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:27,086::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:27,087::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:27,087::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:27,087::__init__::232::IOProcess::(_processLogs) (200234) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:27,088::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200234) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:27,089::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:27,090::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:27,091::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:27,091::__init__::232::IOProcess::(_processLogs) (200235) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:27,091::__init__::232::IOProcess::(_processLogs) (200235) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:27,091::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:27,092::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:27,093::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:27,093::__init__::232::IOProcess::(_processLogs) (200236) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:27,094::__init__::232::IOProcess::(_processLogs) (200236) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:27,094::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:27,094::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:27,094::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:27,095::__init__::232::IOProcess::(_processLogs) (200237) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:27,096::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200237) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:27,096::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:27,098::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:27,098::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:27,099::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200238) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:27,099::__init__::232::IOProcess::(_processLogs) (200238) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:28,114::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:28,117::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135853::DEBUG::2014-10-29 11:12:28,121::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7050a52-86b8-4142-add2-dff6326fc821`::moving from state init -> state preparing >Thread-135853::INFO::2014-10-29 11:12:28,121::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135853::INFO::2014-10-29 11:12:28,122::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475124', 'lastCheck': '1.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004524', 'lastCheck': '1.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582459', 'lastCheck': '1.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000442335', 'lastCheck': '1.8', 'valid': True}} >Thread-135853::DEBUG::2014-10-29 11:12:28,122::task::1191::Storage.TaskManager.Task::(prepare) Task=`d7050a52-86b8-4142-add2-dff6326fc821`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475124', 'lastCheck': '1.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004524', 'lastCheck': '1.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582459', 'lastCheck': '1.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000442335', 'lastCheck': '1.8', 'valid': True}} >Thread-135853::DEBUG::2014-10-29 11:12:28,123::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7050a52-86b8-4142-add2-dff6326fc821`::moving from state preparing -> state finished >Thread-135853::DEBUG::2014-10-29 11:12:28,123::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135853::DEBUG::2014-10-29 11:12:28,123::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135853::DEBUG::2014-10-29 11:12:28,123::task::993::Storage.TaskManager.Task::(_decref) Task=`d7050a52-86b8-4142-add2-dff6326fc821`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:12:28,141::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54119 >Detector thread::DEBUG::2014-10-29 11:12:28,142::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54119 >Detector thread::DEBUG::2014-10-29 11:12:28,142::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54119 >Detector thread::DEBUG::2014-10-29 11:12:28,143::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54119) >Thread-135853::DEBUG::2014-10-29 11:12:28,158::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-135854::DEBUG::2014-10-29 11:12:28,183::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:28,185::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-135854::DEBUG::2014-10-29 11:12:28,186::task::595::Storage.TaskManager.Task::(_updateState) Task=`1551fd22-c6c7-4fe1-aec8-00cc7cff2a94`::moving from state init -> state preparing >Thread-135854::INFO::2014-10-29 11:12:28,189::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >JsonRpcServer::DEBUG::2014-10-29 11:12:28,191::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135855::DEBUG::2014-10-29 11:12:28,201::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135854::DEBUG::2014-10-29 11:12:28,206::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:12:28,209::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:28,209::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:28,209::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:28,210::__init__::232::IOProcess::(_processLogs) (200239) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:28,211::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200239) Queuing response >Thread-135854::DEBUG::2014-10-29 11:12:28,215::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135854::DEBUG::2014-10-29 11:12:28,216::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135855::DEBUG::2014-10-29 11:12:28,217::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-135854::INFO::2014-10-29 11:12:28,217::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135854::DEBUG::2014-10-29 11:12:28,219::task::1191::Storage.TaskManager.Task::(prepare) Task=`1551fd22-c6c7-4fe1-aec8-00cc7cff2a94`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135854::DEBUG::2014-10-29 11:12:28,220::task::595::Storage.TaskManager.Task::(_updateState) Task=`1551fd22-c6c7-4fe1-aec8-00cc7cff2a94`::moving from state preparing -> state finished >Thread-135854::DEBUG::2014-10-29 11:12:28,220::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135854::DEBUG::2014-10-29 11:12:28,221::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135854::DEBUG::2014-10-29 11:12:28,221::task::993::Storage.TaskManager.Task::(_decref) Task=`1551fd22-c6c7-4fe1-aec8-00cc7cff2a94`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:12:28,268::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54120 >Detector thread::DEBUG::2014-10-29 11:12:28,269::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54120 >Detector thread::DEBUG::2014-10-29 11:12:28,269::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54120 >Detector thread::DEBUG::2014-10-29 11:12:28,270::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54120) >Thread-135856::DEBUG::2014-10-29 11:12:28,309::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135856::DEBUG::2014-10-29 11:12:28,310::task::595::Storage.TaskManager.Task::(_updateState) Task=`39f1fd3f-4793-4604-88b2-206f9615d75f`::moving from state init -> state preparing >Thread-135856::INFO::2014-10-29 11:12:28,310::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135856::DEBUG::2014-10-29 11:12:28,310::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135856::DEBUG::2014-10-29 11:12:28,311::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135856::DEBUG::2014-10-29 11:12:28,311::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135856::DEBUG::2014-10-29 11:12:28,311::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135856::DEBUG::2014-10-29 11:12:28,311::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135856::DEBUG::2014-10-29 11:12:28,312::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135856::DEBUG::2014-10-29 11:12:28,392::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135856::DEBUG::2014-10-29 11:12:28,393::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135856::DEBUG::2014-10-29 11:12:28,567::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135856::DEBUG::2014-10-29 11:12:28,569::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135856::DEBUG::2014-10-29 11:12:28,569::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135856::DEBUG::2014-10-29 11:12:28,569::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135856::DEBUG::2014-10-29 11:12:28,570::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135856::DEBUG::2014-10-29 11:12:28,570::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135856::DEBUG::2014-10-29 11:12:28,571::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135856::DEBUG::2014-10-29 11:12:28,571::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:12:28,579::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:28,580::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:28,581::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:28,581::__init__::232::IOProcess::(_processLogs) (200240) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:28,581::__init__::232::IOProcess::(_processLogs) (200240) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:28,584::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:28,584::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:28,584::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:28,585::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:28,585::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:28,586::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:28,587::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:28,589::__init__::232::IOProcess::(_processLogs) (200241) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:28,591::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:28,593::__init__::232::IOProcess::(_processLogs) (200242) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:28,594::__init__::232::IOProcess::(_processLogs) (200241) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:28,596::__init__::232::IOProcess::(_processLogs) (200242) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:28,598::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-135856::DEBUG::2014-10-29 11:12:28,599::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:12:28,601::__init__::232::IOProcess::(_processLogs) (200243) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:28,602::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200243) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:28,604::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:28,605::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:28,605::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:28,605::__init__::232::IOProcess::(_processLogs) (200244) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:12:28,606::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200244) Queuing response >Thread-135856::DEBUG::2014-10-29 11:12:28,607::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:12:28,608::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:28,608::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:28,609::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:28,609::__init__::232::IOProcess::(_processLogs) (200245) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:12:28,610::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200245) Queuing response >Thread-135856::DEBUG::2014-10-29 11:12:28,610::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:12:28,612::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:28,613::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:28,614::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:28,614::__init__::232::IOProcess::(_processLogs) (200246) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:28,614::__init__::232::IOProcess::(_processLogs) (200246) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:28,615::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:28,615::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-135856::DEBUG::2014-10-29 11:12:28,616::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:12:28,616::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-135856::INFO::2014-10-29 11:12:28,617::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:12:28,618::__init__::232::IOProcess::(_processLogs) (200247) Got request for method 'glob' >Thread-135856::INFO::2014-10-29 11:12:28,618::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:12:28,619::__init__::232::IOProcess::(_processLogs) (200247) Queuing response >Thread-135856::INFO::2014-10-29 11:12:28,620::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:12:28,621::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:28,622::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:28,622::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:28,622::__init__::232::IOProcess::(_processLogs) (200248) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:12:28,623::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200248) Queuing response >Thread-135856::DEBUG::2014-10-29 11:12:28,624::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135856::DEBUG::2014-10-29 11:12:28,625::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`f36a8747-24e0-405d-9da0-fa6c84346567`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135856::DEBUG::2014-10-29 11:12:28,626::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135856::DEBUG::2014-10-29 11:12:28,626::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135856::DEBUG::2014-10-29 11:12:28,626::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`f36a8747-24e0-405d-9da0-fa6c84346567`::Granted request >Thread-135856::DEBUG::2014-10-29 11:12:28,627::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`39f1fd3f-4793-4604-88b2-206f9615d75f`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135856::DEBUG::2014-10-29 11:12:28,627::task::993::Storage.TaskManager.Task::(_decref) Task=`39f1fd3f-4793-4604-88b2-206f9615d75f`::ref 1 aborting False >Thread-135856::INFO::2014-10-29 11:12:28,630::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135856::DEBUG::2014-10-29 11:12:28,630::task::1191::Storage.TaskManager.Task::(prepare) Task=`39f1fd3f-4793-4604-88b2-206f9615d75f`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135856::DEBUG::2014-10-29 11:12:28,631::task::595::Storage.TaskManager.Task::(_updateState) Task=`39f1fd3f-4793-4604-88b2-206f9615d75f`::moving from state preparing -> state finished >Thread-135856::DEBUG::2014-10-29 11:12:28,631::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135856::DEBUG::2014-10-29 11:12:28,631::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135856::DEBUG::2014-10-29 11:12:28,631::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135856::DEBUG::2014-10-29 11:12:28,632::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135856::DEBUG::2014-10-29 11:12:28,632::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135856::DEBUG::2014-10-29 11:12:28,632::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135856::DEBUG::2014-10-29 11:12:28,633::task::993::Storage.TaskManager.Task::(_decref) Task=`39f1fd3f-4793-4604-88b2-206f9615d75f`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:12:28,654::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54121 >Detector thread::DEBUG::2014-10-29 11:12:28,655::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54121 >Detector thread::DEBUG::2014-10-29 11:12:28,655::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54121 >Detector thread::DEBUG::2014-10-29 11:12:28,656::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54121) >Thread-135861::DEBUG::2014-10-29 11:12:28,695::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135861::DEBUG::2014-10-29 11:12:28,696::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b55280a-30ee-4a64-aa19-4f607ad88e1c`::moving from state init -> state preparing >Thread-135861::INFO::2014-10-29 11:12:28,697::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135861::INFO::2014-10-29 11:12:28,698::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475124', 'lastCheck': '1.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004524', 'lastCheck': '1.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582459', 'lastCheck': '2.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000442335', 'lastCheck': '2.4', 'valid': True}} >Thread-135861::DEBUG::2014-10-29 11:12:28,698::task::1191::Storage.TaskManager.Task::(prepare) Task=`2b55280a-30ee-4a64-aa19-4f607ad88e1c`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475124', 'lastCheck': '1.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004524', 'lastCheck': '1.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582459', 'lastCheck': '2.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000442335', 'lastCheck': '2.4', 'valid': True}} >Thread-135861::DEBUG::2014-10-29 11:12:28,698::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b55280a-30ee-4a64-aa19-4f607ad88e1c`::moving from state preparing -> state finished >Thread-135861::DEBUG::2014-10-29 11:12:28,699::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135861::DEBUG::2014-10-29 11:12:28,699::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135861::DEBUG::2014-10-29 11:12:28,699::task::993::Storage.TaskManager.Task::(_decref) Task=`2b55280a-30ee-4a64-aa19-4f607ad88e1c`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:12:29,490::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54122 >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:29,494::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:12:29,495::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54122 >Detector thread::DEBUG::2014-10-29 11:12:29,499::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54122 >Detector thread::DEBUG::2014-10-29 11:12:29,502::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54122) >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:29,507::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:29,508::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135862::DEBUG::2014-10-29 11:12:29,529::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135862::DEBUG::2014-10-29 11:12:29,530::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135862::DEBUG::2014-10-29 11:12:29,530::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.32', 'elapsedTime': '513782', 'displayType': 'vnc', 'cpuSys': '0.80', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '15964534', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '63520', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '33898.43'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.21', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:12:29,728::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54124 >Detector thread::DEBUG::2014-10-29 11:12:29,728::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54124 >Detector thread::DEBUG::2014-10-29 11:12:29,728::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54124 >Detector thread::DEBUG::2014-10-29 11:12:29,729::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54124) >Thread-135863::DEBUG::2014-10-29 11:12:29,768::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135863::DEBUG::2014-10-29 11:12:29,770::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135863::DEBUG::2014-10-29 11:12:29,788::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135863::DEBUG::2014-10-29 11:12:29,836::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '157', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '57', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:12:31,176::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54125 >Detector thread::DEBUG::2014-10-29 11:12:31,176::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54125 >Detector thread::DEBUG::2014-10-29 11:12:31,177::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54125 >Detector thread::DEBUG::2014-10-29 11:12:31,177::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54125) >Thread-135864::DEBUG::2014-10-29 11:12:31,217::task::595::Storage.TaskManager.Task::(_updateState) Task=`ed01f276-fdd0-42a5-8b9b-bd2ad52ae591`::moving from state init -> state preparing >Thread-135864::INFO::2014-10-29 11:12:31,217::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135864::INFO::2014-10-29 11:12:31,218::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475124', 'lastCheck': '4.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004524', 'lastCheck': '4.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582459', 'lastCheck': '4.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000442335', 'lastCheck': '4.9', 'valid': True}} >Thread-135864::DEBUG::2014-10-29 11:12:31,218::task::1191::Storage.TaskManager.Task::(prepare) Task=`ed01f276-fdd0-42a5-8b9b-bd2ad52ae591`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475124', 'lastCheck': '4.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004524', 'lastCheck': '4.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582459', 'lastCheck': '4.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000442335', 'lastCheck': '4.9', 'valid': True}} >Thread-135864::DEBUG::2014-10-29 11:12:31,219::task::595::Storage.TaskManager.Task::(_updateState) Task=`ed01f276-fdd0-42a5-8b9b-bd2ad52ae591`::moving from state preparing -> state finished >Thread-135864::DEBUG::2014-10-29 11:12:31,219::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135864::DEBUG::2014-10-29 11:12:31,219::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135864::DEBUG::2014-10-29 11:12:31,219::task::993::Storage.TaskManager.Task::(_decref) Task=`ed01f276-fdd0-42a5-8b9b-bd2ad52ae591`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:31,299::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:31,300::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135865::DEBUG::2014-10-29 11:12:31,304::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:31,307::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:31,309::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135866::DEBUG::2014-10-29 11:12:31,313::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135866::DEBUG::2014-10-29 11:12:31,315::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:12:32,338::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >VM Channels Listener::DEBUG::2014-10-29 11:12:33,536::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:34,340::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:34,343::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135867::DEBUG::2014-10-29 11:12:34,347::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:34,350::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:34,352::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135868::DEBUG::2014-10-29 11:12:34,356::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135868::DEBUG::2014-10-29 11:12:34,358::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:34,515::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:34,516::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:34,517::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:12:36,278::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:36,279::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:36,279::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:36,279::__init__::232::IOProcess::(_processLogs) (200249) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:36,291::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200249) Queuing response >Thread-179::DEBUG::2014-10-29 11:12:36,293::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:12:36,312::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000689487 s, 540 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:12:36,314::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:36,314::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:36,314::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:36,315::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200250) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:36,316::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200250) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:36,337::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:36,339::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-10269::DEBUG::2014-10-29 11:12:36,340::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:12:36,340::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:36,357::__init__::232::IOProcess::(_processLogs) (200251) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:36,360::__init__::232::IOProcess::(_processLogs) (200251) Queuing response >Thread-10269::DEBUG::2014-10-29 11:12:36,360::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000596979 s, 841 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:12:36,363::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:36,364::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:36,364::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:36,364::__init__::232::IOProcess::(_processLogs) (200252) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:36,366::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200252) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:37,098::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:37,099::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:37,099::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:37,099::__init__::232::IOProcess::(_processLogs) (200253) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:37,102::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200253) Queuing response >Thread-178::DEBUG::2014-10-29 11:12:37,103::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:12:37,105::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:37,125::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-178::DEBUG::2014-10-29 11:12:37,126::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000569688 s, 892 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:12:37,138::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-33::DEBUG::2014-10-29 11:12:37,140::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:12:37,140::__init__::232::IOProcess::(_processLogs) (200254) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:37,164::__init__::232::IOProcess::(_processLogs) (200254) Queuing response >Thread-33::DEBUG::2014-10-29 11:12:37,165::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000438979 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:12:37,168::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:37,169::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:37,169::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:37,172::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200255) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:37,173::__init__::232::IOProcess::(_processLogs) (200255) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:37,174::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:37,174::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:37,174::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:37,174::__init__::232::IOProcess::(_processLogs) (200256) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:37,176::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200256) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:37,177::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:37,177::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:37,178::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:37,178::__init__::232::IOProcess::(_processLogs) (200257) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:37,178::__init__::232::IOProcess::(_processLogs) (200257) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:37,181::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:37,181::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:37,181::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:37,182::__init__::232::IOProcess::(_processLogs) (200258) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:37,182::__init__::232::IOProcess::(_processLogs) (200258) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:37,182::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:37,183::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:37,184::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:37,184::__init__::232::IOProcess::(_processLogs) (200259) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:37,184::__init__::232::IOProcess::(_processLogs) (200259) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:37,185::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:37,186::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:37,186::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:37,186::__init__::232::IOProcess::(_processLogs) (200260) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:37,187::__init__::232::IOProcess::(_processLogs) (200260) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:37,187::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:37,188::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:37,188::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:37,190::__init__::232::IOProcess::(_processLogs) (200261) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:37,190::__init__::232::IOProcess::(_processLogs) (200261) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:37,190::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:37,191::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:37,191::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:37,192::__init__::232::IOProcess::(_processLogs) (200262) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:37,193::__init__::232::IOProcess::(_processLogs) (200262) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:37,371::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:37,374::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135869::DEBUG::2014-10-29 11:12:37,378::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:37,380::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:37,382::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135870::DEBUG::2014-10-29 11:12:37,385::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135870::DEBUG::2014-10-29 11:12:37,388::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:12:39,319::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54127 >Detector thread::DEBUG::2014-10-29 11:12:39,320::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54127 >Detector thread::DEBUG::2014-10-29 11:12:39,320::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54127 >Detector thread::DEBUG::2014-10-29 11:12:39,321::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54127) >Thread-135871::DEBUG::2014-10-29 11:12:39,360::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135871::DEBUG::2014-10-29 11:12:39,361::task::595::Storage.TaskManager.Task::(_updateState) Task=`f52496d5-ec80-408d-b60e-33b58f4793c3`::moving from state init -> state preparing >Thread-135871::INFO::2014-10-29 11:12:39,362::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135871::DEBUG::2014-10-29 11:12:39,369::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:12:39,370::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:39,370::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:39,370::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:39,371::__init__::232::IOProcess::(_processLogs) (200263) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:39,371::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200263) Queuing response >Thread-135871::DEBUG::2014-10-29 11:12:39,372::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135871::DEBUG::2014-10-29 11:12:39,373::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135871::INFO::2014-10-29 11:12:39,373::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135871::DEBUG::2014-10-29 11:12:39,373::task::1191::Storage.TaskManager.Task::(prepare) Task=`f52496d5-ec80-408d-b60e-33b58f4793c3`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135871::DEBUG::2014-10-29 11:12:39,374::task::595::Storage.TaskManager.Task::(_updateState) Task=`f52496d5-ec80-408d-b60e-33b58f4793c3`::moving from state preparing -> state finished >Thread-135871::DEBUG::2014-10-29 11:12:39,374::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135871::DEBUG::2014-10-29 11:12:39,374::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135871::DEBUG::2014-10-29 11:12:39,374::task::993::Storage.TaskManager.Task::(_decref) Task=`f52496d5-ec80-408d-b60e-33b58f4793c3`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:12:39,418::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54128 >Detector thread::DEBUG::2014-10-29 11:12:39,419::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54128 >Detector thread::DEBUG::2014-10-29 11:12:39,419::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54128 >Detector thread::DEBUG::2014-10-29 11:12:39,419::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54128) >Thread-135872::DEBUG::2014-10-29 11:12:39,458::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135872::DEBUG::2014-10-29 11:12:39,459::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe790c23-9348-4add-aa94-2ce7ec2f547a`::moving from state init -> state preparing >Thread-135872::INFO::2014-10-29 11:12:39,459::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135872::DEBUG::2014-10-29 11:12:39,460::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135872::DEBUG::2014-10-29 11:12:39,460::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135872::DEBUG::2014-10-29 11:12:39,460::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135872::DEBUG::2014-10-29 11:12:39,460::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135872::DEBUG::2014-10-29 11:12:39,461::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135872::DEBUG::2014-10-29 11:12:39,461::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:39,521::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:39,524::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:39,525::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135872::DEBUG::2014-10-29 11:12:39,562::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135872::DEBUG::2014-10-29 11:12:39,563::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Detector thread::DEBUG::2014-10-29 11:12:39,698::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54129 >Detector thread::DEBUG::2014-10-29 11:12:39,699::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54129 >Detector thread::DEBUG::2014-10-29 11:12:39,700::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54129 >Detector thread::DEBUG::2014-10-29 11:12:39,700::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54129) >Thread-135873::DEBUG::2014-10-29 11:12:39,738::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135873::DEBUG::2014-10-29 11:12:39,740::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135873::DEBUG::2014-10-29 11:12:39,741::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.24', 'elapsedTime': '513792', 'displayType': 'vnc', 'cpuSys': '0.93', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '15964534', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '63520', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '33898.43'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.40', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-135872::DEBUG::2014-10-29 11:12:39,749::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135872::DEBUG::2014-10-29 11:12:39,749::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135872::DEBUG::2014-10-29 11:12:39,750::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135872::DEBUG::2014-10-29 11:12:39,750::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135872::DEBUG::2014-10-29 11:12:39,750::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135872::DEBUG::2014-10-29 11:12:39,751::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135872::DEBUG::2014-10-29 11:12:39,751::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135872::DEBUG::2014-10-29 11:12:39,751::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:12:39,758::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:39,763::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:39,765::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:39,765::__init__::232::IOProcess::(_processLogs) (200264) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:39,765::__init__::232::IOProcess::(_processLogs) (200264) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:39,766::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:39,766::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:39,766::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:39,767::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:39,767::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:39,767::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:39,768::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:39,768::__init__::232::IOProcess::(_processLogs) (200265) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:39,768::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:39,768::__init__::232::IOProcess::(_processLogs) (200266) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:39,769::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200266) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:39,771::__init__::232::IOProcess::(_processLogs) (200265) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:39,771::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:39,771::__init__::232::IOProcess::(_processLogs) (200267) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:39,771::__init__::232::IOProcess::(_processLogs) (200267) Queuing response >Thread-135872::DEBUG::2014-10-29 11:12:39,776::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:12:39,779::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:39,779::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:39,780::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:39,780::__init__::232::IOProcess::(_processLogs) (200268) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:12:39,781::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200268) Queuing response >Thread-135872::DEBUG::2014-10-29 11:12:39,781::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:12:39,782::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:39,783::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:39,783::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:39,783::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200269) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:12:39,783::__init__::232::IOProcess::(_processLogs) (200269) Queuing response >Thread-135872::DEBUG::2014-10-29 11:12:39,784::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:12:39,786::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:39,786::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:39,787::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:39,787::__init__::232::IOProcess::(_processLogs) (200270) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:39,788::__init__::232::IOProcess::(_processLogs) (200270) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:39,788::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:39,788::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:39,789::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:39,789::__init__::232::IOProcess::(_processLogs) (200271) Got request for method 'glob' >Thread-135872::DEBUG::2014-10-29 11:12:39,790::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:12:39,790::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200271) Queuing response >Thread-135872::INFO::2014-10-29 11:12:39,791::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135872::INFO::2014-10-29 11:12:39,792::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135872::INFO::2014-10-29 11:12:39,792::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:12:39,793::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:39,793::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:39,793::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:39,794::__init__::232::IOProcess::(_processLogs) (200272) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:12:39,795::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200272) Queuing response >Thread-135872::DEBUG::2014-10-29 11:12:39,795::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135872::DEBUG::2014-10-29 11:12:39,797::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`39ca2cee-3469-4868-af5e-d905851684dd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135872::DEBUG::2014-10-29 11:12:39,797::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135872::DEBUG::2014-10-29 11:12:39,798::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135872::DEBUG::2014-10-29 11:12:39,798::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`39ca2cee-3469-4868-af5e-d905851684dd`::Granted request >Thread-135872::DEBUG::2014-10-29 11:12:39,799::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fe790c23-9348-4add-aa94-2ce7ec2f547a`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135872::DEBUG::2014-10-29 11:12:39,799::task::993::Storage.TaskManager.Task::(_decref) Task=`fe790c23-9348-4add-aa94-2ce7ec2f547a`::ref 1 aborting False >Thread-135872::INFO::2014-10-29 11:12:39,802::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135872::DEBUG::2014-10-29 11:12:39,802::task::1191::Storage.TaskManager.Task::(prepare) Task=`fe790c23-9348-4add-aa94-2ce7ec2f547a`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135872::DEBUG::2014-10-29 11:12:39,802::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe790c23-9348-4add-aa94-2ce7ec2f547a`::moving from state preparing -> state finished >Thread-135872::DEBUG::2014-10-29 11:12:39,803::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135872::DEBUG::2014-10-29 11:12:39,803::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135872::DEBUG::2014-10-29 11:12:39,803::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135872::DEBUG::2014-10-29 11:12:39,804::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135872::DEBUG::2014-10-29 11:12:39,804::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135872::DEBUG::2014-10-29 11:12:39,804::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135872::DEBUG::2014-10-29 11:12:39,804::task::993::Storage.TaskManager.Task::(_decref) Task=`fe790c23-9348-4add-aa94-2ce7ec2f547a`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:12:39,824::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54130 >Detector thread::DEBUG::2014-10-29 11:12:39,825::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54130 >Detector thread::DEBUG::2014-10-29 11:12:39,825::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54130 >Detector thread::DEBUG::2014-10-29 11:12:39,826::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54130) >Thread-135878::DEBUG::2014-10-29 11:12:39,864::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135878::DEBUG::2014-10-29 11:12:39,865::task::595::Storage.TaskManager.Task::(_updateState) Task=`574225ad-dfba-4a2e-a7ab-60633046ae93`::moving from state init -> state preparing >Thread-135878::INFO::2014-10-29 11:12:39,866::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135878::INFO::2014-10-29 11:12:39,866::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569688', 'lastCheck': '2.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000438979', 'lastCheck': '2.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000689487', 'lastCheck': '3.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000596979', 'lastCheck': '3.5', 'valid': True}} >Thread-135878::DEBUG::2014-10-29 11:12:39,867::task::1191::Storage.TaskManager.Task::(prepare) Task=`574225ad-dfba-4a2e-a7ab-60633046ae93`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569688', 'lastCheck': '2.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000438979', 'lastCheck': '2.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000689487', 'lastCheck': '3.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000596979', 'lastCheck': '3.5', 'valid': True}} >Thread-135878::DEBUG::2014-10-29 11:12:39,867::task::595::Storage.TaskManager.Task::(_updateState) Task=`574225ad-dfba-4a2e-a7ab-60633046ae93`::moving from state preparing -> state finished >Thread-135878::DEBUG::2014-10-29 11:12:39,867::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135878::DEBUG::2014-10-29 11:12:39,867::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135878::DEBUG::2014-10-29 11:12:39,868::task::993::Storage.TaskManager.Task::(_decref) Task=`574225ad-dfba-4a2e-a7ab-60633046ae93`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:12:39,887::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54132 >Detector thread::DEBUG::2014-10-29 11:12:39,888::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54132 >Detector thread::DEBUG::2014-10-29 11:12:39,888::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54132 >Detector thread::DEBUG::2014-10-29 11:12:39,889::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54132) >Thread-135879::DEBUG::2014-10-29 11:12:39,929::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135879::DEBUG::2014-10-29 11:12:39,931::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135879::DEBUG::2014-10-29 11:12:39,951::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135879::DEBUG::2014-10-29 11:12:39,998::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '141', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '41', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:12:40,286::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54133 >Detector thread::DEBUG::2014-10-29 11:12:40,287::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54133 >Detector thread::DEBUG::2014-10-29 11:12:40,287::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54133 >Detector thread::DEBUG::2014-10-29 11:12:40,288::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54133) >Thread-135880::DEBUG::2014-10-29 11:12:40,328::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e4b8900-3932-461d-a7f2-6e647a1ba126`::moving from state init -> state preparing >Thread-135880::INFO::2014-10-29 11:12:40,329::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135880::INFO::2014-10-29 11:12:40,329::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569688', 'lastCheck': '3.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000438979', 'lastCheck': '3.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000689487', 'lastCheck': '4.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000596979', 'lastCheck': '4.0', 'valid': True}} >Thread-135880::DEBUG::2014-10-29 11:12:40,329::task::1191::Storage.TaskManager.Task::(prepare) Task=`2e4b8900-3932-461d-a7f2-6e647a1ba126`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569688', 'lastCheck': '3.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000438979', 'lastCheck': '3.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000689487', 'lastCheck': '4.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000596979', 'lastCheck': '4.0', 'valid': True}} >Thread-135880::DEBUG::2014-10-29 11:12:40,330::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e4b8900-3932-461d-a7f2-6e647a1ba126`::moving from state preparing -> state finished >Thread-135880::DEBUG::2014-10-29 11:12:40,330::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135880::DEBUG::2014-10-29 11:12:40,330::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135880::DEBUG::2014-10-29 11:12:40,331::task::993::Storage.TaskManager.Task::(_decref) Task=`2e4b8900-3932-461d-a7f2-6e647a1ba126`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:40,402::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:40,405::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135881::DEBUG::2014-10-29 11:12:40,408::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:40,411::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:40,413::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135882::DEBUG::2014-10-29 11:12:40,417::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135882::DEBUG::2014-10-29 11:12:40,419::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:43,432::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:43,435::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135883::DEBUG::2014-10-29 11:12:43,438::task::595::Storage.TaskManager.Task::(_updateState) Task=`0cc79e38-289e-4702-b36b-673c4b019c71`::moving from state init -> state preparing >Thread-135883::INFO::2014-10-29 11:12:43,438::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135883::INFO::2014-10-29 11:12:43,439::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569688', 'lastCheck': '6.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000438979', 'lastCheck': '6.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000689487', 'lastCheck': '7.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000596979', 'lastCheck': '7.1', 'valid': True}} >Thread-135883::DEBUG::2014-10-29 11:12:43,439::task::1191::Storage.TaskManager.Task::(prepare) Task=`0cc79e38-289e-4702-b36b-673c4b019c71`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569688', 'lastCheck': '6.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000438979', 'lastCheck': '6.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000689487', 'lastCheck': '7.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000596979', 'lastCheck': '7.1', 'valid': True}} >Thread-135883::DEBUG::2014-10-29 11:12:43,440::task::595::Storage.TaskManager.Task::(_updateState) Task=`0cc79e38-289e-4702-b36b-673c4b019c71`::moving from state preparing -> state finished >Thread-135883::DEBUG::2014-10-29 11:12:43,440::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135883::DEBUG::2014-10-29 11:12:43,440::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135883::DEBUG::2014-10-29 11:12:43,440::task::993::Storage.TaskManager.Task::(_decref) Task=`0cc79e38-289e-4702-b36b-673c4b019c71`::ref 0 aborting False >Thread-135883::DEBUG::2014-10-29 11:12:43,465::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:43,487::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:43,489::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135884::DEBUG::2014-10-29 11:12:43,492::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135884::DEBUG::2014-10-29 11:12:43,495::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:44,531::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:44,533::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:44,535::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:12:46,322::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:46,323::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:46,328::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-179::DEBUG::2014-10-29 11:12:46,330::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:12:46,331::__init__::232::IOProcess::(_processLogs) (200273) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:46,348::__init__::232::IOProcess::(_processLogs) (200273) Queuing response >Thread-179::DEBUG::2014-10-29 11:12:46,352::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000641297 s, 580 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:12:46,356::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:46,362::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:46,365::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:46,366::__init__::232::IOProcess::(_processLogs) (200274) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:46,369::__init__::232::IOProcess::(_processLogs) (200274) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:46,372::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:46,374::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:46,375::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:46,376::__init__::232::IOProcess::(_processLogs) (200275) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:46,382::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200275) Queuing response >Thread-10269::DEBUG::2014-10-29 11:12:46,384::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:12:46,404::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000516426 s, 972 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:12:46,409::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:46,410::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:46,411::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:46,413::__init__::232::IOProcess::(_processLogs) (200276) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:46,418::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200276) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:46,547::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:46,553::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135885::DEBUG::2014-10-29 11:12:46,561::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:46,566::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:46,571::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135886::DEBUG::2014-10-29 11:12:46,578::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135886::DEBUG::2014-10-29 11:12:46,594::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:12:47,191::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:47,191::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:47,192::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:47,192::__init__::232::IOProcess::(_processLogs) (200277) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:47,192::__init__::232::IOProcess::(_processLogs) (200277) Queuing response >Thread-178::DEBUG::2014-10-29 11:12:47,199::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:12:47,201::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:47,220::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-178::DEBUG::2014-10-29 11:12:47,224::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000671956 s, 756 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:12:47,224::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:47,229::__init__::232::IOProcess::(_processLogs) (200278) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:47,234::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200278) Queuing response >Thread-33::DEBUG::2014-10-29 11:12:47,238::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:12:47,239::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:47,259::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-33::DEBUG::2014-10-29 11:12:47,262::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000460667 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:12:47,262::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:47,265::__init__::232::IOProcess::(_processLogs) (200279) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:47,266::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200279) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:47,269::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:47,269::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:47,269::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:47,269::__init__::232::IOProcess::(_processLogs) (200280) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:47,271::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200280) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:47,272::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:47,272::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:47,273::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:47,273::__init__::232::IOProcess::(_processLogs) (200281) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:47,273::__init__::232::IOProcess::(_processLogs) (200281) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:47,275::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:47,276::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:47,277::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:47,277::__init__::232::IOProcess::(_processLogs) (200282) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:47,277::__init__::232::IOProcess::(_processLogs) (200282) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:47,278::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:47,279::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:47,279::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:47,280::__init__::232::IOProcess::(_processLogs) (200283) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:47,280::__init__::232::IOProcess::(_processLogs) (200283) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:47,280::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:47,281::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:47,282::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:47,282::__init__::232::IOProcess::(_processLogs) (200284) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:47,282::__init__::232::IOProcess::(_processLogs) (200284) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:47,283::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:47,284::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:47,284::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:47,286::__init__::232::IOProcess::(_processLogs) (200285) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:47,286::__init__::232::IOProcess::(_processLogs) (200285) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:47,286::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:47,287::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:47,289::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:47,289::__init__::232::IOProcess::(_processLogs) (200286) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:47,289::__init__::232::IOProcess::(_processLogs) (200286) Queuing response >Thread-22::DEBUG::2014-10-29 11:12:47,343::task::595::Storage.TaskManager.Task::(_updateState) Task=`37612d6a-8913-48c8-823c-ffa53ef5539c`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:12:47,343::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:12:47,344::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:47,344::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:47,345::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:47,345::__init__::232::IOProcess::(_processLogs) (200287) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:12:47,346::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200287) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:47,348::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:47,348::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:47,348::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:47,348::__init__::232::IOProcess::(_processLogs) (200288) Got request for method 'stat' >Thread-22::INFO::2014-10-29 11:12:47,350::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010863616', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:12:47,350::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200288) Queuing response >Thread-22::DEBUG::2014-10-29 11:12:47,351::task::1191::Storage.TaskManager.Task::(prepare) Task=`37612d6a-8913-48c8-823c-ffa53ef5539c`::finished: {'truesize': '6010863616', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:12:47,352::task::595::Storage.TaskManager.Task::(_updateState) Task=`37612d6a-8913-48c8-823c-ffa53ef5539c`::moving from state preparing -> state finished >Thread-22::DEBUG::2014-10-29 11:12:47,352::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-10-29 11:12:47,352::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2014-10-29 11:12:47,353::task::993::Storage.TaskManager.Task::(_decref) Task=`37612d6a-8913-48c8-823c-ffa53ef5539c`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:12:47,420::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:49,542::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:49,544::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:49,546::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:49,615::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:49,617::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135887::DEBUG::2014-10-29 11:12:49,621::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:49,624::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:49,625::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135888::DEBUG::2014-10-29 11:12:49,628::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135888::DEBUG::2014-10-29 11:12:49,631::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:12:49,917::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54134 >Detector thread::DEBUG::2014-10-29 11:12:49,917::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54134 >Detector thread::DEBUG::2014-10-29 11:12:49,918::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54134 >Detector thread::DEBUG::2014-10-29 11:12:49,918::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54134) >Thread-135889::DEBUG::2014-10-29 11:12:49,957::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135889::DEBUG::2014-10-29 11:12:49,958::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135889::DEBUG::2014-10-29 11:12:49,959::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.06', 'elapsedTime': '513802', 'displayType': 'vnc', 'cpuSys': '1.06', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '38867578', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '59621', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '34248.48'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.54', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:12:50,049::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54135 >Detector thread::DEBUG::2014-10-29 11:12:50,049::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54135 >Detector thread::DEBUG::2014-10-29 11:12:50,049::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54135 >Detector thread::DEBUG::2014-10-29 11:12:50,050::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54135) >Thread-135890::DEBUG::2014-10-29 11:12:50,089::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135890::DEBUG::2014-10-29 11:12:50,091::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135890::DEBUG::2014-10-29 11:12:50,112::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135890::DEBUG::2014-10-29 11:12:50,173::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '123', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '23', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:12:50,460::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54138 >Detector thread::DEBUG::2014-10-29 11:12:50,461::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54138 >Detector thread::DEBUG::2014-10-29 11:12:50,461::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54138 >Detector thread::DEBUG::2014-10-29 11:12:50,462::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54138) >Thread-135891::DEBUG::2014-10-29 11:12:50,502::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135891::DEBUG::2014-10-29 11:12:50,503::task::595::Storage.TaskManager.Task::(_updateState) Task=`cdeccfe8-3b6c-44b0-83bd-0ded4195abfb`::moving from state init -> state preparing >Thread-135891::INFO::2014-10-29 11:12:50,503::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135891::DEBUG::2014-10-29 11:12:50,506::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:12:50,507::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:50,507::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:50,508::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:50,508::__init__::232::IOProcess::(_processLogs) (200289) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:50,509::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200289) Queuing response >Thread-135891::DEBUG::2014-10-29 11:12:50,510::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135891::DEBUG::2014-10-29 11:12:50,510::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135891::INFO::2014-10-29 11:12:50,511::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135891::DEBUG::2014-10-29 11:12:50,511::task::1191::Storage.TaskManager.Task::(prepare) Task=`cdeccfe8-3b6c-44b0-83bd-0ded4195abfb`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135891::DEBUG::2014-10-29 11:12:50,511::task::595::Storage.TaskManager.Task::(_updateState) Task=`cdeccfe8-3b6c-44b0-83bd-0ded4195abfb`::moving from state preparing -> state finished >Thread-135891::DEBUG::2014-10-29 11:12:50,512::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135891::DEBUG::2014-10-29 11:12:50,512::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135891::DEBUG::2014-10-29 11:12:50,512::task::993::Storage.TaskManager.Task::(_decref) Task=`cdeccfe8-3b6c-44b0-83bd-0ded4195abfb`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:12:50,556::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54139 >Detector thread::DEBUG::2014-10-29 11:12:50,556::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54139 >Detector thread::DEBUG::2014-10-29 11:12:50,556::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54139 >Detector thread::DEBUG::2014-10-29 11:12:50,557::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54139) >Thread-135892::DEBUG::2014-10-29 11:12:50,596::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135892::DEBUG::2014-10-29 11:12:50,596::task::595::Storage.TaskManager.Task::(_updateState) Task=`1729bb90-2e86-466b-8a25-2e2ec8b123a3`::moving from state init -> state preparing >Thread-135892::INFO::2014-10-29 11:12:50,597::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135892::DEBUG::2014-10-29 11:12:50,597::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135892::DEBUG::2014-10-29 11:12:50,597::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135892::DEBUG::2014-10-29 11:12:50,598::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135892::DEBUG::2014-10-29 11:12:50,598::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135892::DEBUG::2014-10-29 11:12:50,598::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135892::DEBUG::2014-10-29 11:12:50,599::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135892::DEBUG::2014-10-29 11:12:50,681::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135892::DEBUG::2014-10-29 11:12:50,682::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Detector thread::DEBUG::2014-10-29 11:12:50,850::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54140 >Thread-135892::DEBUG::2014-10-29 11:12:50,852::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Detector thread::DEBUG::2014-10-29 11:12:50,854::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54140 >Thread-135892::DEBUG::2014-10-29 11:12:50,855::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Detector thread::DEBUG::2014-10-29 11:12:50,856::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54140 >Thread-135892::DEBUG::2014-10-29 11:12:50,858::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Detector thread::DEBUG::2014-10-29 11:12:50,858::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54140) >Thread-135892::DEBUG::2014-10-29 11:12:50,863::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135892::DEBUG::2014-10-29 11:12:50,865::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135892::DEBUG::2014-10-29 11:12:50,865::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135892::DEBUG::2014-10-29 11:12:50,865::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135892::DEBUG::2014-10-29 11:12:50,866::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:12:50,872::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:50,874::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:50,874::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:50,875::__init__::232::IOProcess::(_processLogs) (200290) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:50,876::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200290) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:50,878::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:50,879::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:50,879::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:50,880::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:50,880::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:50,880::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:50,881::__init__::232::IOProcess::(_processLogs) (200291) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:50,881::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:50,881::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:50,881::__init__::232::IOProcess::(_processLogs) (200292) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:50,882::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:50,882::__init__::232::IOProcess::(_processLogs) (200293) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:50,883::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200291) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:50,885::__init__::232::IOProcess::(_processLogs) (200293) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:50,887::__init__::232::IOProcess::(_processLogs) (200292) Queuing response >Thread-135892::DEBUG::2014-10-29 11:12:50,900::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-135893::DEBUG::2014-10-29 11:12:50,900::task::595::Storage.TaskManager.Task::(_updateState) Task=`c51c286b-26d4-4bac-a93d-f3987e8d567c`::moving from state init -> state preparing >Thread-135893::INFO::2014-10-29 11:12:50,902::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-17::DEBUG::2014-10-29 11:12:50,903::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:50,905::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-135893::INFO::2014-10-29 11:12:50,905::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000671956', 'lastCheck': '3.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460667', 'lastCheck': '3.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000641297', 'lastCheck': '4.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000516426', 'lastCheck': '4.5', 'valid': True}} >Thread-17::DEBUG::2014-10-29 11:12:50,906::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-135893::DEBUG::2014-10-29 11:12:50,907::task::1191::Storage.TaskManager.Task::(prepare) Task=`c51c286b-26d4-4bac-a93d-f3987e8d567c`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000671956', 'lastCheck': '3.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460667', 'lastCheck': '3.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000641297', 'lastCheck': '4.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000516426', 'lastCheck': '4.5', 'valid': True}} >Thread-17::DEBUG::2014-10-29 11:12:50,908::__init__::232::IOProcess::(_processLogs) (200294) Got request for method 'touch' >Thread-135893::DEBUG::2014-10-29 11:12:50,908::task::595::Storage.TaskManager.Task::(_updateState) Task=`c51c286b-26d4-4bac-a93d-f3987e8d567c`::moving from state preparing -> state finished >Thread-135893::DEBUG::2014-10-29 11:12:50,909::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135893::DEBUG::2014-10-29 11:12:50,911::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17::DEBUG::2014-10-29 11:12:50,912::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200294) Queuing response >Thread-135892::DEBUG::2014-10-29 11:12:50,912::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-135893::DEBUG::2014-10-29 11:12:50,913::task::993::Storage.TaskManager.Task::(_decref) Task=`c51c286b-26d4-4bac-a93d-f3987e8d567c`::ref 0 aborting False >Thread-135892::DEBUG::2014-10-29 11:12:50,917::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:12:50,918::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:50,921::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:50,923::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:50,926::__init__::232::IOProcess::(_processLogs) (200295) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:12:50,927::__init__::232::IOProcess::(_processLogs) (200295) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:50,928::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:50,928::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:50,929::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:50,930::__init__::232::IOProcess::(_processLogs) (200296) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:50,930::__init__::232::IOProcess::(_processLogs) (200296) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:50,931::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-135892::DEBUG::2014-10-29 11:12:50,932::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:12:50,932::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-135892::INFO::2014-10-29 11:12:50,934::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:12:50,936::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-135892::INFO::2014-10-29 11:12:50,936::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:12:50,938::__init__::232::IOProcess::(_processLogs) (200297) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:50,939::__init__::232::IOProcess::(_processLogs) (200297) Queuing response >Thread-135892::INFO::2014-10-29 11:12:50,939::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:12:50,940::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:50,941::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:50,941::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:50,941::__init__::232::IOProcess::(_processLogs) (200298) Got request for method 'readfile' >Thread-135892::DEBUG::2014-10-29 11:12:50,946::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:12:50,946::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200298) Queuing response >Thread-135892::DEBUG::2014-10-29 11:12:50,952::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`3eb27ac4-ff69-4307-8e7c-217c63354fcb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135892::DEBUG::2014-10-29 11:12:50,953::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135892::DEBUG::2014-10-29 11:12:50,954::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135892::DEBUG::2014-10-29 11:12:50,955::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`3eb27ac4-ff69-4307-8e7c-217c63354fcb`::Granted request >Thread-135892::DEBUG::2014-10-29 11:12:50,960::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1729bb90-2e86-466b-8a25-2e2ec8b123a3`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135892::DEBUG::2014-10-29 11:12:50,962::task::993::Storage.TaskManager.Task::(_decref) Task=`1729bb90-2e86-466b-8a25-2e2ec8b123a3`::ref 1 aborting False >Thread-135892::INFO::2014-10-29 11:12:50,976::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135892::DEBUG::2014-10-29 11:12:50,977::task::1191::Storage.TaskManager.Task::(prepare) Task=`1729bb90-2e86-466b-8a25-2e2ec8b123a3`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135892::DEBUG::2014-10-29 11:12:50,977::task::595::Storage.TaskManager.Task::(_updateState) Task=`1729bb90-2e86-466b-8a25-2e2ec8b123a3`::moving from state preparing -> state finished >Thread-135892::DEBUG::2014-10-29 11:12:50,977::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135892::DEBUG::2014-10-29 11:12:50,978::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135892::DEBUG::2014-10-29 11:12:50,978::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135892::DEBUG::2014-10-29 11:12:50,978::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135892::DEBUG::2014-10-29 11:12:50,978::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135892::DEBUG::2014-10-29 11:12:50,979::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135892::DEBUG::2014-10-29 11:12:50,979::task::993::Storage.TaskManager.Task::(_decref) Task=`1729bb90-2e86-466b-8a25-2e2ec8b123a3`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:12:51,000::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54141 >Detector thread::DEBUG::2014-10-29 11:12:51,000::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54141 >Detector thread::DEBUG::2014-10-29 11:12:51,001::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54141 >Detector thread::DEBUG::2014-10-29 11:12:51,001::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54141) >Thread-135898::DEBUG::2014-10-29 11:12:51,040::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135898::DEBUG::2014-10-29 11:12:51,040::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f50a909-84c2-4db4-9b8e-18173c77a0a4`::moving from state init -> state preparing >Thread-135898::INFO::2014-10-29 11:12:51,041::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135898::INFO::2014-10-29 11:12:51,041::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000671956', 'lastCheck': '3.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460667', 'lastCheck': '3.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000641297', 'lastCheck': '4.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000516426', 'lastCheck': '4.6', 'valid': True}} >Thread-135898::DEBUG::2014-10-29 11:12:51,041::task::1191::Storage.TaskManager.Task::(prepare) Task=`7f50a909-84c2-4db4-9b8e-18173c77a0a4`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000671956', 'lastCheck': '3.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460667', 'lastCheck': '3.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000641297', 'lastCheck': '4.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000516426', 'lastCheck': '4.6', 'valid': True}} >Thread-135898::DEBUG::2014-10-29 11:12:51,042::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f50a909-84c2-4db4-9b8e-18173c77a0a4`::moving from state preparing -> state finished >Thread-135898::DEBUG::2014-10-29 11:12:51,042::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135898::DEBUG::2014-10-29 11:12:51,042::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135898::DEBUG::2014-10-29 11:12:51,042::task::993::Storage.TaskManager.Task::(_decref) Task=`7f50a909-84c2-4db4-9b8e-18173c77a0a4`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:52,645::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:52,648::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135899::DEBUG::2014-10-29 11:12:52,651::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:52,653::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:52,655::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135900::DEBUG::2014-10-29 11:12:52,659::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135900::DEBUG::2014-10-29 11:12:52,662::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:54,553::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:54,555::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:54,559::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:55,678::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:55,681::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135901::DEBUG::2014-10-29 11:12:55,684::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:55,687::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:55,689::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135902::DEBUG::2014-10-29 11:12:55,692::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135902::DEBUG::2014-10-29 11:12:55,694::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:12:56,369::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:56,369::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:56,369::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:56,370::__init__::232::IOProcess::(_processLogs) (200299) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:56,370::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200299) Queuing response >Thread-179::DEBUG::2014-10-29 11:12:56,372::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:12:56,392::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000570056 s, 653 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:12:56,394::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:56,394::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:56,394::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:56,395::__init__::232::IOProcess::(_processLogs) (200300) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:56,396::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200300) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:56,422::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:56,422::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:56,423::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:56,423::__init__::232::IOProcess::(_processLogs) (200301) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:56,425::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200301) Queuing response >Thread-10269::DEBUG::2014-10-29 11:12:56,426::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:12:56,445::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000482244 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:12:56,447::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:56,447::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:56,448::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:56,448::__init__::232::IOProcess::(_processLogs) (200302) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:56,450::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200302) Queuing response >Thread-178::DEBUG::2014-10-29 11:12:57,286::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 9b5dff8d-f9a0-4e5c-8800-3a988fc12016 >Thread-17::DEBUG::2014-10-29 11:12:57,292::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:57,295::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:57,295::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:57,295::__init__::232::IOProcess::(_processLogs) (200303) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:57,296::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200303) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:57,300::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:57,303::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:57,306::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:57,309::__init__::232::IOProcess::(_processLogs) (200304) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:57,322::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200304) Queuing response >Thread-178::DEBUG::2014-10-29 11:12:57,322::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016 >Thread-33::DEBUG::2014-10-29 11:12:57,326::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:12:57,350::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-33::DEBUG::2014-10-29 11:12:57,352::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000532348 s, 915 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:12:57,355::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:57,358::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:57,360::__init__::232::IOProcess::(_processLogs) (200305) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:57,362::__init__::232::IOProcess::(_processLogs) (200305) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:57,363::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:57,363::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:57,363::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:57,364::__init__::232::IOProcess::(_processLogs) (200306) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:57,365::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200306) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:57,366::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:57,366::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:57,366::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:57,366::__init__::232::IOProcess::(_processLogs) (200307) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:57,367::__init__::232::IOProcess::(_processLogs) (200307) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:57,368::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:57,369::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:57,369::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:57,369::__init__::232::IOProcess::(_processLogs) (200308) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:12:57,370::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200308) Queuing response >Thread-178::DEBUG::2014-10-29 11:12:57,371::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:12:57,372::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:57,373::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:57,373::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:57,374::__init__::232::IOProcess::(_processLogs) (200309) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:57,374::__init__::232::IOProcess::(_processLogs) (200309) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:57,377::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:57,377::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:57,377::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-178::DEBUG::2014-10-29 11:12:57,379::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nsednev_ovirt_3_5_HE_for_disks', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=Default', 'POOL_DOMAINS=9b5dff8d-f9a0-4e5c-8800-3a988fc12016:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=00000002-0002-0002-0002-000000000321', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_ovirt_3_5_HE_for_disks', 'ROLE=Master', 'SDUUID=9b5dff8d-f9a0-4e5c-8800-3a988fc12016', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=08256ef27d308c4f5bfe4a0974fd548f7d749489'] >Thread-17::DEBUG::2014-10-29 11:12:57,378::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200310) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:12:57,380::__init__::232::IOProcess::(_processLogs) (200310) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:57,382::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:57,383::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:57,384::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:57,384::__init__::232::IOProcess::(_processLogs) (200311) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:57,385::__init__::232::IOProcess::(_processLogs) (200311) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:57,385::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:57,386::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:57,387::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:57,387::__init__::232::IOProcess::(_processLogs) (200312) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:57,387::__init__::232::IOProcess::(_processLogs) (200312) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:57,388::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:57,389::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:57,389::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:57,390::__init__::232::IOProcess::(_processLogs) (200313) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:57,390::__init__::232::IOProcess::(_processLogs) (200313) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:57,390::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:57,391::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:57,391::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:57,391::__init__::232::IOProcess::(_processLogs) (200314) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:12:57,392::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200314) Queuing response >Thread-178::DEBUG::2014-10-29 11:12:57,392::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:12:57,393::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-178::INFO::2014-10-29 11:12:57,394::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9b5dff8d-f9a0-4e5c-8800-3a988fc12016_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:12:57,395::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-178::INFO::2014-10-29 11:12:57,395::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9b5dff8d-f9a0-4e5c-8800-3a988fc12016_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:12:57,396::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:57,397::__init__::232::IOProcess::(_processLogs) (200315) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:57,397::__init__::232::IOProcess::(_processLogs) (200315) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:57,399::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:57,400::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:57,400::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:57,400::__init__::232::IOProcess::(_processLogs) (200316) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:57,402::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200316) Queuing response >Thread-178::DEBUG::2014-10-29 11:12:57,403::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:12:57,420::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000495985 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:12:57,422::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:57,422::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:57,422::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:57,425::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200317) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:12:57,427::__init__::232::IOProcess::(_processLogs) (200317) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:57,427::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:57,428::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:57,429::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:57,429::__init__::232::IOProcess::(_processLogs) (200318) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:57,430::__init__::232::IOProcess::(_processLogs) (200318) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:57,430::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:57,431::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:57,432::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:57,432::__init__::232::IOProcess::(_processLogs) (200319) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:57,432::__init__::232::IOProcess::(_processLogs) (200319) Queuing response >Thread-17::DEBUG::2014-10-29 11:12:57,433::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:12:57,433::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:12:57,434::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:12:57,434::__init__::232::IOProcess::(_processLogs) (200320) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:12:57,436::__init__::232::IOProcess::(_processLogs) (200320) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:58,707::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:58,710::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135907::DEBUG::2014-10-29 11:12:58,713::task::595::Storage.TaskManager.Task::(_updateState) Task=`52925e09-7d47-47c7-b35b-2a71ea1b6999`::moving from state init -> state preparing >Thread-135907::INFO::2014-10-29 11:12:58,714::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135907::INFO::2014-10-29 11:12:58,714::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495985', 'lastCheck': '1.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532348', 'lastCheck': '1.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000570056', 'lastCheck': '2.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000482244', 'lastCheck': '2.3', 'valid': True}} >Thread-135907::DEBUG::2014-10-29 11:12:58,715::task::1191::Storage.TaskManager.Task::(prepare) Task=`52925e09-7d47-47c7-b35b-2a71ea1b6999`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495985', 'lastCheck': '1.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532348', 'lastCheck': '1.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000570056', 'lastCheck': '2.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000482244', 'lastCheck': '2.3', 'valid': True}} >Thread-135907::DEBUG::2014-10-29 11:12:58,715::task::595::Storage.TaskManager.Task::(_updateState) Task=`52925e09-7d47-47c7-b35b-2a71ea1b6999`::moving from state preparing -> state finished >Thread-135907::DEBUG::2014-10-29 11:12:58,715::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135907::DEBUG::2014-10-29 11:12:58,715::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135907::DEBUG::2014-10-29 11:12:58,716::task::993::Storage.TaskManager.Task::(_decref) Task=`52925e09-7d47-47c7-b35b-2a71ea1b6999`::ref 0 aborting False >Thread-135907::DEBUG::2014-10-29 11:12:58,759::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:12:58,781::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:12:58,783::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135908::DEBUG::2014-10-29 11:12:58,787::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135908::DEBUG::2014-10-29 11:12:58,789::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:59,566::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:59,568::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:12:59,570::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:13:00,128::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54142 >Detector thread::DEBUG::2014-10-29 11:13:00,129::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54142 >Detector thread::DEBUG::2014-10-29 11:13:00,129::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54142 >Detector thread::DEBUG::2014-10-29 11:13:00,130::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54142) >Thread-135909::DEBUG::2014-10-29 11:13:00,168::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135909::DEBUG::2014-10-29 11:13:00,169::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135909::DEBUG::2014-10-29 11:13:00,170::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.06', 'elapsedTime': '513812', 'displayType': 'vnc', 'cpuSys': '1.06', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '38867578', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '59621', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '34248.48'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.74', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:13:00,224::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54143 >Detector thread::DEBUG::2014-10-29 11:13:00,224::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54143 >Detector thread::DEBUG::2014-10-29 11:13:00,225::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54143 >Detector thread::DEBUG::2014-10-29 11:13:00,225::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54143) >Thread-135910::DEBUG::2014-10-29 11:13:00,264::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135910::DEBUG::2014-10-29 11:13:00,266::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135910::DEBUG::2014-10-29 11:13:00,290::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135910::DEBUG::2014-10-29 11:13:00,340::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '107', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '7', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:13:01,013::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54145 >Detector thread::DEBUG::2014-10-29 11:13:01,015::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54145 >Detector thread::DEBUG::2014-10-29 11:13:01,015::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54145 >Detector thread::DEBUG::2014-10-29 11:13:01,015::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54145) >Thread-135911::DEBUG::2014-10-29 11:13:01,055::task::595::Storage.TaskManager.Task::(_updateState) Task=`22a96b38-7162-4a24-a949-7fed0031dc35`::moving from state init -> state preparing >Thread-135911::INFO::2014-10-29 11:13:01,055::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135911::INFO::2014-10-29 11:13:01,056::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495985', 'lastCheck': '3.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532348', 'lastCheck': '3.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000570056', 'lastCheck': '4.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000482244', 'lastCheck': '4.6', 'valid': True}} >Thread-135911::DEBUG::2014-10-29 11:13:01,056::task::1191::Storage.TaskManager.Task::(prepare) Task=`22a96b38-7162-4a24-a949-7fed0031dc35`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495985', 'lastCheck': '3.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532348', 'lastCheck': '3.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000570056', 'lastCheck': '4.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000482244', 'lastCheck': '4.6', 'valid': True}} >Thread-135911::DEBUG::2014-10-29 11:13:01,056::task::595::Storage.TaskManager.Task::(_updateState) Task=`22a96b38-7162-4a24-a949-7fed0031dc35`::moving from state preparing -> state finished >Thread-135911::DEBUG::2014-10-29 11:13:01,057::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135911::DEBUG::2014-10-29 11:13:01,057::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135911::DEBUG::2014-10-29 11:13:01,057::task::993::Storage.TaskManager.Task::(_decref) Task=`22a96b38-7162-4a24-a949-7fed0031dc35`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:13:01,595::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54147 >Detector thread::DEBUG::2014-10-29 11:13:01,596::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54147 >Detector thread::DEBUG::2014-10-29 11:13:01,596::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54147 >Detector thread::DEBUG::2014-10-29 11:13:01,596::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54147) >Thread-135912::DEBUG::2014-10-29 11:13:01,636::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135912::DEBUG::2014-10-29 11:13:01,636::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f94b321-c054-4ed3-959f-4eedf7aa260b`::moving from state init -> state preparing >Thread-135912::INFO::2014-10-29 11:13:01,637::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135912::DEBUG::2014-10-29 11:13:01,640::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:13:01,641::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:01,642::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:01,642::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:01,642::__init__::232::IOProcess::(_processLogs) (200321) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:13:01,643::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200321) Queuing response >Thread-135912::DEBUG::2014-10-29 11:13:01,643::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135912::DEBUG::2014-10-29 11:13:01,644::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135912::INFO::2014-10-29 11:13:01,645::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135912::DEBUG::2014-10-29 11:13:01,645::task::1191::Storage.TaskManager.Task::(prepare) Task=`1f94b321-c054-4ed3-959f-4eedf7aa260b`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135912::DEBUG::2014-10-29 11:13:01,645::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f94b321-c054-4ed3-959f-4eedf7aa260b`::moving from state preparing -> state finished >Thread-135912::DEBUG::2014-10-29 11:13:01,646::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135912::DEBUG::2014-10-29 11:13:01,646::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135912::DEBUG::2014-10-29 11:13:01,646::task::993::Storage.TaskManager.Task::(_decref) Task=`1f94b321-c054-4ed3-959f-4eedf7aa260b`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:13:01,690::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54148 >Detector thread::DEBUG::2014-10-29 11:13:01,690::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54148 >Detector thread::DEBUG::2014-10-29 11:13:01,691::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54148 >Detector thread::DEBUG::2014-10-29 11:13:01,691::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54148) >Thread-135913::DEBUG::2014-10-29 11:13:01,730::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135913::DEBUG::2014-10-29 11:13:01,730::task::595::Storage.TaskManager.Task::(_updateState) Task=`46c88250-2c19-4711-bb99-652b95604808`::moving from state init -> state preparing >Thread-135913::INFO::2014-10-29 11:13:01,731::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135913::DEBUG::2014-10-29 11:13:01,731::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135913::DEBUG::2014-10-29 11:13:01,732::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135913::DEBUG::2014-10-29 11:13:01,732::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135913::DEBUG::2014-10-29 11:13:01,732::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135913::DEBUG::2014-10-29 11:13:01,732::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135913::DEBUG::2014-10-29 11:13:01,733::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135913::DEBUG::2014-10-29 11:13:01,811::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135913::DEBUG::2014-10-29 11:13:01,812::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:01,831::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:01,834::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135914::DEBUG::2014-10-29 11:13:01,838::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:01,841::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:01,843::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135915::DEBUG::2014-10-29 11:13:01,845::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135915::DEBUG::2014-10-29 11:13:01,848::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-135913::DEBUG::2014-10-29 11:13:01,998::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135913::DEBUG::2014-10-29 11:13:01,999::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135913::DEBUG::2014-10-29 11:13:01,999::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135913::DEBUG::2014-10-29 11:13:02,000::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135913::DEBUG::2014-10-29 11:13:02,000::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135913::DEBUG::2014-10-29 11:13:02,000::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135913::DEBUG::2014-10-29 11:13:02,001::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135913::DEBUG::2014-10-29 11:13:02,001::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:13:02,009::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:02,010::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:02,010::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:02,010::__init__::232::IOProcess::(_processLogs) (200322) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:13:02,011::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200322) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:02,013::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:02,013::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:02,014::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:02,014::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:02,015::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:02,015::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:02,015::__init__::232::IOProcess::(_processLogs) (200323) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:13:02,016::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:02,018::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:02,020::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:02,021::__init__::232::IOProcess::(_processLogs) (200325) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:13:02,022::__init__::232::IOProcess::(_processLogs) (200324) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:13:02,024::__init__::232::IOProcess::(_processLogs) (200323) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:02,025::__init__::232::IOProcess::(_processLogs) (200325) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:02,027::__init__::232::IOProcess::(_processLogs) (200324) Queuing response >Thread-135913::DEBUG::2014-10-29 11:13:02,029::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:13:02,033::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:02,033::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:02,033::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:02,034::__init__::232::IOProcess::(_processLogs) (200326) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:13:02,034::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200326) Queuing response >Thread-135913::DEBUG::2014-10-29 11:13:02,035::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:13:02,036::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:02,036::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:02,036::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:02,037::__init__::232::IOProcess::(_processLogs) (200327) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:13:02,037::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200327) Queuing response >Thread-135913::DEBUG::2014-10-29 11:13:02,038::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:13:02,040::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:02,040::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:02,041::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:02,042::__init__::232::IOProcess::(_processLogs) (200328) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:02,042::__init__::232::IOProcess::(_processLogs) (200328) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:02,042::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:02,043::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:02,043::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-135913::DEBUG::2014-10-29 11:13:02,043::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-135913::INFO::2014-10-29 11:13:02,045::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:13:02,045::__init__::232::IOProcess::(_processLogs) (200329) Got request for method 'glob' >Thread-135913::INFO::2014-10-29 11:13:02,046::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:13:02,047::__init__::232::IOProcess::(_processLogs) (200329) Queuing response >Thread-135913::INFO::2014-10-29 11:13:02,047::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:13:02,049::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:02,049::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:02,049::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:02,050::__init__::232::IOProcess::(_processLogs) (200330) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:13:02,050::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200330) Queuing response >Thread-135913::DEBUG::2014-10-29 11:13:02,051::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135913::DEBUG::2014-10-29 11:13:02,053::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`668f2169-01be-409c-bba1-681b0898fb06`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135913::DEBUG::2014-10-29 11:13:02,053::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135913::DEBUG::2014-10-29 11:13:02,054::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135913::DEBUG::2014-10-29 11:13:02,054::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`668f2169-01be-409c-bba1-681b0898fb06`::Granted request >Thread-135913::DEBUG::2014-10-29 11:13:02,055::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`46c88250-2c19-4711-bb99-652b95604808`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135913::DEBUG::2014-10-29 11:13:02,055::task::993::Storage.TaskManager.Task::(_decref) Task=`46c88250-2c19-4711-bb99-652b95604808`::ref 1 aborting False >Thread-135913::INFO::2014-10-29 11:13:02,057::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135913::DEBUG::2014-10-29 11:13:02,058::task::1191::Storage.TaskManager.Task::(prepare) Task=`46c88250-2c19-4711-bb99-652b95604808`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135913::DEBUG::2014-10-29 11:13:02,058::task::595::Storage.TaskManager.Task::(_updateState) Task=`46c88250-2c19-4711-bb99-652b95604808`::moving from state preparing -> state finished >Thread-135913::DEBUG::2014-10-29 11:13:02,058::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135913::DEBUG::2014-10-29 11:13:02,059::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135913::DEBUG::2014-10-29 11:13:02,059::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135913::DEBUG::2014-10-29 11:13:02,059::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135913::DEBUG::2014-10-29 11:13:02,060::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135913::DEBUG::2014-10-29 11:13:02,060::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135913::DEBUG::2014-10-29 11:13:02,060::task::993::Storage.TaskManager.Task::(_decref) Task=`46c88250-2c19-4711-bb99-652b95604808`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:13:02,083::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54149 >Detector thread::DEBUG::2014-10-29 11:13:02,083::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54149 >Detector thread::DEBUG::2014-10-29 11:13:02,084::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54149 >Detector thread::DEBUG::2014-10-29 11:13:02,084::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54149) >Thread-135920::DEBUG::2014-10-29 11:13:02,123::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135920::DEBUG::2014-10-29 11:13:02,123::task::595::Storage.TaskManager.Task::(_updateState) Task=`023ff81a-be53-40f2-a54c-76754d9e0fdc`::moving from state init -> state preparing >Thread-135920::INFO::2014-10-29 11:13:02,124::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135920::INFO::2014-10-29 11:13:02,124::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495985', 'lastCheck': '4.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532348', 'lastCheck': '4.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000570056', 'lastCheck': '5.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000482244', 'lastCheck': '5.7', 'valid': True}} >Thread-135920::DEBUG::2014-10-29 11:13:02,125::task::1191::Storage.TaskManager.Task::(prepare) Task=`023ff81a-be53-40f2-a54c-76754d9e0fdc`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495985', 'lastCheck': '4.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532348', 'lastCheck': '4.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000570056', 'lastCheck': '5.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000482244', 'lastCheck': '5.7', 'valid': True}} >Thread-135920::DEBUG::2014-10-29 11:13:02,125::task::595::Storage.TaskManager.Task::(_updateState) Task=`023ff81a-be53-40f2-a54c-76754d9e0fdc`::moving from state preparing -> state finished >Thread-135920::DEBUG::2014-10-29 11:13:02,125::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135920::DEBUG::2014-10-29 11:13:02,125::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135920::DEBUG::2014-10-29 11:13:02,126::task::993::Storage.TaskManager.Task::(_decref) Task=`023ff81a-be53-40f2-a54c-76754d9e0fdc`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:13:02,444::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >VM Channels Listener::DEBUG::2014-10-29 11:13:03,568::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:04,577::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:04,579::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:04,581::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:04,869::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:04,872::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135921::DEBUG::2014-10-29 11:13:04,876::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:04,878::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:04,880::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135922::DEBUG::2014-10-29 11:13:04,883::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135922::DEBUG::2014-10-29 11:13:04,885::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:13:06,400::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:06,401::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:06,401::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:06,401::__init__::232::IOProcess::(_processLogs) (200331) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:06,402::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200331) Queuing response >Thread-179::DEBUG::2014-10-29 11:13:06,404::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:13:06,421::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000500373 s, 743 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:13:06,423::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:06,425::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:06,426::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:06,426::__init__::232::IOProcess::(_processLogs) (200332) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:06,426::__init__::232::IOProcess::(_processLogs) (200332) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:06,452::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:06,453::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:06,453::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:06,454::__init__::232::IOProcess::(_processLogs) (200333) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:06,454::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200333) Queuing response >Thread-10269::DEBUG::2014-10-29 11:13:06,455::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:13:06,472::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00137943 s, 364 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:13:06,474::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:06,475::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:06,475::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:06,475::__init__::232::IOProcess::(_processLogs) (200334) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:06,476::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200334) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:07,401::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:07,401::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:07,402::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:07,402::__init__::232::IOProcess::(_processLogs) (200335) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:07,404::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200335) Queuing response >Thread-33::DEBUG::2014-10-29 11:13:07,406::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:13:07,428::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00142454 s, 342 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:13:07,432::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:07,434::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:07,435::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:07,435::__init__::232::IOProcess::(_processLogs) (200336) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:07,442::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200336) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:07,446::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:07,447::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:07,447::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:07,448::__init__::232::IOProcess::(_processLogs) (200337) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:07,449::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200337) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:07,451::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-178::DEBUG::2014-10-29 11:13:07,451::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:13:07,452::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:07,467::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:07,468::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200338) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:07,469::__init__::232::IOProcess::(_processLogs) (200338) Queuing response >Thread-178::DEBUG::2014-10-29 11:13:07,473::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000606141 s, 838 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:13:07,474::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:07,476::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:07,477::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:07,478::__init__::232::IOProcess::(_processLogs) (200339) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:07,478::__init__::232::IOProcess::(_processLogs) (200339) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:07,478::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:07,480::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:07,481::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:07,482::__init__::232::IOProcess::(_processLogs) (200340) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:07,482::__init__::232::IOProcess::(_processLogs) (200340) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:07,483::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:07,483::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:07,483::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:07,483::__init__::232::IOProcess::(_processLogs) (200341) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:07,484::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:07,484::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:07,485::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:07,486::__init__::232::IOProcess::(_processLogs) (200342) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:07,487::__init__::232::IOProcess::(_processLogs) (200341) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:07,488::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200342) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:07,489::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:07,489::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:07,490::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:07,491::__init__::232::IOProcess::(_processLogs) (200343) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:07,491::__init__::232::IOProcess::(_processLogs) (200343) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:07,491::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:07,492::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:07,492::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:07,493::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200344) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:07,494::__init__::232::IOProcess::(_processLogs) (200344) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:07,900::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:07,902::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135923::DEBUG::2014-10-29 11:13:07,906::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:07,908::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:07,911::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135924::DEBUG::2014-10-29 11:13:07,914::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135924::DEBUG::2014-10-29 11:13:07,916::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:13:09,328::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54150 >Detector thread::DEBUG::2014-10-29 11:13:09,329::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54150 >Detector thread::DEBUG::2014-10-29 11:13:09,329::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54150 >Detector thread::DEBUG::2014-10-29 11:13:09,330::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54150) >Thread-135925::DEBUG::2014-10-29 11:13:09,368::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135925::DEBUG::2014-10-29 11:13:09,369::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135925::DEBUG::2014-10-29 11:13:09,369::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.35', 'elapsedTime': '513821', 'displayType': 'vnc', 'cpuSys': '0.60', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '38867578', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '59621', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '34248.48'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.92', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:09,589::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:09,590::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:09,592::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:13:10,391::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54152 >Detector thread::DEBUG::2014-10-29 11:13:10,391::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54152 >Detector thread::DEBUG::2014-10-29 11:13:10,392::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54152 >Detector thread::DEBUG::2014-10-29 11:13:10,392::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54152) >Thread-135926::DEBUG::2014-10-29 11:13:10,431::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135926::DEBUG::2014-10-29 11:13:10,433::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135926::DEBUG::2014-10-29 11:13:10,452::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135926::DEBUG::2014-10-29 11:13:10,499::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '91', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '91', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:10,933::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:10,935::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135927::DEBUG::2014-10-29 11:13:10,939::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:10,941::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:10,943::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135928::DEBUG::2014-10-29 11:13:10,946::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135928::DEBUG::2014-10-29 11:13:10,948::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:13:11,117::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54153 >Detector thread::DEBUG::2014-10-29 11:13:11,118::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54153 >Detector thread::DEBUG::2014-10-29 11:13:11,118::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54153 >Detector thread::DEBUG::2014-10-29 11:13:11,119::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54153) >Thread-135929::DEBUG::2014-10-29 11:13:11,158::task::595::Storage.TaskManager.Task::(_updateState) Task=`6fa4ef5d-719f-4a5f-9caa-233ff0e1acc9`::moving from state init -> state preparing >Thread-135929::INFO::2014-10-29 11:13:11,158::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135929::INFO::2014-10-29 11:13:11,159::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606141', 'lastCheck': '3.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00142454', 'lastCheck': '3.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000500373', 'lastCheck': '4.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00137943', 'lastCheck': '4.7', 'valid': True}} >Thread-135929::DEBUG::2014-10-29 11:13:11,159::task::1191::Storage.TaskManager.Task::(prepare) Task=`6fa4ef5d-719f-4a5f-9caa-233ff0e1acc9`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606141', 'lastCheck': '3.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00142454', 'lastCheck': '3.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000500373', 'lastCheck': '4.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00137943', 'lastCheck': '4.7', 'valid': True}} >Thread-135929::DEBUG::2014-10-29 11:13:11,160::task::595::Storage.TaskManager.Task::(_updateState) Task=`6fa4ef5d-719f-4a5f-9caa-233ff0e1acc9`::moving from state preparing -> state finished >Thread-135929::DEBUG::2014-10-29 11:13:11,160::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135929::DEBUG::2014-10-29 11:13:11,160::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135929::DEBUG::2014-10-29 11:13:11,160::task::993::Storage.TaskManager.Task::(_decref) Task=`6fa4ef5d-719f-4a5f-9caa-233ff0e1acc9`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:13:12,708::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54155 >Detector thread::DEBUG::2014-10-29 11:13:12,708::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54155 >Detector thread::DEBUG::2014-10-29 11:13:12,708::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54155 >Detector thread::DEBUG::2014-10-29 11:13:12,709::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54155) >Thread-135930::DEBUG::2014-10-29 11:13:12,749::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135930::DEBUG::2014-10-29 11:13:12,749::task::595::Storage.TaskManager.Task::(_updateState) Task=`91c4e0ba-a3e3-4d0d-bddb-8322d35ea21e`::moving from state init -> state preparing >Thread-135930::INFO::2014-10-29 11:13:12,750::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135930::DEBUG::2014-10-29 11:13:12,753::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:13:12,754::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:12,754::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:12,754::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:12,754::__init__::232::IOProcess::(_processLogs) (200345) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:13:12,755::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200345) Queuing response >Thread-135930::DEBUG::2014-10-29 11:13:12,755::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135930::DEBUG::2014-10-29 11:13:12,757::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135930::INFO::2014-10-29 11:13:12,757::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135930::DEBUG::2014-10-29 11:13:12,758::task::1191::Storage.TaskManager.Task::(prepare) Task=`91c4e0ba-a3e3-4d0d-bddb-8322d35ea21e`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135930::DEBUG::2014-10-29 11:13:12,758::task::595::Storage.TaskManager.Task::(_updateState) Task=`91c4e0ba-a3e3-4d0d-bddb-8322d35ea21e`::moving from state preparing -> state finished >Thread-135930::DEBUG::2014-10-29 11:13:12,758::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135930::DEBUG::2014-10-29 11:13:12,758::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135930::DEBUG::2014-10-29 11:13:12,759::task::993::Storage.TaskManager.Task::(_decref) Task=`91c4e0ba-a3e3-4d0d-bddb-8322d35ea21e`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:13:12,803::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54156 >Detector thread::DEBUG::2014-10-29 11:13:12,803::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54156 >Detector thread::DEBUG::2014-10-29 11:13:12,803::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54156 >Detector thread::DEBUG::2014-10-29 11:13:12,804::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54156) >Thread-135931::DEBUG::2014-10-29 11:13:12,843::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135931::DEBUG::2014-10-29 11:13:12,843::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a007c40-89e6-4742-8be7-a082fa3bfb39`::moving from state init -> state preparing >Thread-135931::INFO::2014-10-29 11:13:12,844::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135931::DEBUG::2014-10-29 11:13:12,844::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135931::DEBUG::2014-10-29 11:13:12,844::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135931::DEBUG::2014-10-29 11:13:12,845::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135931::DEBUG::2014-10-29 11:13:12,845::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135931::DEBUG::2014-10-29 11:13:12,845::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135931::DEBUG::2014-10-29 11:13:12,846::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135931::DEBUG::2014-10-29 11:13:12,942::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135931::DEBUG::2014-10-29 11:13:12,943::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135931::DEBUG::2014-10-29 11:13:13,116::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135931::DEBUG::2014-10-29 11:13:13,118::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135931::DEBUG::2014-10-29 11:13:13,118::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135931::DEBUG::2014-10-29 11:13:13,118::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135931::DEBUG::2014-10-29 11:13:13,119::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135931::DEBUG::2014-10-29 11:13:13,119::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135931::DEBUG::2014-10-29 11:13:13,119::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135931::DEBUG::2014-10-29 11:13:13,120::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:13:13,125::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:13,129::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:13,130::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:13,130::__init__::232::IOProcess::(_processLogs) (200346) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:13:13,132::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200346) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:13,133::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:13,133::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:13,134::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:13,134::__init__::232::IOProcess::(_processLogs) (200347) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:13:13,134::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200347) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:13,136::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:13,138::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:13,139::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:13,141::__init__::232::IOProcess::(_processLogs) (200348) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:13:13,145::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200348) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:13,149::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-135931::DEBUG::2014-10-29 11:13:13,150::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:13:13,151::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:13,153::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:13,154::__init__::232::IOProcess::(_processLogs) (200349) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:13:13,154::__init__::232::IOProcess::(_processLogs) (200349) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:13,155::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:13,155::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:13,155::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:13,155::__init__::232::IOProcess::(_processLogs) (200350) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:13:13,156::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200350) Queuing response >Thread-135931::DEBUG::2014-10-29 11:13:13,157::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:13:13,158::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:13,158::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:13,158::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:13,159::__init__::232::IOProcess::(_processLogs) (200351) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:13:13,159::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200351) Queuing response >Thread-135931::DEBUG::2014-10-29 11:13:13,160::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:13:13,162::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:13,163::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:13,163::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:13,164::__init__::232::IOProcess::(_processLogs) (200352) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:13,164::__init__::232::IOProcess::(_processLogs) (200352) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:13,164::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:13,165::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:13,165::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:13,165::__init__::232::IOProcess::(_processLogs) (200353) Got request for method 'glob' >Thread-135931::DEBUG::2014-10-29 11:13:13,166::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:13:13,166::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200353) Queuing response >Thread-135931::INFO::2014-10-29 11:13:13,167::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135931::INFO::2014-10-29 11:13:13,168::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135931::INFO::2014-10-29 11:13:13,168::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:13:13,169::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:13,170::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:13,170::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:13,170::__init__::232::IOProcess::(_processLogs) (200354) Got request for method 'readfile' >Thread-135931::DEBUG::2014-10-29 11:13:13,171::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:13:13,171::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200354) Queuing response >Thread-135931::DEBUG::2014-10-29 11:13:13,174::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`58f915b8-a228-4ba1-9b80-546159461936`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135931::DEBUG::2014-10-29 11:13:13,174::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135931::DEBUG::2014-10-29 11:13:13,175::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135931::DEBUG::2014-10-29 11:13:13,175::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`58f915b8-a228-4ba1-9b80-546159461936`::Granted request >Thread-135931::DEBUG::2014-10-29 11:13:13,176::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0a007c40-89e6-4742-8be7-a082fa3bfb39`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135931::DEBUG::2014-10-29 11:13:13,176::task::993::Storage.TaskManager.Task::(_decref) Task=`0a007c40-89e6-4742-8be7-a082fa3bfb39`::ref 1 aborting False >Thread-135931::INFO::2014-10-29 11:13:13,179::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135931::DEBUG::2014-10-29 11:13:13,179::task::1191::Storage.TaskManager.Task::(prepare) Task=`0a007c40-89e6-4742-8be7-a082fa3bfb39`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135931::DEBUG::2014-10-29 11:13:13,179::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a007c40-89e6-4742-8be7-a082fa3bfb39`::moving from state preparing -> state finished >Thread-135931::DEBUG::2014-10-29 11:13:13,179::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135931::DEBUG::2014-10-29 11:13:13,180::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135931::DEBUG::2014-10-29 11:13:13,180::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135931::DEBUG::2014-10-29 11:13:13,180::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135931::DEBUG::2014-10-29 11:13:13,181::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135931::DEBUG::2014-10-29 11:13:13,181::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135931::DEBUG::2014-10-29 11:13:13,181::task::993::Storage.TaskManager.Task::(_decref) Task=`0a007c40-89e6-4742-8be7-a082fa3bfb39`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:13:13,203::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54157 >Detector thread::DEBUG::2014-10-29 11:13:13,204::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54157 >Detector thread::DEBUG::2014-10-29 11:13:13,204::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54157 >Detector thread::DEBUG::2014-10-29 11:13:13,205::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54157) >Thread-135936::DEBUG::2014-10-29 11:13:13,243::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135936::DEBUG::2014-10-29 11:13:13,244::task::595::Storage.TaskManager.Task::(_updateState) Task=`3fb1f9f9-86e9-4876-9c2d-4521b734c6f4`::moving from state init -> state preparing >Thread-135936::INFO::2014-10-29 11:13:13,244::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135936::INFO::2014-10-29 11:13:13,245::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606141', 'lastCheck': '5.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00142454', 'lastCheck': '5.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000500373', 'lastCheck': '6.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00137943', 'lastCheck': '6.8', 'valid': True}} >Thread-135936::DEBUG::2014-10-29 11:13:13,245::task::1191::Storage.TaskManager.Task::(prepare) Task=`3fb1f9f9-86e9-4876-9c2d-4521b734c6f4`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606141', 'lastCheck': '5.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00142454', 'lastCheck': '5.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000500373', 'lastCheck': '6.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00137943', 'lastCheck': '6.8', 'valid': True}} >Thread-135936::DEBUG::2014-10-29 11:13:13,245::task::595::Storage.TaskManager.Task::(_updateState) Task=`3fb1f9f9-86e9-4876-9c2d-4521b734c6f4`::moving from state preparing -> state finished >Thread-135936::DEBUG::2014-10-29 11:13:13,246::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135936::DEBUG::2014-10-29 11:13:13,246::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135936::DEBUG::2014-10-29 11:13:13,246::task::993::Storage.TaskManager.Task::(_decref) Task=`3fb1f9f9-86e9-4876-9c2d-4521b734c6f4`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:13,972::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:13,974::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135937::DEBUG::2014-10-29 11:13:13,978::task::595::Storage.TaskManager.Task::(_updateState) Task=`6460b8e9-b7f2-40f7-9c76-de1448c384e3`::moving from state init -> state preparing >Thread-135937::INFO::2014-10-29 11:13:13,979::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135937::INFO::2014-10-29 11:13:13,979::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606141', 'lastCheck': '6.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00142454', 'lastCheck': '6.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000500373', 'lastCheck': '7.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00137943', 'lastCheck': '7.5', 'valid': True}} >Thread-135937::DEBUG::2014-10-29 11:13:13,980::task::1191::Storage.TaskManager.Task::(prepare) Task=`6460b8e9-b7f2-40f7-9c76-de1448c384e3`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606141', 'lastCheck': '6.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00142454', 'lastCheck': '6.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000500373', 'lastCheck': '7.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00137943', 'lastCheck': '7.5', 'valid': True}} >Thread-135937::DEBUG::2014-10-29 11:13:13,980::task::595::Storage.TaskManager.Task::(_updateState) Task=`6460b8e9-b7f2-40f7-9c76-de1448c384e3`::moving from state preparing -> state finished >Thread-135937::DEBUG::2014-10-29 11:13:13,980::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135937::DEBUG::2014-10-29 11:13:13,980::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135937::DEBUG::2014-10-29 11:13:13,981::task::993::Storage.TaskManager.Task::(_decref) Task=`6460b8e9-b7f2-40f7-9c76-de1448c384e3`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:14,599::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:14,601::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:14,602::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135937::DEBUG::2014-10-29 11:13:14,814::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:14,840::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:14,843::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135938::DEBUG::2014-10-29 11:13:14,848::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135938::DEBUG::2014-10-29 11:13:14,850::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:13:16,430::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:16,436::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-179::DEBUG::2014-10-29 11:13:16,439::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:13:16,439::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:16,458::__init__::232::IOProcess::(_processLogs) (200355) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:16,460::__init__::232::IOProcess::(_processLogs) (200355) Queuing response >Thread-179::DEBUG::2014-10-29 11:13:16,461::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000804962 s, 462 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:13:16,466::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:16,468::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:16,473::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:16,476::__init__::232::IOProcess::(_processLogs) (200356) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:16,478::__init__::232::IOProcess::(_processLogs) (200356) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:16,481::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:16,482::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:16,484::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:16,485::__init__::232::IOProcess::(_processLogs) (200357) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:16,490::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200357) Queuing response >Thread-10269::DEBUG::2014-10-29 11:13:16,493::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:13:16,512::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000414955 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:13:16,517::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:16,518::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:16,519::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:16,521::__init__::232::IOProcess::(_processLogs) (200358) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:16,526::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200358) Queuing response >Thread-22::DEBUG::2014-10-29 11:13:17,481::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-17::DEBUG::2014-10-29 11:13:17,487::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:17,488::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:17,488::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:17,488::__init__::232::IOProcess::(_processLogs) (200359) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:17,490::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200359) Queuing response >Thread-33::DEBUG::2014-10-29 11:13:17,500::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:13:17,502::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:17,525::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-33::DEBUG::2014-10-29 11:13:17,527::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000611909 s, 796 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:13:17,529::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:17,532::__init__::232::IOProcess::(_processLogs) (200360) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:17,540::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200360) Queuing response >Thread-178::DEBUG::2014-10-29 11:13:17,541::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:13:17,561::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:17,565::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-178::DEBUG::2014-10-29 11:13:17,566::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000487888 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:13:17,567::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:17,568::__init__::232::IOProcess::(_processLogs) (200361) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:17,568::__init__::232::IOProcess::(_processLogs) (200361) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:17,569::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:17,569::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:17,570::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:17,571::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:17,571::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:17,572::__init__::232::IOProcess::(_processLogs) (200362) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:17,572::__init__::232::IOProcess::(_processLogs) (200362) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:17,572::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:17,572::__init__::232::IOProcess::(_processLogs) (200363) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:17,573::__init__::232::IOProcess::(_processLogs) (200363) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:17,575::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:17,576::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:17,577::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:17,577::__init__::232::IOProcess::(_processLogs) (200364) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:17,578::__init__::232::IOProcess::(_processLogs) (200364) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:17,578::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:17,578::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:17,578::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:17,580::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200365) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:17,580::__init__::232::IOProcess::(_processLogs) (200365) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:17,580::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:17,581::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:17,581::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:17,582::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200366) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:17,582::__init__::232::IOProcess::(_processLogs) (200366) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:17,584::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:17,584::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:17,585::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:17,586::__init__::232::IOProcess::(_processLogs) (200367) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:17,586::__init__::232::IOProcess::(_processLogs) (200367) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:17,587::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:17,587::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:17,588::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:17,588::__init__::232::IOProcess::(_processLogs) (200368) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:17,589::__init__::232::IOProcess::(_processLogs) (200368) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:17,898::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:17,901::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135939::DEBUG::2014-10-29 11:13:17,904::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:17,907::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:17,909::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135940::DEBUG::2014-10-29 11:13:17,912::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135940::DEBUG::2014-10-29 11:13:17,914::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:13:19,553::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54158 >Detector thread::DEBUG::2014-10-29 11:13:19,553::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54158 >Detector thread::DEBUG::2014-10-29 11:13:19,554::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54158 >Detector thread::DEBUG::2014-10-29 11:13:19,554::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54158) >Thread-135941::DEBUG::2014-10-29 11:13:19,593::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135941::DEBUG::2014-10-29 11:13:19,594::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135941::DEBUG::2014-10-29 11:13:19,595::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.04', 'elapsedTime': '513832', 'displayType': 'vnc', 'cpuSys': '0.67', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '38867578', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '59621', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '34248.48'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.11', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:19,614::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:19,617::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:19,619::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:13:20,539::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54160 >Detector thread::DEBUG::2014-10-29 11:13:20,540::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54160 >Detector thread::DEBUG::2014-10-29 11:13:20,540::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54160 >Detector thread::DEBUG::2014-10-29 11:13:20,541::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54160) >Thread-135942::DEBUG::2014-10-29 11:13:20,579::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135942::DEBUG::2014-10-29 11:13:20,581::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135942::DEBUG::2014-10-29 11:13:20,603::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135942::DEBUG::2014-10-29 11:13:20,648::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '76', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '76', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:20,934::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:20,936::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135943::DEBUG::2014-10-29 11:13:20,940::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:20,943::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:20,944::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135944::DEBUG::2014-10-29 11:13:20,948::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135944::DEBUG::2014-10-29 11:13:20,950::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:13:21,219::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54161 >Detector thread::DEBUG::2014-10-29 11:13:21,219::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54161 >Detector thread::DEBUG::2014-10-29 11:13:21,220::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54161 >Detector thread::DEBUG::2014-10-29 11:13:21,220::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54161) >Thread-135945::DEBUG::2014-10-29 11:13:21,260::task::595::Storage.TaskManager.Task::(_updateState) Task=`506befd3-892c-453f-b93e-d7096aa91b89`::moving from state init -> state preparing >Thread-135945::INFO::2014-10-29 11:13:21,261::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135945::INFO::2014-10-29 11:13:21,261::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487888', 'lastCheck': '3.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611909', 'lastCheck': '3.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000804962', 'lastCheck': '4.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000414955', 'lastCheck': '4.7', 'valid': True}} >Thread-135945::DEBUG::2014-10-29 11:13:21,262::task::1191::Storage.TaskManager.Task::(prepare) Task=`506befd3-892c-453f-b93e-d7096aa91b89`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487888', 'lastCheck': '3.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611909', 'lastCheck': '3.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000804962', 'lastCheck': '4.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000414955', 'lastCheck': '4.7', 'valid': True}} >Thread-135945::DEBUG::2014-10-29 11:13:21,262::task::595::Storage.TaskManager.Task::(_updateState) Task=`506befd3-892c-453f-b93e-d7096aa91b89`::moving from state preparing -> state finished >Thread-135945::DEBUG::2014-10-29 11:13:21,262::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135945::DEBUG::2014-10-29 11:13:21,262::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135945::DEBUG::2014-10-29 11:13:21,263::task::993::Storage.TaskManager.Task::(_decref) Task=`506befd3-892c-453f-b93e-d7096aa91b89`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:23,961::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:23,964::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135946::DEBUG::2014-10-29 11:13:23,966::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:23,969::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:23,970::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135947::DEBUG::2014-10-29 11:13:23,973::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135947::DEBUG::2014-10-29 11:13:23,976::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:24,625::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:24,627::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:24,628::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:13:26,163::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54163 >Detector thread::DEBUG::2014-10-29 11:13:26,164::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54163 >Detector thread::DEBUG::2014-10-29 11:13:26,164::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54163 >Detector thread::DEBUG::2014-10-29 11:13:26,165::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54163) >Thread-135948::DEBUG::2014-10-29 11:13:26,204::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135948::DEBUG::2014-10-29 11:13:26,205::task::595::Storage.TaskManager.Task::(_updateState) Task=`453b87aa-4bc8-4032-ac8b-d23774bb5088`::moving from state init -> state preparing >Thread-135948::INFO::2014-10-29 11:13:26,205::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135948::DEBUG::2014-10-29 11:13:26,210::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:13:26,211::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:26,212::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:26,212::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:26,212::__init__::232::IOProcess::(_processLogs) (200369) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:13:26,212::__init__::232::IOProcess::(_processLogs) (200369) Queuing response >Thread-135948::DEBUG::2014-10-29 11:13:26,213::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135948::DEBUG::2014-10-29 11:13:26,214::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135948::INFO::2014-10-29 11:13:26,214::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135948::DEBUG::2014-10-29 11:13:26,214::task::1191::Storage.TaskManager.Task::(prepare) Task=`453b87aa-4bc8-4032-ac8b-d23774bb5088`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135948::DEBUG::2014-10-29 11:13:26,215::task::595::Storage.TaskManager.Task::(_updateState) Task=`453b87aa-4bc8-4032-ac8b-d23774bb5088`::moving from state preparing -> state finished >Thread-135948::DEBUG::2014-10-29 11:13:26,215::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135948::DEBUG::2014-10-29 11:13:26,215::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135948::DEBUG::2014-10-29 11:13:26,215::task::993::Storage.TaskManager.Task::(_decref) Task=`453b87aa-4bc8-4032-ac8b-d23774bb5088`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:13:26,259::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54164 >Detector thread::DEBUG::2014-10-29 11:13:26,260::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54164 >Detector thread::DEBUG::2014-10-29 11:13:26,260::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54164 >Detector thread::DEBUG::2014-10-29 11:13:26,261::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54164) >Thread-135949::DEBUG::2014-10-29 11:13:26,299::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135949::DEBUG::2014-10-29 11:13:26,300::task::595::Storage.TaskManager.Task::(_updateState) Task=`152da67f-d339-4b5c-b092-70b65d736089`::moving from state init -> state preparing >Thread-135949::INFO::2014-10-29 11:13:26,300::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135949::DEBUG::2014-10-29 11:13:26,300::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135949::DEBUG::2014-10-29 11:13:26,301::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135949::DEBUG::2014-10-29 11:13:26,301::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135949::DEBUG::2014-10-29 11:13:26,301::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135949::DEBUG::2014-10-29 11:13:26,301::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135949::DEBUG::2014-10-29 11:13:26,302::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135949::DEBUG::2014-10-29 11:13:26,388::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135949::DEBUG::2014-10-29 11:13:26,389::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-17::DEBUG::2014-10-29 11:13:26,480::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:26,480::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:26,481::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:26,481::__init__::232::IOProcess::(_processLogs) (200370) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:26,482::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200370) Queuing response >Thread-179::DEBUG::2014-10-29 11:13:26,485::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:13:26,510::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000560248 s, 664 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:13:26,512::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:26,514::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:26,516::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:26,516::__init__::232::IOProcess::(_processLogs) (200371) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:26,516::__init__::232::IOProcess::(_processLogs) (200371) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:26,530::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:26,530::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:26,532::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-10269::DEBUG::2014-10-29 11:13:26,534::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:13:26,534::__init__::232::IOProcess::(_processLogs) (200372) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:26,554::__init__::232::IOProcess::(_processLogs) (200372) Queuing response >Thread-10269::DEBUG::2014-10-29 11:13:26,565::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00894354 s, 56.1 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:13:26,566::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:26,566::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:26,567::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:26,567::__init__::232::IOProcess::(_processLogs) (200373) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:26,569::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200373) Queuing response >Thread-135949::DEBUG::2014-10-29 11:13:26,580::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135949::DEBUG::2014-10-29 11:13:26,581::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135949::DEBUG::2014-10-29 11:13:26,581::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135949::DEBUG::2014-10-29 11:13:26,582::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135949::DEBUG::2014-10-29 11:13:26,582::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135949::DEBUG::2014-10-29 11:13:26,582::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135949::DEBUG::2014-10-29 11:13:26,583::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135949::DEBUG::2014-10-29 11:13:26,583::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:13:26,586::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:26,587::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:26,587::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:26,587::__init__::232::IOProcess::(_processLogs) (200374) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:13:26,588::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200374) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:26,594::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:26,594::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:26,595::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:26,595::__init__::232::IOProcess::(_processLogs) (200375) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:13:26,596::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200375) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:26,597::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:26,599::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:26,602::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:26,604::__init__::232::IOProcess::(_processLogs) (200376) Got request for method 'glob' >Thread-135949::DEBUG::2014-10-29 11:13:26,608::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:13:26,609::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200376) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:26,612::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:26,612::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:26,612::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:26,612::__init__::232::IOProcess::(_processLogs) (200377) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:13:26,613::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200377) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:26,614::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:26,615::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:26,615::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:26,615::__init__::232::IOProcess::(_processLogs) (200378) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:13:26,616::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200378) Queuing response >Thread-135949::DEBUG::2014-10-29 11:13:26,616::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:13:26,618::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:26,619::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:26,619::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:26,619::__init__::232::IOProcess::(_processLogs) (200379) Got request for method 'readfile' >Thread-135949::DEBUG::2014-10-29 11:13:26,620::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:13:26,620::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200379) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:26,623::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:26,624::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:26,625::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:26,625::__init__::232::IOProcess::(_processLogs) (200380) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:26,625::__init__::232::IOProcess::(_processLogs) (200380) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:26,626::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:26,626::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:26,626::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:26,627::__init__::232::IOProcess::(_processLogs) (200381) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:13:26,627::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200381) Queuing response >Thread-135949::DEBUG::2014-10-29 11:13:26,627::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-135949::INFO::2014-10-29 11:13:26,629::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135949::INFO::2014-10-29 11:13:26,629::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135949::INFO::2014-10-29 11:13:26,629::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:13:26,630::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:26,630::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:26,630::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:26,631::__init__::232::IOProcess::(_processLogs) (200382) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:13:26,632::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200382) Queuing response >Thread-135949::DEBUG::2014-10-29 11:13:26,633::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135949::DEBUG::2014-10-29 11:13:26,634::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`6e77029f-31d7-4f86-b629-53446f54b95d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135949::DEBUG::2014-10-29 11:13:26,634::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135949::DEBUG::2014-10-29 11:13:26,635::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135949::DEBUG::2014-10-29 11:13:26,635::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`6e77029f-31d7-4f86-b629-53446f54b95d`::Granted request >Thread-135949::DEBUG::2014-10-29 11:13:26,636::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`152da67f-d339-4b5c-b092-70b65d736089`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135949::DEBUG::2014-10-29 11:13:26,636::task::993::Storage.TaskManager.Task::(_decref) Task=`152da67f-d339-4b5c-b092-70b65d736089`::ref 1 aborting False >Thread-135949::INFO::2014-10-29 11:13:26,639::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135949::DEBUG::2014-10-29 11:13:26,639::task::1191::Storage.TaskManager.Task::(prepare) Task=`152da67f-d339-4b5c-b092-70b65d736089`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135949::DEBUG::2014-10-29 11:13:26,639::task::595::Storage.TaskManager.Task::(_updateState) Task=`152da67f-d339-4b5c-b092-70b65d736089`::moving from state preparing -> state finished >Thread-135949::DEBUG::2014-10-29 11:13:26,640::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135949::DEBUG::2014-10-29 11:13:26,640::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135949::DEBUG::2014-10-29 11:13:26,640::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135949::DEBUG::2014-10-29 11:13:26,641::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135949::DEBUG::2014-10-29 11:13:26,641::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135949::DEBUG::2014-10-29 11:13:26,641::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135949::DEBUG::2014-10-29 11:13:26,641::task::993::Storage.TaskManager.Task::(_decref) Task=`152da67f-d339-4b5c-b092-70b65d736089`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:13:26,664::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54165 >Detector thread::DEBUG::2014-10-29 11:13:26,665::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54165 >Detector thread::DEBUG::2014-10-29 11:13:26,665::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54165 >Detector thread::DEBUG::2014-10-29 11:13:26,665::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54165) >Thread-135954::DEBUG::2014-10-29 11:13:26,704::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135954::DEBUG::2014-10-29 11:13:26,705::task::595::Storage.TaskManager.Task::(_updateState) Task=`fde302b9-12b2-4e60-b7f6-f4317a55461f`::moving from state init -> state preparing >Thread-135954::INFO::2014-10-29 11:13:26,705::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135954::INFO::2014-10-29 11:13:26,706::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487888', 'lastCheck': '9.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611909', 'lastCheck': '9.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000560248', 'lastCheck': '0.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00894354', 'lastCheck': '0.1', 'valid': True}} >Thread-135954::DEBUG::2014-10-29 11:13:26,706::task::1191::Storage.TaskManager.Task::(prepare) Task=`fde302b9-12b2-4e60-b7f6-f4317a55461f`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487888', 'lastCheck': '9.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611909', 'lastCheck': '9.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000560248', 'lastCheck': '0.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00894354', 'lastCheck': '0.1', 'valid': True}} >Thread-135954::DEBUG::2014-10-29 11:13:26,706::task::595::Storage.TaskManager.Task::(_updateState) Task=`fde302b9-12b2-4e60-b7f6-f4317a55461f`::moving from state preparing -> state finished >Thread-135954::DEBUG::2014-10-29 11:13:26,706::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135954::DEBUG::2014-10-29 11:13:26,707::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135954::DEBUG::2014-10-29 11:13:26,707::task::993::Storage.TaskManager.Task::(_decref) Task=`fde302b9-12b2-4e60-b7f6-f4317a55461f`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:26,990::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:26,992::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135955::DEBUG::2014-10-29 11:13:26,995::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:26,998::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:27,000::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135956::DEBUG::2014-10-29 11:13:27,003::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135956::DEBUG::2014-10-29 11:13:27,005::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:13:27,587::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:27,590::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:27,592::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:27,594::__init__::232::IOProcess::(_processLogs) (200383) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:27,599::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200383) Queuing response >Thread-33::DEBUG::2014-10-29 11:13:27,602::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:13:27,619::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:27,625::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-33::DEBUG::2014-10-29 11:13:27,628::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000565063 s, 862 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:13:27,636::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-178::DEBUG::2014-10-29 11:13:27,637::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:13:27,638::__init__::232::IOProcess::(_processLogs) (200384) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:27,657::__init__::232::IOProcess::(_processLogs) (200384) Queuing response >Thread-178::DEBUG::2014-10-29 11:13:27,658::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000504629 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:13:27,662::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:27,662::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:27,663::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:27,663::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:27,665::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:27,666::__init__::232::IOProcess::(_processLogs) (200385) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:27,666::__init__::232::IOProcess::(_processLogs) (200385) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:27,667::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:27,667::__init__::232::IOProcess::(_processLogs) (200386) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:27,667::__init__::232::IOProcess::(_processLogs) (200386) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:27,670::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:27,670::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:27,670::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:27,671::__init__::232::IOProcess::(_processLogs) (200387) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:27,672::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200387) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:27,673::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:27,673::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:27,673::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:27,674::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:27,674::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:27,675::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200388) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:27,676::__init__::232::IOProcess::(_processLogs) (200388) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:27,676::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:27,676::__init__::232::IOProcess::(_processLogs) (200389) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:27,676::__init__::232::IOProcess::(_processLogs) (200389) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:27,678::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:27,679::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:27,679::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:27,679::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:27,679::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:27,680::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200390) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:27,681::__init__::232::IOProcess::(_processLogs) (200390) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:27,681::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:27,682::__init__::232::IOProcess::(_processLogs) (200391) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:27,682::__init__::232::IOProcess::(_processLogs) (200391) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:27,683::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:27,684::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:27,684::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:27,687::__init__::232::IOProcess::(_processLogs) (200392) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:27,687::__init__::232::IOProcess::(_processLogs) (200392) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:29,635::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:29,641::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:29,646::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:13:29,745::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54166 >Detector thread::DEBUG::2014-10-29 11:13:29,746::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54166 >Detector thread::DEBUG::2014-10-29 11:13:29,746::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54166 >Detector thread::DEBUG::2014-10-29 11:13:29,747::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54166) >Thread-135957::DEBUG::2014-10-29 11:13:29,786::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135957::DEBUG::2014-10-29 11:13:29,788::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135957::DEBUG::2014-10-29 11:13:29,789::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.04', 'elapsedTime': '513842', 'displayType': 'vnc', 'cpuSys': '0.67', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '38867578', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '59621', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '34248.48'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.30', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:30,020::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:30,023::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135958::DEBUG::2014-10-29 11:13:30,028::task::595::Storage.TaskManager.Task::(_updateState) Task=`afd458ad-1314-420c-8c7d-43ef652b1557`::moving from state init -> state preparing >Thread-135958::INFO::2014-10-29 11:13:30,028::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135958::INFO::2014-10-29 11:13:30,029::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504629', 'lastCheck': '2.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565063', 'lastCheck': '2.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000560248', 'lastCheck': '3.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00894354', 'lastCheck': '3.5', 'valid': True}} >Thread-135958::DEBUG::2014-10-29 11:13:30,029::task::1191::Storage.TaskManager.Task::(prepare) Task=`afd458ad-1314-420c-8c7d-43ef652b1557`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504629', 'lastCheck': '2.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565063', 'lastCheck': '2.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000560248', 'lastCheck': '3.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00894354', 'lastCheck': '3.5', 'valid': True}} >Thread-135958::DEBUG::2014-10-29 11:13:30,029::task::595::Storage.TaskManager.Task::(_updateState) Task=`afd458ad-1314-420c-8c7d-43ef652b1557`::moving from state preparing -> state finished >Thread-135958::DEBUG::2014-10-29 11:13:30,030::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135958::DEBUG::2014-10-29 11:13:30,030::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135958::DEBUG::2014-10-29 11:13:30,030::task::993::Storage.TaskManager.Task::(_decref) Task=`afd458ad-1314-420c-8c7d-43ef652b1557`::ref 0 aborting False >Thread-135958::DEBUG::2014-10-29 11:13:30,057::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:30,080::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:30,082::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135959::DEBUG::2014-10-29 11:13:30,085::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135959::DEBUG::2014-10-29 11:13:30,087::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:13:30,318::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54168 >Detector thread::DEBUG::2014-10-29 11:13:30,319::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54168 >Detector thread::DEBUG::2014-10-29 11:13:30,319::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54168 >Detector thread::DEBUG::2014-10-29 11:13:30,320::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54168) >Thread-135960::DEBUG::2014-10-29 11:13:30,360::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f95a7c5-341d-4e36-93a1-9af3696100c4`::moving from state init -> state preparing >Thread-135960::INFO::2014-10-29 11:13:30,360::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135960::INFO::2014-10-29 11:13:30,361::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504629', 'lastCheck': '2.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565063', 'lastCheck': '2.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000560248', 'lastCheck': '3.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00894354', 'lastCheck': '3.8', 'valid': True}} >Thread-135960::DEBUG::2014-10-29 11:13:30,361::task::1191::Storage.TaskManager.Task::(prepare) Task=`7f95a7c5-341d-4e36-93a1-9af3696100c4`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504629', 'lastCheck': '2.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565063', 'lastCheck': '2.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000560248', 'lastCheck': '3.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00894354', 'lastCheck': '3.8', 'valid': True}} >Thread-135960::DEBUG::2014-10-29 11:13:30,361::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f95a7c5-341d-4e36-93a1-9af3696100c4`::moving from state preparing -> state finished >Thread-135960::DEBUG::2014-10-29 11:13:30,362::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135960::DEBUG::2014-10-29 11:13:30,362::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135960::DEBUG::2014-10-29 11:13:30,362::task::993::Storage.TaskManager.Task::(_decref) Task=`7f95a7c5-341d-4e36-93a1-9af3696100c4`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:13:30,689::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54169 >Detector thread::DEBUG::2014-10-29 11:13:30,690::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54169 >Detector thread::DEBUG::2014-10-29 11:13:30,690::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54169 >Detector thread::DEBUG::2014-10-29 11:13:30,690::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54169) >Thread-135961::DEBUG::2014-10-29 11:13:30,729::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135961::DEBUG::2014-10-29 11:13:30,731::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135961::DEBUG::2014-10-29 11:13:30,749::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135961::DEBUG::2014-10-29 11:13:30,796::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '61', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '61', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-22::DEBUG::2014-10-29 11:13:32,504::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:33,129::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:33,131::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135962::DEBUG::2014-10-29 11:13:33,135::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:33,137::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:33,139::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135963::DEBUG::2014-10-29 11:13:33,142::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135963::DEBUG::2014-10-29 11:13:33,144::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:13:33,629::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:34,655::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:34,656::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:34,657::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:36,162::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:36,165::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135964::DEBUG::2014-10-29 11:13:36,169::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:36,171::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:36,173::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135965::DEBUG::2014-10-29 11:13:36,176::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135965::DEBUG::2014-10-29 11:13:36,178::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:13:36,518::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:36,519::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:36,519::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:36,519::__init__::232::IOProcess::(_processLogs) (200393) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:36,521::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200393) Queuing response >Thread-179::DEBUG::2014-10-29 11:13:36,523::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:13:36,549::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00535677 s, 69.4 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:13:36,551::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:36,551::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:36,552::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:36,552::__init__::232::IOProcess::(_processLogs) (200394) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:36,554::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200394) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:36,572::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:36,572::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:36,572::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:36,573::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200395) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:36,574::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200395) Queuing response >Thread-10269::DEBUG::2014-10-29 11:13:36,576::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:13:36,597::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00198712 s, 253 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:13:36,599::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:36,599::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:36,599::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:36,600::__init__::232::IOProcess::(_processLogs) (200396) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:36,600::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200396) Queuing response >Detector thread::DEBUG::2014-10-29 11:13:37,312::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54171 >Detector thread::DEBUG::2014-10-29 11:13:37,312::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54171 >Detector thread::DEBUG::2014-10-29 11:13:37,313::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54171 >Detector thread::DEBUG::2014-10-29 11:13:37,313::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54171) >Thread-135966::DEBUG::2014-10-29 11:13:37,353::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135966::DEBUG::2014-10-29 11:13:37,354::task::595::Storage.TaskManager.Task::(_updateState) Task=`f82473fb-3296-4d88-b829-6a64282ede76`::moving from state init -> state preparing >Thread-135966::INFO::2014-10-29 11:13:37,354::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135966::DEBUG::2014-10-29 11:13:37,357::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:13:37,358::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:37,358::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:37,358::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:37,359::__init__::232::IOProcess::(_processLogs) (200397) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:13:37,360::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200397) Queuing response >Thread-135966::DEBUG::2014-10-29 11:13:37,360::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-135966::DEBUG::2014-10-29 11:13:37,361::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135966::INFO::2014-10-29 11:13:37,362::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135966::DEBUG::2014-10-29 11:13:37,362::task::1191::Storage.TaskManager.Task::(prepare) Task=`f82473fb-3296-4d88-b829-6a64282ede76`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135966::DEBUG::2014-10-29 11:13:37,362::task::595::Storage.TaskManager.Task::(_updateState) Task=`f82473fb-3296-4d88-b829-6a64282ede76`::moving from state preparing -> state finished >Thread-135966::DEBUG::2014-10-29 11:13:37,362::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135966::DEBUG::2014-10-29 11:13:37,363::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135966::DEBUG::2014-10-29 11:13:37,363::task::993::Storage.TaskManager.Task::(_decref) Task=`f82473fb-3296-4d88-b829-6a64282ede76`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:13:37,406::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54172 >Detector thread::DEBUG::2014-10-29 11:13:37,407::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54172 >Detector thread::DEBUG::2014-10-29 11:13:37,407::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54172 >Detector thread::DEBUG::2014-10-29 11:13:37,408::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54172) >Thread-135967::DEBUG::2014-10-29 11:13:37,447::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135967::DEBUG::2014-10-29 11:13:37,447::task::595::Storage.TaskManager.Task::(_updateState) Task=`f2c38c40-cd6b-44fc-b0e2-871c11d7e051`::moving from state init -> state preparing >Thread-135967::INFO::2014-10-29 11:13:37,448::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135967::DEBUG::2014-10-29 11:13:37,448::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135967::DEBUG::2014-10-29 11:13:37,448::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135967::DEBUG::2014-10-29 11:13:37,449::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135967::DEBUG::2014-10-29 11:13:37,449::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135967::DEBUG::2014-10-29 11:13:37,449::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135967::DEBUG::2014-10-29 11:13:37,450::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135967::DEBUG::2014-10-29 11:13:37,541::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135967::DEBUG::2014-10-29 11:13:37,542::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-178::DEBUG::2014-10-29 11:13:37,691::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:13:37,712::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:37,716::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:37,718::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-178::DEBUG::2014-10-29 11:13:37,718::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000810091 s, 627 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:13:37,721::__init__::232::IOProcess::(_processLogs) (200398) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:37,725::__init__::232::IOProcess::(_processLogs) (200398) Queuing response >Thread-135967::DEBUG::2014-10-29 11:13:37,725::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135967::DEBUG::2014-10-29 11:13:37,731::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-10-29 11:13:37,731::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:37,735::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-135967::DEBUG::2014-10-29 11:13:37,736::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-10-29 11:13:37,738::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:37,741::__init__::232::IOProcess::(_processLogs) (200399) Got request for method 'statvfs' >Thread-135967::DEBUG::2014-10-29 11:13:37,742::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135967::DEBUG::2014-10-29 11:13:37,745::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135967::DEBUG::2014-10-29 11:13:37,746::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135967::DEBUG::2014-10-29 11:13:37,752::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-10-29 11:13:37,752::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200399) Queuing response >Thread-135967::DEBUG::2014-10-29 11:13:37,756::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:13:37,759::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:37,761::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:37,765::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:37,767::__init__::232::IOProcess::(_processLogs) (200400) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:37,768::__init__::232::IOProcess::(_processLogs) (200400) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:37,770::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:37,770::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:37,770::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:37,771::__init__::232::IOProcess::(_processLogs) (200401) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:13:37,772::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200401) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:37,773::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:37,773::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:37,773::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:37,773::__init__::232::IOProcess::(_processLogs) (200402) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:13:37,774::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200402) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:37,778::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:37,780::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:37,781::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:37,786::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200403) Got request for method 'glob' >Thread-135967::DEBUG::2014-10-29 11:13:37,787::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:13:37,788::__init__::232::IOProcess::(_processLogs) (200403) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:37,790::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:37,790::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:37,790::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:37,790::__init__::232::IOProcess::(_processLogs) (200404) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:13:37,791::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200404) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:37,792::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:37,793::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:37,793::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:37,793::__init__::232::IOProcess::(_processLogs) (200405) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:37,793::__init__::232::IOProcess::(_processLogs) (200405) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:37,795::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:37,795::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:37,796::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:37,796::__init__::232::IOProcess::(_processLogs) (200406) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:13:37,796::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:37,797::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:37,798::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:37,799::__init__::232::IOProcess::(_processLogs) (200407) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:37,799::__init__::232::IOProcess::(_processLogs) (200407) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:37,799::__init__::232::IOProcess::(_processLogs) (200406) Queuing response >Thread-135967::DEBUG::2014-10-29 11:13:37,800::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:13:37,801::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:37,801::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:37,801::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:37,802::__init__::232::IOProcess::(_processLogs) (200408) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:13:37,802::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200408) Queuing response >Thread-135967::DEBUG::2014-10-29 11:13:37,803::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:13:37,805::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:37,806::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:37,806::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:37,807::__init__::232::IOProcess::(_processLogs) (200409) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:37,807::__init__::232::IOProcess::(_processLogs) (200409) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:37,807::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:37,808::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:37,808::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:37,808::__init__::232::IOProcess::(_processLogs) (200410) Got request for method 'glob' >Thread-135967::DEBUG::2014-10-29 11:13:37,809::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:13:37,809::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200410) Queuing response >Thread-135967::INFO::2014-10-29 11:13:37,810::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135967::INFO::2014-10-29 11:13:37,811::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135967::INFO::2014-10-29 11:13:37,811::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:13:37,813::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:37,814::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:37,814::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:37,814::__init__::232::IOProcess::(_processLogs) (200411) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:37,815::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200411) Queuing response >Thread-33::DEBUG::2014-10-29 11:13:37,817::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:13:37,818::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:37,838::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:37,838::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:37,838::__init__::232::IOProcess::(_processLogs) (200412) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:13:37,840::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200412) Queuing response >Thread-135967::DEBUG::2014-10-29 11:13:37,840::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-33::DEBUG::2014-10-29 11:13:37,843::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00145542 s, 335 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:13:37,847::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:37,849::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-135967::DEBUG::2014-10-29 11:13:37,850::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`4b62a3bd-ab0a-42bf-b34f-83ad2bff4cc4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-17::DEBUG::2014-10-29 11:13:37,851::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-135967::DEBUG::2014-10-29 11:13:37,852::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-17::DEBUG::2014-10-29 11:13:37,852::__init__::232::IOProcess::(_processLogs) (200413) Got request for method 'statvfs' >Thread-135967::DEBUG::2014-10-29 11:13:37,856::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-17::DEBUG::2014-10-29 11:13:37,856::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200413) Queuing response >Thread-135967::DEBUG::2014-10-29 11:13:37,858::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`4b62a3bd-ab0a-42bf-b34f-83ad2bff4cc4`::Granted request >Thread-17::DEBUG::2014-10-29 11:13:37,861::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-135967::DEBUG::2014-10-29 11:13:37,861::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f2c38c40-cd6b-44fc-b0e2-871c11d7e051`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135967::DEBUG::2014-10-29 11:13:37,862::task::993::Storage.TaskManager.Task::(_decref) Task=`f2c38c40-cd6b-44fc-b0e2-871c11d7e051`::ref 1 aborting False >Thread-17::DEBUG::2014-10-29 11:13:37,862::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:37,864::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:37,866::__init__::232::IOProcess::(_processLogs) (200414) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:37,869::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200414) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:37,872::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:37,874::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:37,876::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-135967::INFO::2014-10-29 11:13:37,877::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-17::DEBUG::2014-10-29 11:13:37,877::__init__::232::IOProcess::(_processLogs) (200415) Got request for method 'access' >Thread-135967::DEBUG::2014-10-29 11:13:37,878::task::1191::Storage.TaskManager.Task::(prepare) Task=`f2c38c40-cd6b-44fc-b0e2-871c11d7e051`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-17::DEBUG::2014-10-29 11:13:37,879::__init__::232::IOProcess::(_processLogs) (200415) Queuing response >Thread-135967::DEBUG::2014-10-29 11:13:37,880::task::595::Storage.TaskManager.Task::(_updateState) Task=`f2c38c40-cd6b-44fc-b0e2-871c11d7e051`::moving from state preparing -> state finished >Thread-135967::DEBUG::2014-10-29 11:13:37,881::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135967::DEBUG::2014-10-29 11:13:37,882::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135967::DEBUG::2014-10-29 11:13:37,885::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-17::DEBUG::2014-10-29 11:13:37,886::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-135967::DEBUG::2014-10-29 11:13:37,886::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-17::DEBUG::2014-10-29 11:13:37,887::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-135967::DEBUG::2014-10-29 11:13:37,888::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-17::DEBUG::2014-10-29 11:13:37,889::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-135967::DEBUG::2014-10-29 11:13:37,889::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-17::DEBUG::2014-10-29 11:13:37,890::__init__::232::IOProcess::(_processLogs) (200416) Got request for method 'access' >Thread-135967::DEBUG::2014-10-29 11:13:37,893::task::993::Storage.TaskManager.Task::(_decref) Task=`f2c38c40-cd6b-44fc-b0e2-871c11d7e051`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:13:37,896::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200416) Queuing response >Detector thread::DEBUG::2014-10-29 11:13:37,918::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54173 >Detector thread::DEBUG::2014-10-29 11:13:37,919::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54173 >Detector thread::DEBUG::2014-10-29 11:13:37,919::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54173 >Detector thread::DEBUG::2014-10-29 11:13:37,920::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54173) >Thread-135972::DEBUG::2014-10-29 11:13:37,959::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135972::DEBUG::2014-10-29 11:13:37,959::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a007d71-57da-467f-a062-21fb09da9ae3`::moving from state init -> state preparing >Thread-135972::INFO::2014-10-29 11:13:37,960::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135972::INFO::2014-10-29 11:13:37,961::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000810091', 'lastCheck': '0.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00145542', 'lastCheck': '0.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00535677', 'lastCheck': '1.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00198712', 'lastCheck': '1.4', 'valid': True}} >Thread-135972::DEBUG::2014-10-29 11:13:37,961::task::1191::Storage.TaskManager.Task::(prepare) Task=`5a007d71-57da-467f-a062-21fb09da9ae3`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000810091', 'lastCheck': '0.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00145542', 'lastCheck': '0.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00535677', 'lastCheck': '1.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00198712', 'lastCheck': '1.4', 'valid': True}} >Thread-135972::DEBUG::2014-10-29 11:13:37,961::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a007d71-57da-467f-a062-21fb09da9ae3`::moving from state preparing -> state finished >Thread-135972::DEBUG::2014-10-29 11:13:37,961::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135972::DEBUG::2014-10-29 11:13:37,962::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135972::DEBUG::2014-10-29 11:13:37,962::task::993::Storage.TaskManager.Task::(_decref) Task=`5a007d71-57da-467f-a062-21fb09da9ae3`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:39,205::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:39,208::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135973::DEBUG::2014-10-29 11:13:39,212::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:39,215::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:39,217::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135974::DEBUG::2014-10-29 11:13:39,220::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135974::DEBUG::2014-10-29 11:13:39,222::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:39,661::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:39,663::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:39,664::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:13:39,980::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54174 >Detector thread::DEBUG::2014-10-29 11:13:39,981::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54174 >Detector thread::DEBUG::2014-10-29 11:13:39,981::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54174 >Detector thread::DEBUG::2014-10-29 11:13:39,982::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54174) >Thread-135975::DEBUG::2014-10-29 11:13:40,022::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135975::DEBUG::2014-10-29 11:13:40,026::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135975::DEBUG::2014-10-29 11:13:40,027::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.54', 'elapsedTime': '513852', 'displayType': 'vnc', 'cpuSys': '0.60', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '38867578', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '59621', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '34248.48'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.52', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:13:40,420::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54176 >Detector thread::DEBUG::2014-10-29 11:13:40,421::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54176 >Detector thread::DEBUG::2014-10-29 11:13:40,421::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54176 >Detector thread::DEBUG::2014-10-29 11:13:40,421::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54176) >Thread-135976::DEBUG::2014-10-29 11:13:40,462::task::595::Storage.TaskManager.Task::(_updateState) Task=`338fc13e-b845-4a26-b868-b3e93e38f278`::moving from state init -> state preparing >Thread-135976::INFO::2014-10-29 11:13:40,463::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135976::INFO::2014-10-29 11:13:40,464::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000810091', 'lastCheck': '2.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00145542', 'lastCheck': '2.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00535677', 'lastCheck': '3.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00198712', 'lastCheck': '3.9', 'valid': True}} >Thread-135976::DEBUG::2014-10-29 11:13:40,464::task::1191::Storage.TaskManager.Task::(prepare) Task=`338fc13e-b845-4a26-b868-b3e93e38f278`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000810091', 'lastCheck': '2.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00145542', 'lastCheck': '2.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00535677', 'lastCheck': '3.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00198712', 'lastCheck': '3.9', 'valid': True}} >Thread-135976::DEBUG::2014-10-29 11:13:40,464::task::595::Storage.TaskManager.Task::(_updateState) Task=`338fc13e-b845-4a26-b868-b3e93e38f278`::moving from state preparing -> state finished >Thread-135976::DEBUG::2014-10-29 11:13:40,464::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135976::DEBUG::2014-10-29 11:13:40,465::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135976::DEBUG::2014-10-29 11:13:40,465::task::993::Storage.TaskManager.Task::(_decref) Task=`338fc13e-b845-4a26-b868-b3e93e38f278`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:13:40,845::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54177 >Detector thread::DEBUG::2014-10-29 11:13:40,846::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54177 >Detector thread::DEBUG::2014-10-29 11:13:40,846::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54177 >Detector thread::DEBUG::2014-10-29 11:13:40,847::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54177) >Thread-135977::DEBUG::2014-10-29 11:13:40,885::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135977::DEBUG::2014-10-29 11:13:40,887::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135977::DEBUG::2014-10-29 11:13:40,909::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135977::DEBUG::2014-10-29 11:13:40,957::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '45', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '45', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:42,238::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:42,241::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135978::DEBUG::2014-10-29 11:13:42,244::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:42,247::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:42,250::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135979::DEBUG::2014-10-29 11:13:42,253::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135979::DEBUG::2014-10-29 11:13:42,255::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:44,671::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:44,672::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:44,673::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:45,271::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:45,275::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135980::DEBUG::2014-10-29 11:13:45,279::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a76c51b-d164-4935-a78c-58a5a24b5aba`::moving from state init -> state preparing >Thread-135980::INFO::2014-10-29 11:13:45,280::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135980::INFO::2014-10-29 11:13:45,280::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000810091', 'lastCheck': '7.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00145542', 'lastCheck': '7.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00535677', 'lastCheck': '8.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00198712', 'lastCheck': '8.7', 'valid': True}} >Thread-135980::DEBUG::2014-10-29 11:13:45,281::task::1191::Storage.TaskManager.Task::(prepare) Task=`2a76c51b-d164-4935-a78c-58a5a24b5aba`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000810091', 'lastCheck': '7.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00145542', 'lastCheck': '7.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00535677', 'lastCheck': '8.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00198712', 'lastCheck': '8.7', 'valid': True}} >Thread-135980::DEBUG::2014-10-29 11:13:45,281::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a76c51b-d164-4935-a78c-58a5a24b5aba`::moving from state preparing -> state finished >Thread-135980::DEBUG::2014-10-29 11:13:45,281::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135980::DEBUG::2014-10-29 11:13:45,282::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135980::DEBUG::2014-10-29 11:13:45,282::task::993::Storage.TaskManager.Task::(_decref) Task=`2a76c51b-d164-4935-a78c-58a5a24b5aba`::ref 0 aborting False >Thread-135980::DEBUG::2014-10-29 11:13:45,305::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:45,327::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:45,329::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135981::DEBUG::2014-10-29 11:13:45,333::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135981::DEBUG::2014-10-29 11:13:45,335::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:13:46,561::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:46,562::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:46,564::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:46,565::__init__::232::IOProcess::(_processLogs) (200417) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:46,571::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200417) Queuing response >Thread-179::DEBUG::2014-10-29 11:13:46,573::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:13:46,601::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00959411 s, 38.8 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:13:46,608::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:46,609::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:46,610::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:46,611::__init__::232::IOProcess::(_processLogs) (200418) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:46,618::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200418) Queuing response >Thread-10269::DEBUG::2014-10-29 11:13:46,620::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:13:46,620::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:46,638::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:46,641::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-10269::DEBUG::2014-10-29 11:13:46,641::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000535682 s, 937 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:13:46,644::__init__::232::IOProcess::(_processLogs) (200419) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:46,652::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200419) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:46,655::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:46,657::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:46,659::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:46,660::__init__::232::IOProcess::(_processLogs) (200420) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:46,666::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200420) Queuing response >Thread-22::DEBUG::2014-10-29 11:13:47,509::task::595::Storage.TaskManager.Task::(_updateState) Task=`be671222-adeb-4a9c-a1d9-39798026e5b0`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:13:47,509::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:13:47,510::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:47,511::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:47,511::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:47,511::__init__::232::IOProcess::(_processLogs) (200421) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:13:47,516::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200421) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:47,518::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:47,520::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-22::INFO::2014-10-29 11:13:47,520::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010863616', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:13:47,521::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-22::DEBUG::2014-10-29 11:13:47,522::task::1191::Storage.TaskManager.Task::(prepare) Task=`be671222-adeb-4a9c-a1d9-39798026e5b0`::finished: {'truesize': '6010863616', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:13:47,523::task::595::Storage.TaskManager.Task::(_updateState) Task=`be671222-adeb-4a9c-a1d9-39798026e5b0`::moving from state preparing -> state finished >Thread-17::DEBUG::2014-10-29 11:13:47,523::__init__::232::IOProcess::(_processLogs) (200422) Got request for method 'stat' >Thread-22::DEBUG::2014-10-29 11:13:47,524::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17::DEBUG::2014-10-29 11:13:47,526::__init__::232::IOProcess::(_processLogs) (200422) Queuing response >Thread-22::DEBUG::2014-10-29 11:13:47,526::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2014-10-29 11:13:47,527::task::993::Storage.TaskManager.Task::(_decref) Task=`be671222-adeb-4a9c-a1d9-39798026e5b0`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:13:47,605::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-17::DEBUG::2014-10-29 11:13:47,799::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:47,800::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:47,800::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:47,801::__init__::232::IOProcess::(_processLogs) (200423) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:47,802::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200423) Queuing response >Thread-178::DEBUG::2014-10-29 11:13:47,803::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:13:47,822::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000584719 s, 869 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:13:47,825::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:47,825::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:47,825::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:47,825::__init__::232::IOProcess::(_processLogs) (200424) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:47,826::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200424) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:47,829::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:47,829::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:47,830::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:47,831::__init__::232::IOProcess::(_processLogs) (200425) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:47,831::__init__::232::IOProcess::(_processLogs) (200425) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:47,832::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:47,832::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:47,833::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:47,833::__init__::232::IOProcess::(_processLogs) (200426) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:47,834::__init__::232::IOProcess::(_processLogs) (200426) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:47,834::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:47,834::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:47,835::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:47,836::__init__::232::IOProcess::(_processLogs) (200427) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:47,837::__init__::232::IOProcess::(_processLogs) (200427) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:47,898::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:47,898::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:47,898::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:47,899::__init__::232::IOProcess::(_processLogs) (200428) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:47,900::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200428) Queuing response >Thread-33::DEBUG::2014-10-29 11:13:47,902::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:13:47,921::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000575373 s, 846 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:13:47,923::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:47,923::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:47,923::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:47,924::__init__::232::IOProcess::(_processLogs) (200429) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:47,925::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200429) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:47,927::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:47,928::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:47,929::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:47,929::__init__::232::IOProcess::(_processLogs) (200430) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:47,929::__init__::232::IOProcess::(_processLogs) (200430) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:47,930::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:47,931::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:47,931::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:47,931::__init__::232::IOProcess::(_processLogs) (200431) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:47,932::__init__::232::IOProcess::(_processLogs) (200431) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:47,933::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:47,933::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:47,934::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:47,935::__init__::232::IOProcess::(_processLogs) (200432) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:47,936::__init__::232::IOProcess::(_processLogs) (200432) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:48,390::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:48,393::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135982::DEBUG::2014-10-29 11:13:48,397::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:48,400::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:48,403::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135983::DEBUG::2014-10-29 11:13:48,407::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135983::DEBUG::2014-10-29 11:13:48,409::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:13:48,524::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54179 >Detector thread::DEBUG::2014-10-29 11:13:48,524::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54179 >Detector thread::DEBUG::2014-10-29 11:13:48,525::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54179 >Detector thread::DEBUG::2014-10-29 11:13:48,525::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54179) >Thread-135984::DEBUG::2014-10-29 11:13:48,565::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135984::DEBUG::2014-10-29 11:13:48,565::task::595::Storage.TaskManager.Task::(_updateState) Task=`87a5b5c5-e97a-402c-b85a-6a042bb81322`::moving from state init -> state preparing >Thread-135984::INFO::2014-10-29 11:13:48,566::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-135984::DEBUG::2014-10-29 11:13:48,580::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:13:48,581::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:48,582::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:48,582::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:48,582::__init__::232::IOProcess::(_processLogs) (200433) Got request for method 'glob' >Thread-135984::DEBUG::2014-10-29 11:13:48,583::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:13:48,583::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200433) Queuing response >Thread-135984::DEBUG::2014-10-29 11:13:48,585::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-135984::INFO::2014-10-29 11:13:48,586::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135984::DEBUG::2014-10-29 11:13:48,587::task::1191::Storage.TaskManager.Task::(prepare) Task=`87a5b5c5-e97a-402c-b85a-6a042bb81322`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-135984::DEBUG::2014-10-29 11:13:48,589::task::595::Storage.TaskManager.Task::(_updateState) Task=`87a5b5c5-e97a-402c-b85a-6a042bb81322`::moving from state preparing -> state finished >Thread-135984::DEBUG::2014-10-29 11:13:48,591::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135984::DEBUG::2014-10-29 11:13:48,592::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135984::DEBUG::2014-10-29 11:13:48,594::task::993::Storage.TaskManager.Task::(_decref) Task=`87a5b5c5-e97a-402c-b85a-6a042bb81322`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:13:48,642::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54180 >Detector thread::DEBUG::2014-10-29 11:13:48,645::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54180 >Detector thread::DEBUG::2014-10-29 11:13:48,646::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54180 >Detector thread::DEBUG::2014-10-29 11:13:48,648::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54180) >Thread-135985::DEBUG::2014-10-29 11:13:48,682::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135985::DEBUG::2014-10-29 11:13:48,683::task::595::Storage.TaskManager.Task::(_updateState) Task=`af6cdec7-0929-431d-8725-d9ea67661d52`::moving from state init -> state preparing >Thread-135985::INFO::2014-10-29 11:13:48,683::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-135985::DEBUG::2014-10-29 11:13:48,683::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-135985::DEBUG::2014-10-29 11:13:48,683::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135985::DEBUG::2014-10-29 11:13:48,684::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-135985::DEBUG::2014-10-29 11:13:48,684::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-135985::DEBUG::2014-10-29 11:13:48,684::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-135985::DEBUG::2014-10-29 11:13:48,685::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-135985::DEBUG::2014-10-29 11:13:48,763::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-135985::DEBUG::2014-10-29 11:13:48,764::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-135985::DEBUG::2014-10-29 11:13:48,950::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-135985::DEBUG::2014-10-29 11:13:48,951::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135985::DEBUG::2014-10-29 11:13:48,952::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135985::DEBUG::2014-10-29 11:13:48,952::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135985::DEBUG::2014-10-29 11:13:48,952::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135985::DEBUG::2014-10-29 11:13:48,953::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-135985::DEBUG::2014-10-29 11:13:48,953::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-135985::DEBUG::2014-10-29 11:13:48,953::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:13:48,960::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:48,961::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:48,961::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:48,961::__init__::232::IOProcess::(_processLogs) (200434) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:13:48,962::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200434) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:48,967::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:48,967::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:48,969::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:48,971::__init__::232::IOProcess::(_processLogs) (200435) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:13:48,973::__init__::232::IOProcess::(_processLogs) (200435) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:48,977::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:48,979::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-135985::DEBUG::2014-10-29 11:13:48,981::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:13:48,981::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:48,983::__init__::232::IOProcess::(_processLogs) (200436) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:13:48,984::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200436) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:48,985::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:48,985::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:48,986::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:48,986::__init__::232::IOProcess::(_processLogs) (200437) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:13:48,987::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200437) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:48,988::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:48,988::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:48,988::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:48,988::__init__::232::IOProcess::(_processLogs) (200438) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:13:48,990::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200438) Queuing response >Thread-135985::DEBUG::2014-10-29 11:13:48,991::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:13:48,992::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:48,992::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:48,993::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:48,993::__init__::232::IOProcess::(_processLogs) (200439) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:13:48,994::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200439) Queuing response >Thread-135985::DEBUG::2014-10-29 11:13:48,995::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:13:48,996::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:48,997::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:48,998::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:48,998::__init__::232::IOProcess::(_processLogs) (200440) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:48,999::__init__::232::IOProcess::(_processLogs) (200440) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:48,999::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:48,999::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:49,000::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:49,000::__init__::232::IOProcess::(_processLogs) (200441) Got request for method 'glob' >Thread-135985::DEBUG::2014-10-29 11:13:49,001::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:13:49,001::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200441) Queuing response >Thread-135985::INFO::2014-10-29 11:13:49,002::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-135985::INFO::2014-10-29 11:13:49,003::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-135985::INFO::2014-10-29 11:13:49,003::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:13:49,004::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:49,004::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:49,004::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:49,004::__init__::232::IOProcess::(_processLogs) (200442) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:13:49,005::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200442) Queuing response >Thread-135985::DEBUG::2014-10-29 11:13:49,006::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-135985::DEBUG::2014-10-29 11:13:49,008::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`d22b9ba1-31f5-489d-82a3-0491de079396`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-135985::DEBUG::2014-10-29 11:13:49,008::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-135985::DEBUG::2014-10-29 11:13:49,009::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-135985::DEBUG::2014-10-29 11:13:49,009::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`d22b9ba1-31f5-489d-82a3-0491de079396`::Granted request >Thread-135985::DEBUG::2014-10-29 11:13:49,010::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`af6cdec7-0929-431d-8725-d9ea67661d52`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-135985::DEBUG::2014-10-29 11:13:49,010::task::993::Storage.TaskManager.Task::(_decref) Task=`af6cdec7-0929-431d-8725-d9ea67661d52`::ref 1 aborting False >Thread-135985::INFO::2014-10-29 11:13:49,012::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135985::DEBUG::2014-10-29 11:13:49,013::task::1191::Storage.TaskManager.Task::(prepare) Task=`af6cdec7-0929-431d-8725-d9ea67661d52`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-135985::DEBUG::2014-10-29 11:13:49,013::task::595::Storage.TaskManager.Task::(_updateState) Task=`af6cdec7-0929-431d-8725-d9ea67661d52`::moving from state preparing -> state finished >Thread-135985::DEBUG::2014-10-29 11:13:49,013::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-135985::DEBUG::2014-10-29 11:13:49,014::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135985::DEBUG::2014-10-29 11:13:49,014::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-135985::DEBUG::2014-10-29 11:13:49,014::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-135985::DEBUG::2014-10-29 11:13:49,015::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-135985::DEBUG::2014-10-29 11:13:49,015::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-135985::DEBUG::2014-10-29 11:13:49,015::task::993::Storage.TaskManager.Task::(_decref) Task=`af6cdec7-0929-431d-8725-d9ea67661d52`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:13:49,037::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54181 >Detector thread::DEBUG::2014-10-29 11:13:49,038::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54181 >Detector thread::DEBUG::2014-10-29 11:13:49,038::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54181 >Detector thread::DEBUG::2014-10-29 11:13:49,039::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54181) >Thread-135990::DEBUG::2014-10-29 11:13:49,078::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-135990::DEBUG::2014-10-29 11:13:49,078::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e33b91b-0bc3-4b5f-a848-21e5baf36a38`::moving from state init -> state preparing >Thread-135990::INFO::2014-10-29 11:13:49,079::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135990::INFO::2014-10-29 11:13:49,079::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000584719', 'lastCheck': '1.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000575373', 'lastCheck': '1.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00959411', 'lastCheck': '2.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000535682', 'lastCheck': '2.4', 'valid': True}} >Thread-135990::DEBUG::2014-10-29 11:13:49,080::task::1191::Storage.TaskManager.Task::(prepare) Task=`6e33b91b-0bc3-4b5f-a848-21e5baf36a38`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000584719', 'lastCheck': '1.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000575373', 'lastCheck': '1.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00959411', 'lastCheck': '2.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000535682', 'lastCheck': '2.4', 'valid': True}} >Thread-135990::DEBUG::2014-10-29 11:13:49,080::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e33b91b-0bc3-4b5f-a848-21e5baf36a38`::moving from state preparing -> state finished >Thread-135990::DEBUG::2014-10-29 11:13:49,080::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135990::DEBUG::2014-10-29 11:13:49,080::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135990::DEBUG::2014-10-29 11:13:49,081::task::993::Storage.TaskManager.Task::(_decref) Task=`6e33b91b-0bc3-4b5f-a848-21e5baf36a38`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:49,680::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:49,681::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:49,684::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:13:50,193::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54182 >Detector thread::DEBUG::2014-10-29 11:13:50,194::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54182 >Detector thread::DEBUG::2014-10-29 11:13:50,194::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54182 >Detector thread::DEBUG::2014-10-29 11:13:50,194::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54182) >Thread-135991::DEBUG::2014-10-29 11:13:50,233::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-135991::DEBUG::2014-10-29 11:13:50,237::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135991::DEBUG::2014-10-29 11:13:50,238::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.76', 'elapsedTime': '513862', 'displayType': 'vnc', 'cpuSys': '0.66', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '36103175', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57126', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '33620.32'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.63', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:13:50,533::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54184 >Detector thread::DEBUG::2014-10-29 11:13:50,534::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54184 >Detector thread::DEBUG::2014-10-29 11:13:50,534::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54184 >Detector thread::DEBUG::2014-10-29 11:13:50,535::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54184) >Thread-135992::DEBUG::2014-10-29 11:13:50,574::task::595::Storage.TaskManager.Task::(_updateState) Task=`07bee73d-f278-469d-9711-49326a0adb70`::moving from state init -> state preparing >Thread-135992::INFO::2014-10-29 11:13:50,574::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135992::INFO::2014-10-29 11:13:50,575::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000584719', 'lastCheck': '2.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000575373', 'lastCheck': '2.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00959411', 'lastCheck': '3.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000535682', 'lastCheck': '3.9', 'valid': True}} >Thread-135992::DEBUG::2014-10-29 11:13:50,575::task::1191::Storage.TaskManager.Task::(prepare) Task=`07bee73d-f278-469d-9711-49326a0adb70`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000584719', 'lastCheck': '2.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000575373', 'lastCheck': '2.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00959411', 'lastCheck': '3.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000535682', 'lastCheck': '3.9', 'valid': True}} >Thread-135992::DEBUG::2014-10-29 11:13:50,576::task::595::Storage.TaskManager.Task::(_updateState) Task=`07bee73d-f278-469d-9711-49326a0adb70`::moving from state preparing -> state finished >Thread-135992::DEBUG::2014-10-29 11:13:50,576::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135992::DEBUG::2014-10-29 11:13:50,576::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135992::DEBUG::2014-10-29 11:13:50,576::task::993::Storage.TaskManager.Task::(_decref) Task=`07bee73d-f278-469d-9711-49326a0adb70`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:13:51,006::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54185 >Detector thread::DEBUG::2014-10-29 11:13:51,007::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54185 >Detector thread::DEBUG::2014-10-29 11:13:51,007::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54185 >Detector thread::DEBUG::2014-10-29 11:13:51,007::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54185) >Thread-135993::DEBUG::2014-10-29 11:13:51,046::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-135993::DEBUG::2014-10-29 11:13:51,047::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-135993::DEBUG::2014-10-29 11:13:51,067::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-135993::DEBUG::2014-10-29 11:13:51,113::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '29', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '29', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:51,430::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:51,433::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135994::DEBUG::2014-10-29 11:13:51,436::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:51,438::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:51,440::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135995::DEBUG::2014-10-29 11:13:51,443::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135995::DEBUG::2014-10-29 11:13:51,445::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:54,460::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:54,462::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135996::DEBUG::2014-10-29 11:13:54,465::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:54,467::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:54,469::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135997::DEBUG::2014-10-29 11:13:54,472::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135997::DEBUG::2014-10-29 11:13:54,474::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:54,687::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:54,688::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:54,690::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:13:56,658::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:56,659::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:56,660::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:56,660::__init__::232::IOProcess::(_processLogs) (200443) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:56,669::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:56,670::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:56,670::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:56,670::__init__::232::IOProcess::(_processLogs) (200444) Got request for method 'statvfs' >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:57,489::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:57,492::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135998::DEBUG::2014-10-29 11:13:57,495::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:13:57,498::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:13:57,500::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135999::DEBUG::2014-10-29 11:13:57,503::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-135999::DEBUG::2014-10-29 11:13:57,505::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:13:57,838::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:57,838::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:57,838::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:57,839::__init__::232::IOProcess::(_processLogs) (200445) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:57,937::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:57,937::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:57,938::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:57,938::__init__::232::IOProcess::(_processLogs) (200446) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:58,794::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200443) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:58,794::__init__::232::IOProcess::(_processLogs) (200445) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:58,802::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200446) Queuing response >Thread-179::DEBUG::2014-10-29 11:13:58,805::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:13:58,828::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000534679 s, 696 kB/s\n'; <rc> = 0 >Thread-178::DEBUG::2014-10-29 11:13:58,828::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:13:58,850::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200444) Queuing response >Thread-178::DEBUG::2014-10-29 11:13:58,854::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00259169 s, 196 kB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-10-29 11:13:58,854::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:13:58,879::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-33::DEBUG::2014-10-29 11:13:58,880::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00116945 s, 416 kB/s\n'; <rc> = 0 >Thread-10269::DEBUG::2014-10-29 11:13:58,881::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:13:58,882::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:58,900::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:58,901::__init__::232::IOProcess::(_processLogs) (200447) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:58,903::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200447) Queuing response >Thread-10269::DEBUG::2014-10-29 11:13:58,906::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00273089 s, 184 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:13:58,910::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:58,911::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:58,911::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:58,911::__init__::232::IOProcess::(_processLogs) (200448) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:58,911::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:58,912::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:58,912::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:58,912::__init__::232::IOProcess::(_processLogs) (200449) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:58,914::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200448) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:58,916::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200449) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:58,918::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:58,918::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:58,918::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:58,918::__init__::232::IOProcess::(_processLogs) (200450) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:13:58,920::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200450) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:58,923::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:58,923::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:58,924::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:58,924::__init__::232::IOProcess::(_processLogs) (200451) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:58,924::__init__::232::IOProcess::(_processLogs) (200451) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:58,924::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:58,925::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:58,926::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:58,926::__init__::232::IOProcess::(_processLogs) (200452) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:58,927::__init__::232::IOProcess::(_processLogs) (200452) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:58,927::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:58,928::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:58,929::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:58,929::__init__::232::IOProcess::(_processLogs) (200453) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:58,929::__init__::232::IOProcess::(_processLogs) (200453) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:58,929::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:58,930::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:58,931::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:58,931::__init__::232::IOProcess::(_processLogs) (200454) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:58,932::__init__::232::IOProcess::(_processLogs) (200454) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:58,932::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:58,932::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:58,933::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:58,934::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:58,934::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:58,936::__init__::232::IOProcess::(_processLogs) (200455) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:58,936::__init__::232::IOProcess::(_processLogs) (200455) Queuing response >Thread-17::DEBUG::2014-10-29 11:13:58,936::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:58,936::__init__::232::IOProcess::(_processLogs) (200456) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:13:58,937::__init__::232::IOProcess::(_processLogs) (200456) Queuing response >Detector thread::DEBUG::2014-10-29 11:13:59,394::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54186 >Detector thread::DEBUG::2014-10-29 11:13:59,395::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54186 >Detector thread::DEBUG::2014-10-29 11:13:59,395::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54186 >Detector thread::DEBUG::2014-10-29 11:13:59,395::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54186) >Thread-136000::DEBUG::2014-10-29 11:13:59,434::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136000::DEBUG::2014-10-29 11:13:59,436::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136000::DEBUG::2014-10-29 11:13:59,437::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.76', 'elapsedTime': '513871', 'displayType': 'vnc', 'cpuSys': '0.66', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '36103175', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57126', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '33620.32'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.83', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:13:59,689::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54189 >Detector thread::DEBUG::2014-10-29 11:13:59,690::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54189 >Detector thread::DEBUG::2014-10-29 11:13:59,690::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54189 >Detector thread::DEBUG::2014-10-29 11:13:59,691::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54189) >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:59,696::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:59,697::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:13:59,698::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136001::DEBUG::2014-10-29 11:13:59,731::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136001::DEBUG::2014-10-29 11:13:59,732::task::595::Storage.TaskManager.Task::(_updateState) Task=`11cceea5-d195-44af-afbf-cbe51b2a4ef9`::moving from state init -> state preparing >Thread-136001::INFO::2014-10-29 11:13:59,732::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136001::DEBUG::2014-10-29 11:13:59,735::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:13:59,736::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:13:59,736::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:13:59,736::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:13:59,737::__init__::232::IOProcess::(_processLogs) (200457) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:13:59,739::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200457) Queuing response >Thread-136001::DEBUG::2014-10-29 11:13:59,740::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136001::DEBUG::2014-10-29 11:13:59,740::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136001::INFO::2014-10-29 11:13:59,741::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136001::DEBUG::2014-10-29 11:13:59,741::task::1191::Storage.TaskManager.Task::(prepare) Task=`11cceea5-d195-44af-afbf-cbe51b2a4ef9`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136001::DEBUG::2014-10-29 11:13:59,741::task::595::Storage.TaskManager.Task::(_updateState) Task=`11cceea5-d195-44af-afbf-cbe51b2a4ef9`::moving from state preparing -> state finished >Thread-136001::DEBUG::2014-10-29 11:13:59,742::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136001::DEBUG::2014-10-29 11:13:59,742::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136001::DEBUG::2014-10-29 11:13:59,742::task::993::Storage.TaskManager.Task::(_decref) Task=`11cceea5-d195-44af-afbf-cbe51b2a4ef9`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:13:59,786::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54190 >Detector thread::DEBUG::2014-10-29 11:13:59,786::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54190 >Detector thread::DEBUG::2014-10-29 11:13:59,787::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54190 >Detector thread::DEBUG::2014-10-29 11:13:59,787::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54190) >Thread-136002::DEBUG::2014-10-29 11:13:59,826::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136002::DEBUG::2014-10-29 11:13:59,826::task::595::Storage.TaskManager.Task::(_updateState) Task=`bcb4a75c-da9a-46a6-93f6-c39c8f3aa1e9`::moving from state init -> state preparing >Thread-136002::INFO::2014-10-29 11:13:59,827::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136002::DEBUG::2014-10-29 11:13:59,827::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136002::DEBUG::2014-10-29 11:13:59,827::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136002::DEBUG::2014-10-29 11:13:59,828::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136002::DEBUG::2014-10-29 11:13:59,828::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136002::DEBUG::2014-10-29 11:13:59,828::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136002::DEBUG::2014-10-29 11:13:59,829::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136002::DEBUG::2014-10-29 11:13:59,924::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136002::DEBUG::2014-10-29 11:13:59,925::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136002::DEBUG::2014-10-29 11:14:00,089::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136002::DEBUG::2014-10-29 11:14:00,091::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136002::DEBUG::2014-10-29 11:14:00,091::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136002::DEBUG::2014-10-29 11:14:00,092::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136002::DEBUG::2014-10-29 11:14:00,092::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136002::DEBUG::2014-10-29 11:14:00,092::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136002::DEBUG::2014-10-29 11:14:00,093::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136002::DEBUG::2014-10-29 11:14:00,093::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:14:00,099::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:00,102::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:00,103::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:00,103::__init__::232::IOProcess::(_processLogs) (200458) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:00,104::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200458) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:00,106::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:00,106::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:00,106::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:00,107::__init__::232::IOProcess::(_processLogs) (200459) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:00,107::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200459) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:00,109::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:00,110::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:00,113::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:00,115::__init__::232::IOProcess::(_processLogs) (200460) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:00,118::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200460) Queuing response >Thread-136002::DEBUG::2014-10-29 11:14:00,122::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:14:00,123::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:00,124::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:00,124::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:00,124::__init__::232::IOProcess::(_processLogs) (200461) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:00,125::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200461) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:00,126::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:00,127::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:00,127::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:00,127::__init__::232::IOProcess::(_processLogs) (200462) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:14:00,128::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200462) Queuing response >Thread-136002::DEBUG::2014-10-29 11:14:00,128::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:14:00,129::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:00,130::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:00,130::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:00,130::__init__::232::IOProcess::(_processLogs) (200463) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:14:00,131::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200463) Queuing response >Thread-136002::DEBUG::2014-10-29 11:14:00,132::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:14:00,133::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:00,133::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:00,133::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:00,134::__init__::232::IOProcess::(_processLogs) (200464) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:00,134::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200464) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:00,136::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:00,136::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:00,136::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:00,136::__init__::232::IOProcess::(_processLogs) (200465) Got request for method 'glob' >Thread-136002::DEBUG::2014-10-29 11:14:00,137::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:14:00,137::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200465) Queuing response >Thread-136002::INFO::2014-10-29 11:14:00,138::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136002::INFO::2014-10-29 11:14:00,139::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136002::INFO::2014-10-29 11:14:00,139::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:14:00,140::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:00,140::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:00,141::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:00,141::__init__::232::IOProcess::(_processLogs) (200466) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:14:00,142::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200466) Queuing response >Thread-136002::DEBUG::2014-10-29 11:14:00,142::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136002::DEBUG::2014-10-29 11:14:00,144::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`fa9b1716-ab5e-4588-be69-f69484a6b8df`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136002::DEBUG::2014-10-29 11:14:00,145::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136002::DEBUG::2014-10-29 11:14:00,145::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136002::DEBUG::2014-10-29 11:14:00,145::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`fa9b1716-ab5e-4588-be69-f69484a6b8df`::Granted request >Thread-136002::DEBUG::2014-10-29 11:14:00,146::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bcb4a75c-da9a-46a6-93f6-c39c8f3aa1e9`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136002::DEBUG::2014-10-29 11:14:00,146::task::993::Storage.TaskManager.Task::(_decref) Task=`bcb4a75c-da9a-46a6-93f6-c39c8f3aa1e9`::ref 1 aborting False >Thread-136002::INFO::2014-10-29 11:14:00,149::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136002::DEBUG::2014-10-29 11:14:00,149::task::1191::Storage.TaskManager.Task::(prepare) Task=`bcb4a75c-da9a-46a6-93f6-c39c8f3aa1e9`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136002::DEBUG::2014-10-29 11:14:00,150::task::595::Storage.TaskManager.Task::(_updateState) Task=`bcb4a75c-da9a-46a6-93f6-c39c8f3aa1e9`::moving from state preparing -> state finished >Thread-136002::DEBUG::2014-10-29 11:14:00,150::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136002::DEBUG::2014-10-29 11:14:00,150::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136002::DEBUG::2014-10-29 11:14:00,151::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136002::DEBUG::2014-10-29 11:14:00,151::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136002::DEBUG::2014-10-29 11:14:00,151::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136002::DEBUG::2014-10-29 11:14:00,151::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136002::DEBUG::2014-10-29 11:14:00,152::task::993::Storage.TaskManager.Task::(_decref) Task=`bcb4a75c-da9a-46a6-93f6-c39c8f3aa1e9`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:14:00,173::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54191 >Detector thread::DEBUG::2014-10-29 11:14:00,174::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54191 >Detector thread::DEBUG::2014-10-29 11:14:00,174::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54191 >Detector thread::DEBUG::2014-10-29 11:14:00,175::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54191) >Thread-136007::DEBUG::2014-10-29 11:14:00,214::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136007::DEBUG::2014-10-29 11:14:00,214::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e0d0ec3-171b-4226-9dbf-33e727958865`::moving from state init -> state preparing >Thread-136007::INFO::2014-10-29 11:14:00,215::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136007::INFO::2014-10-29 11:14:00,215::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00259169', 'lastCheck': '1.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00116945', 'lastCheck': '1.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534679', 'lastCheck': '1.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00273089', 'lastCheck': '1.3', 'valid': True}} >Thread-136007::DEBUG::2014-10-29 11:14:00,216::task::1191::Storage.TaskManager.Task::(prepare) Task=`8e0d0ec3-171b-4226-9dbf-33e727958865`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00259169', 'lastCheck': '1.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00116945', 'lastCheck': '1.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534679', 'lastCheck': '1.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00273089', 'lastCheck': '1.3', 'valid': True}} >Thread-136007::DEBUG::2014-10-29 11:14:00,216::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e0d0ec3-171b-4226-9dbf-33e727958865`::moving from state preparing -> state finished >Thread-136007::DEBUG::2014-10-29 11:14:00,216::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136007::DEBUG::2014-10-29 11:14:00,216::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136007::DEBUG::2014-10-29 11:14:00,217::task::993::Storage.TaskManager.Task::(_decref) Task=`8e0d0ec3-171b-4226-9dbf-33e727958865`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:00,530::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:00,533::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136008::DEBUG::2014-10-29 11:14:00,538::task::595::Storage.TaskManager.Task::(_updateState) Task=`de45df66-b732-41ed-baa4-b033b72fb918`::moving from state init -> state preparing >Thread-136008::INFO::2014-10-29 11:14:00,539::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136008::INFO::2014-10-29 11:14:00,540::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00259169', 'lastCheck': '1.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00116945', 'lastCheck': '1.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534679', 'lastCheck': '1.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00273089', 'lastCheck': '1.6', 'valid': True}} >Thread-136008::DEBUG::2014-10-29 11:14:00,540::task::1191::Storage.TaskManager.Task::(prepare) Task=`de45df66-b732-41ed-baa4-b033b72fb918`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00259169', 'lastCheck': '1.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00116945', 'lastCheck': '1.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534679', 'lastCheck': '1.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00273089', 'lastCheck': '1.6', 'valid': True}} >Thread-136008::DEBUG::2014-10-29 11:14:00,540::task::595::Storage.TaskManager.Task::(_updateState) Task=`de45df66-b732-41ed-baa4-b033b72fb918`::moving from state preparing -> state finished >Thread-136008::DEBUG::2014-10-29 11:14:00,540::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136008::DEBUG::2014-10-29 11:14:00,541::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136008::DEBUG::2014-10-29 11:14:00,541::task::993::Storage.TaskManager.Task::(_decref) Task=`de45df66-b732-41ed-baa4-b033b72fb918`::ref 0 aborting False >Thread-136008::DEBUG::2014-10-29 11:14:00,566::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:00,588::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:00,590::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136009::DEBUG::2014-10-29 11:14:00,594::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136009::DEBUG::2014-10-29 11:14:00,596::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:14:00,633::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54192 >Detector thread::DEBUG::2014-10-29 11:14:00,633::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54192 >Detector thread::DEBUG::2014-10-29 11:14:00,634::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54192 >Detector thread::DEBUG::2014-10-29 11:14:00,634::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54192) >Thread-136010::DEBUG::2014-10-29 11:14:00,674::task::595::Storage.TaskManager.Task::(_updateState) Task=`70b9d99e-8226-4082-861a-800a2c349e51`::moving from state init -> state preparing >Thread-136010::INFO::2014-10-29 11:14:00,674::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136010::INFO::2014-10-29 11:14:00,675::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00259169', 'lastCheck': '1.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00116945', 'lastCheck': '1.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534679', 'lastCheck': '1.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00273089', 'lastCheck': '1.8', 'valid': True}} >Thread-136010::DEBUG::2014-10-29 11:14:00,675::task::1191::Storage.TaskManager.Task::(prepare) Task=`70b9d99e-8226-4082-861a-800a2c349e51`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00259169', 'lastCheck': '1.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00116945', 'lastCheck': '1.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534679', 'lastCheck': '1.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00273089', 'lastCheck': '1.8', 'valid': True}} >Thread-136010::DEBUG::2014-10-29 11:14:00,675::task::595::Storage.TaskManager.Task::(_updateState) Task=`70b9d99e-8226-4082-861a-800a2c349e51`::moving from state preparing -> state finished >Thread-136010::DEBUG::2014-10-29 11:14:00,675::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136010::DEBUG::2014-10-29 11:14:00,676::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136010::DEBUG::2014-10-29 11:14:00,676::task::993::Storage.TaskManager.Task::(_decref) Task=`70b9d99e-8226-4082-861a-800a2c349e51`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:14:01,162::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54193 >Detector thread::DEBUG::2014-10-29 11:14:01,163::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54193 >Detector thread::DEBUG::2014-10-29 11:14:01,163::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54193 >Detector thread::DEBUG::2014-10-29 11:14:01,164::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54193) >Thread-136011::DEBUG::2014-10-29 11:14:01,202::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136011::DEBUG::2014-10-29 11:14:01,205::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136011::DEBUG::2014-10-29 11:14:01,225::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136011::DEBUG::2014-10-29 11:14:01,274::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '13', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '13', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-22::DEBUG::2014-10-29 11:14:02,627::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:03,638::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:03,641::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136012::DEBUG::2014-10-29 11:14:03,644::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:03,646::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:03,648::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136013::DEBUG::2014-10-29 11:14:03,651::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136013::DEBUG::2014-10-29 11:14:03,654::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:14:03,663::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:04,701::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:04,703::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:04,705::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:06,673::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:06,675::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136014::DEBUG::2014-10-29 11:14:06,679::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:06,681::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:06,683::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136015::DEBUG::2014-10-29 11:14:06,687::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136015::DEBUG::2014-10-29 11:14:06,689::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:14:08,911::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:08,912::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:08,914::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:08,914::__init__::232::IOProcess::(_processLogs) (200467) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:08,916::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200467) Queuing response >Thread-179::DEBUG::2014-10-29 11:14:08,917::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:14:08,935::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-179::DEBUG::2014-10-29 11:14:08,939::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00143 s, 260 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:14:08,940::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:08,942::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:08,942::__init__::232::IOProcess::(_processLogs) (200468) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:08,944::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200468) Queuing response >Thread-10269::DEBUG::2014-10-29 11:14:08,946::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:14:08,947::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:08,947::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:08,948::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:08,965::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:08,965::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-10269::DEBUG::2014-10-29 11:14:08,967::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000581471 s, 863 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:14:08,968::__init__::232::IOProcess::(_processLogs) (200469) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:08,971::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200469) Queuing response >Thread-178::DEBUG::2014-10-29 11:14:08,972::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:14:08,988::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:08,989::__init__::232::IOProcess::(_processLogs) (200470) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:08,989::__init__::232::IOProcess::(_processLogs) (200470) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:08,989::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:08,990::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:08,990::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:08,991::__init__::232::IOProcess::(_processLogs) (200471) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:08,991::__init__::232::IOProcess::(_processLogs) (200471) Queuing response >Thread-178::DEBUG::2014-10-29 11:14:08,998::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000430257 s, 1.2 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-10-29 11:14:09,001::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:14:09,020::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:09,025::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-33::DEBUG::2014-10-29 11:14:09,026::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000677934 s, 718 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:14:09,027::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:09,029::__init__::232::IOProcess::(_processLogs) (200472) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:09,031::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200472) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:09,033::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:09,033::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:09,033::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:09,033::__init__::232::IOProcess::(_processLogs) (200473) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:09,034::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:09,034::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:09,034::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:09,034::__init__::232::IOProcess::(_processLogs) (200474) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:09,035::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200474) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:09,036::__init__::232::IOProcess::(_processLogs) (200473) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:09,041::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:09,041::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:09,042::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:09,042::__init__::232::IOProcess::(_processLogs) (200475) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:09,043::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200475) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:09,044::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:09,044::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:09,045::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:09,045::__init__::232::IOProcess::(_processLogs) (200476) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:09,046::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200476) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:09,046::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:09,047::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:09,047::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:09,047::__init__::232::IOProcess::(_processLogs) (200477) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:09,048::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200477) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:09,049::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:09,050::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:09,050::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:09,050::__init__::232::IOProcess::(_processLogs) (200478) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:09,051::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200478) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:09,052::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:09,052::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:09,052::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:09,052::__init__::232::IOProcess::(_processLogs) (200479) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:09,053::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200479) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:09,055::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:09,055::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:09,056::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:09,056::__init__::232::IOProcess::(_processLogs) (200480) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:09,057::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200480) Queuing response >Detector thread::DEBUG::2014-10-29 11:14:09,600::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54194 >Detector thread::DEBUG::2014-10-29 11:14:09,601::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54194 >Detector thread::DEBUG::2014-10-29 11:14:09,601::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54194 >Detector thread::DEBUG::2014-10-29 11:14:09,602::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54194) >Thread-136016::DEBUG::2014-10-29 11:14:09,641::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136016::DEBUG::2014-10-29 11:14:09,643::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136016::DEBUG::2014-10-29 11:14:09,643::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.85', 'elapsedTime': '513882', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '36103175', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57126', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '33620.32'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.01', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:09,704::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:09,707::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136017::DEBUG::2014-10-29 11:14:09,710::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:09,711::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:09,726::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:09,728::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:09,729::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpcServer::DEBUG::2014-10-29 11:14:09,734::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136018::DEBUG::2014-10-29 11:14:09,737::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136018::DEBUG::2014-10-29 11:14:09,740::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:14:10,321::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54196 >Detector thread::DEBUG::2014-10-29 11:14:10,322::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54196 >Detector thread::DEBUG::2014-10-29 11:14:10,322::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54196 >Detector thread::DEBUG::2014-10-29 11:14:10,323::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54196) >Thread-136019::DEBUG::2014-10-29 11:14:10,362::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136019::DEBUG::2014-10-29 11:14:10,364::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136019::DEBUG::2014-10-29 11:14:10,383::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136019::DEBUG::2014-10-29 11:14:10,431::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '98', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '98', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:14:10,732::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54197 >Detector thread::DEBUG::2014-10-29 11:14:10,733::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54197 >Detector thread::DEBUG::2014-10-29 11:14:10,734::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54197 >Detector thread::DEBUG::2014-10-29 11:14:10,734::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54197) >Thread-136020::DEBUG::2014-10-29 11:14:10,773::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f5074fc-4d64-4c51-82a2-673c599fc9fa`::moving from state init -> state preparing >Thread-136020::INFO::2014-10-29 11:14:10,774::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136020::INFO::2014-10-29 11:14:10,775::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430257', 'lastCheck': '1.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677934', 'lastCheck': '1.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00143', 'lastCheck': '1.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000581471', 'lastCheck': '1.7', 'valid': True}} >Thread-136020::DEBUG::2014-10-29 11:14:10,775::task::1191::Storage.TaskManager.Task::(prepare) Task=`4f5074fc-4d64-4c51-82a2-673c599fc9fa`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430257', 'lastCheck': '1.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677934', 'lastCheck': '1.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00143', 'lastCheck': '1.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000581471', 'lastCheck': '1.7', 'valid': True}} >Thread-136020::DEBUG::2014-10-29 11:14:10,775::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f5074fc-4d64-4c51-82a2-673c599fc9fa`::moving from state preparing -> state finished >Thread-136020::DEBUG::2014-10-29 11:14:10,776::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136020::DEBUG::2014-10-29 11:14:10,776::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136020::DEBUG::2014-10-29 11:14:10,776::task::993::Storage.TaskManager.Task::(_decref) Task=`4f5074fc-4d64-4c51-82a2-673c599fc9fa`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:14:10,836::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54199 >Detector thread::DEBUG::2014-10-29 11:14:10,836::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54199 >Detector thread::DEBUG::2014-10-29 11:14:10,836::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54199 >Detector thread::DEBUG::2014-10-29 11:14:10,837::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54199) >Thread-136021::DEBUG::2014-10-29 11:14:10,877::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136021::DEBUG::2014-10-29 11:14:10,877::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd2449e6-4d8e-4ad8-8d24-594b7699c6e2`::moving from state init -> state preparing >Thread-136021::INFO::2014-10-29 11:14:10,878::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136021::DEBUG::2014-10-29 11:14:10,892::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:14:10,893::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:10,893::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:10,894::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:10,894::__init__::232::IOProcess::(_processLogs) (200481) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:11,785::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200481) Queuing response >Thread-136021::DEBUG::2014-10-29 11:14:11,786::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136021::DEBUG::2014-10-29 11:14:11,787::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136021::INFO::2014-10-29 11:14:11,787::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136021::DEBUG::2014-10-29 11:14:11,787::task::1191::Storage.TaskManager.Task::(prepare) Task=`cd2449e6-4d8e-4ad8-8d24-594b7699c6e2`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136021::DEBUG::2014-10-29 11:14:11,788::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd2449e6-4d8e-4ad8-8d24-594b7699c6e2`::moving from state preparing -> state finished >Thread-136021::DEBUG::2014-10-29 11:14:11,788::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136021::DEBUG::2014-10-29 11:14:11,788::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136021::DEBUG::2014-10-29 11:14:11,789::task::993::Storage.TaskManager.Task::(_decref) Task=`cd2449e6-4d8e-4ad8-8d24-594b7699c6e2`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:14:11,836::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54200 >Detector thread::DEBUG::2014-10-29 11:14:11,837::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54200 >Detector thread::DEBUG::2014-10-29 11:14:11,837::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54200 >Detector thread::DEBUG::2014-10-29 11:14:11,838::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54200) >Thread-136022::DEBUG::2014-10-29 11:14:11,877::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136022::DEBUG::2014-10-29 11:14:11,877::task::595::Storage.TaskManager.Task::(_updateState) Task=`d1b0fdaf-1cb4-4a4a-8d5f-403a0d040528`::moving from state init -> state preparing >Thread-136022::INFO::2014-10-29 11:14:11,878::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136022::DEBUG::2014-10-29 11:14:11,878::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136022::DEBUG::2014-10-29 11:14:11,878::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136022::DEBUG::2014-10-29 11:14:11,879::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136022::DEBUG::2014-10-29 11:14:11,879::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136022::DEBUG::2014-10-29 11:14:11,879::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136022::DEBUG::2014-10-29 11:14:11,880::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136022::DEBUG::2014-10-29 11:14:11,967::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136022::DEBUG::2014-10-29 11:14:11,968::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136022::DEBUG::2014-10-29 11:14:12,149::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136022::DEBUG::2014-10-29 11:14:12,150::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136022::DEBUG::2014-10-29 11:14:12,151::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136022::DEBUG::2014-10-29 11:14:12,151::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136022::DEBUG::2014-10-29 11:14:12,151::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136022::DEBUG::2014-10-29 11:14:12,152::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136022::DEBUG::2014-10-29 11:14:12,152::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136022::DEBUG::2014-10-29 11:14:12,153::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:14:12,160::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:12,163::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:12,163::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:12,164::__init__::232::IOProcess::(_processLogs) (200482) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:12,165::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200482) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:12,166::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:12,166::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:12,167::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:12,167::__init__::232::IOProcess::(_processLogs) (200483) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:12,168::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200483) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:12,170::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:12,172::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:12,174::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:12,176::__init__::232::IOProcess::(_processLogs) (200484) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:12,180::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200484) Queuing response >Thread-136022::DEBUG::2014-10-29 11:14:12,182::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:14:12,184::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:12,184::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:12,185::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:12,185::__init__::232::IOProcess::(_processLogs) (200485) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:12,186::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200485) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:12,187::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:12,187::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:12,187::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:12,188::__init__::232::IOProcess::(_processLogs) (200486) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:14:12,188::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200486) Queuing response >Thread-136022::DEBUG::2014-10-29 11:14:12,189::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:14:12,190::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:12,190::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:12,190::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:12,191::__init__::232::IOProcess::(_processLogs) (200487) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:14:12,192::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200487) Queuing response >Thread-136022::DEBUG::2014-10-29 11:14:12,192::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:14:12,193::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:12,194::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:12,194::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:12,194::__init__::232::IOProcess::(_processLogs) (200488) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:12,195::__init__::232::IOProcess::(_processLogs) (200488) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:12,195::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:12,196::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:12,196::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:12,196::__init__::232::IOProcess::(_processLogs) (200489) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:12,197::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200489) Queuing response >Thread-136022::DEBUG::2014-10-29 11:14:12,198::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-136022::INFO::2014-10-29 11:14:12,198::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136022::INFO::2014-10-29 11:14:12,198::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136022::INFO::2014-10-29 11:14:12,199::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:14:12,199::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:12,200::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:12,200::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:12,200::__init__::232::IOProcess::(_processLogs) (200490) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:14:12,201::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200490) Queuing response >Thread-136022::DEBUG::2014-10-29 11:14:12,202::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136022::DEBUG::2014-10-29 11:14:12,204::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`d454deb1-85e6-4ca1-ab82-3837ed5671d1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136022::DEBUG::2014-10-29 11:14:12,204::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136022::DEBUG::2014-10-29 11:14:12,204::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136022::DEBUG::2014-10-29 11:14:12,205::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`d454deb1-85e6-4ca1-ab82-3837ed5671d1`::Granted request >Thread-136022::DEBUG::2014-10-29 11:14:12,205::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d1b0fdaf-1cb4-4a4a-8d5f-403a0d040528`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136022::DEBUG::2014-10-29 11:14:12,206::task::993::Storage.TaskManager.Task::(_decref) Task=`d1b0fdaf-1cb4-4a4a-8d5f-403a0d040528`::ref 1 aborting False >Thread-136022::INFO::2014-10-29 11:14:12,208::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136022::DEBUG::2014-10-29 11:14:12,209::task::1191::Storage.TaskManager.Task::(prepare) Task=`d1b0fdaf-1cb4-4a4a-8d5f-403a0d040528`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136022::DEBUG::2014-10-29 11:14:12,209::task::595::Storage.TaskManager.Task::(_updateState) Task=`d1b0fdaf-1cb4-4a4a-8d5f-403a0d040528`::moving from state preparing -> state finished >Thread-136022::DEBUG::2014-10-29 11:14:12,209::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136022::DEBUG::2014-10-29 11:14:12,210::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136022::DEBUG::2014-10-29 11:14:12,210::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136022::DEBUG::2014-10-29 11:14:12,210::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136022::DEBUG::2014-10-29 11:14:12,211::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136022::DEBUG::2014-10-29 11:14:12,211::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136022::DEBUG::2014-10-29 11:14:12,211::task::993::Storage.TaskManager.Task::(_decref) Task=`d1b0fdaf-1cb4-4a4a-8d5f-403a0d040528`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:14:12,234::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54201 >Detector thread::DEBUG::2014-10-29 11:14:12,238::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54201 >Detector thread::DEBUG::2014-10-29 11:14:12,238::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54201 >Detector thread::DEBUG::2014-10-29 11:14:12,239::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54201) >Thread-136027::DEBUG::2014-10-29 11:14:12,278::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136027::DEBUG::2014-10-29 11:14:12,279::task::595::Storage.TaskManager.Task::(_updateState) Task=`544a6014-00af-4805-92b2-21a50b12fd18`::moving from state init -> state preparing >Thread-136027::INFO::2014-10-29 11:14:12,279::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136027::INFO::2014-10-29 11:14:12,280::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430257', 'lastCheck': '3.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677934', 'lastCheck': '3.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00143', 'lastCheck': '3.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000581471', 'lastCheck': '3.2', 'valid': True}} >Thread-136027::DEBUG::2014-10-29 11:14:12,280::task::1191::Storage.TaskManager.Task::(prepare) Task=`544a6014-00af-4805-92b2-21a50b12fd18`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430257', 'lastCheck': '3.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677934', 'lastCheck': '3.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00143', 'lastCheck': '3.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000581471', 'lastCheck': '3.2', 'valid': True}} >Thread-136027::DEBUG::2014-10-29 11:14:12,280::task::595::Storage.TaskManager.Task::(_updateState) Task=`544a6014-00af-4805-92b2-21a50b12fd18`::moving from state preparing -> state finished >Thread-136027::DEBUG::2014-10-29 11:14:12,281::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136027::DEBUG::2014-10-29 11:14:12,281::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136027::DEBUG::2014-10-29 11:14:12,281::task::993::Storage.TaskManager.Task::(_decref) Task=`544a6014-00af-4805-92b2-21a50b12fd18`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:12,753::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:12,756::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136028::DEBUG::2014-10-29 11:14:12,759::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:12,761::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:12,763::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136029::DEBUG::2014-10-29 11:14:12,767::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136029::DEBUG::2014-10-29 11:14:12,769::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:14,735::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:14,737::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:14,740::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:15,782::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:15,785::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136030::DEBUG::2014-10-29 11:14:15,790::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4630dca-2d85-4182-8a22-f814b30ba8bf`::moving from state init -> state preparing >Thread-136030::INFO::2014-10-29 11:14:15,791::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136030::INFO::2014-10-29 11:14:15,791::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430257', 'lastCheck': '6.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677934', 'lastCheck': '6.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00143', 'lastCheck': '6.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000581471', 'lastCheck': '6.8', 'valid': True}} >Thread-136030::DEBUG::2014-10-29 11:14:15,792::task::1191::Storage.TaskManager.Task::(prepare) Task=`e4630dca-2d85-4182-8a22-f814b30ba8bf`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430257', 'lastCheck': '6.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677934', 'lastCheck': '6.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00143', 'lastCheck': '6.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000581471', 'lastCheck': '6.8', 'valid': True}} >Thread-136030::DEBUG::2014-10-29 11:14:15,792::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4630dca-2d85-4182-8a22-f814b30ba8bf`::moving from state preparing -> state finished >Thread-136030::DEBUG::2014-10-29 11:14:15,792::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136030::DEBUG::2014-10-29 11:14:15,793::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136030::DEBUG::2014-10-29 11:14:15,793::task::993::Storage.TaskManager.Task::(_decref) Task=`e4630dca-2d85-4182-8a22-f814b30ba8bf`::ref 0 aborting False >Thread-136030::DEBUG::2014-10-29 11:14:15,817::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:15,845::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:15,847::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136031::DEBUG::2014-10-29 11:14:15,850::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136031::DEBUG::2014-10-29 11:14:15,853::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:14:17,648::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:18,897::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:18,904::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136032::DEBUG::2014-10-29 11:14:18,911::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:18,916::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:18,921::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136033::DEBUG::2014-10-29 11:14:18,929::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136033::DEBUG::2014-10-29 11:14:18,936::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:14:19,026::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:19,026::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:19,027::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:19,027::__init__::232::IOProcess::(_processLogs) (200491) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:19,027::__init__::232::IOProcess::(_processLogs) (200491) Queuing response >Thread-179::DEBUG::2014-10-29 11:14:19,029::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:14:19,047::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-179::DEBUG::2014-10-29 11:14:19,048::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000585827 s, 635 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:14:19,050::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:19,051::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:19,051::__init__::232::IOProcess::(_processLogs) (200492) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:19,053::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200492) Queuing response >Thread-10269::DEBUG::2014-10-29 11:14:19,054::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:14:19,073::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:19,077::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10269::DEBUG::2014-10-29 11:14:19,077::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000439776 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:14:19,078::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:19,079::__init__::232::IOProcess::(_processLogs) (200493) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:19,081::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200493) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:19,084::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:19,084::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:19,084::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:19,084::__init__::232::IOProcess::(_processLogs) (200494) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:19,085::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:19,086::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:19,086::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:19,086::__init__::232::IOProcess::(_processLogs) (200495) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:19,086::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:19,087::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:19,087::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:19,087::__init__::232::IOProcess::(_processLogs) (200496) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:19,087::__init__::232::IOProcess::(_processLogs) (200494) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:19,089::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200495) Queuing response >Thread-33::DEBUG::2014-10-29 11:14:19,090::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:14:19,091::__init__::232::IOProcess::(_processLogs) (200496) Queuing response >Thread-178::DEBUG::2014-10-29 11:14:19,113::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:14:19,114::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.0023644 s, 206 kB/s\n'; <rc> = 0 >Thread-178::DEBUG::2014-10-29 11:14:19,138::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.0015109 s, 336 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:14:19,139::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:19,141::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:19,141::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:19,141::__init__::232::IOProcess::(_processLogs) (200497) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:19,143::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200497) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:19,145::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:19,145::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:19,145::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:19,145::__init__::232::IOProcess::(_processLogs) (200498) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:19,146::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:19,146::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:19,146::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:19,146::__init__::232::IOProcess::(_processLogs) (200499) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:19,147::__init__::232::IOProcess::(_processLogs) (200499) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:19,147::__init__::232::IOProcess::(_processLogs) (200498) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:19,152::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:19,152::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:19,152::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:19,153::__init__::232::IOProcess::(_processLogs) (200500) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:19,153::__init__::232::IOProcess::(_processLogs) (200500) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:19,153::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:19,153::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:19,154::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:19,154::__init__::232::IOProcess::(_processLogs) (200501) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:19,154::__init__::232::IOProcess::(_processLogs) (200501) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:19,156::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:19,156::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:19,157::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:19,157::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:19,157::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:19,157::__init__::232::IOProcess::(_processLogs) (200502) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:19,158::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200502) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:19,159::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:19,160::__init__::232::IOProcess::(_processLogs) (200503) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:19,160::__init__::232::IOProcess::(_processLogs) (200503) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:19,161::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:19,162::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:19,162::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:19,162::__init__::232::IOProcess::(_processLogs) (200504) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:19,163::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200504) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:19,747::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:19,749::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:19,750::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:14:19,802::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54202 >Detector thread::DEBUG::2014-10-29 11:14:19,802::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54202 >Detector thread::DEBUG::2014-10-29 11:14:19,802::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54202 >Detector thread::DEBUG::2014-10-29 11:14:19,803::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54202) >Thread-136034::DEBUG::2014-10-29 11:14:19,842::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136034::DEBUG::2014-10-29 11:14:19,843::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136034::DEBUG::2014-10-29 11:14:19,844::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.81', 'elapsedTime': '513892', 'displayType': 'vnc', 'cpuSys': '0.20', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '36103175', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57126', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '33620.32'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.19', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:14:20,492::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54204 >Detector thread::DEBUG::2014-10-29 11:14:20,493::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54204 >Detector thread::DEBUG::2014-10-29 11:14:20,493::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54204 >Detector thread::DEBUG::2014-10-29 11:14:20,493::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54204) >Thread-136035::DEBUG::2014-10-29 11:14:20,532::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136035::DEBUG::2014-10-29 11:14:20,534::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136035::DEBUG::2014-10-29 11:14:20,552::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136035::DEBUG::2014-10-29 11:14:20,598::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '81', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '81', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:14:20,860::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54205 >Detector thread::DEBUG::2014-10-29 11:14:20,861::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54205 >Detector thread::DEBUG::2014-10-29 11:14:20,861::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54205 >Detector thread::DEBUG::2014-10-29 11:14:20,862::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54205) >Thread-136036::DEBUG::2014-10-29 11:14:20,901::task::595::Storage.TaskManager.Task::(_updateState) Task=`77bb2e03-5ef4-4c66-b083-91c9bcca8dc7`::moving from state init -> state preparing >Thread-136036::INFO::2014-10-29 11:14:20,902::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136036::INFO::2014-10-29 11:14:20,903::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0015109', 'lastCheck': '1.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0023644', 'lastCheck': '1.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585827', 'lastCheck': '1.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000439776', 'lastCheck': '1.8', 'valid': True}} >Thread-136036::DEBUG::2014-10-29 11:14:20,903::task::1191::Storage.TaskManager.Task::(prepare) Task=`77bb2e03-5ef4-4c66-b083-91c9bcca8dc7`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0015109', 'lastCheck': '1.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0023644', 'lastCheck': '1.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585827', 'lastCheck': '1.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000439776', 'lastCheck': '1.8', 'valid': True}} >Thread-136036::DEBUG::2014-10-29 11:14:20,903::task::595::Storage.TaskManager.Task::(_updateState) Task=`77bb2e03-5ef4-4c66-b083-91c9bcca8dc7`::moving from state preparing -> state finished >Thread-136036::DEBUG::2014-10-29 11:14:20,904::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136036::DEBUG::2014-10-29 11:14:20,904::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136036::DEBUG::2014-10-29 11:14:20,904::task::993::Storage.TaskManager.Task::(_decref) Task=`77bb2e03-5ef4-4c66-b083-91c9bcca8dc7`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:21,970::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:21,972::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136037::DEBUG::2014-10-29 11:14:21,976::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:21,978::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:21,980::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136038::DEBUG::2014-10-29 11:14:21,983::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136038::DEBUG::2014-10-29 11:14:21,985::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:14:22,849::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54207 >Detector thread::DEBUG::2014-10-29 11:14:22,850::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54207 >Detector thread::DEBUG::2014-10-29 11:14:22,850::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54207 >Detector thread::DEBUG::2014-10-29 11:14:22,851::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54207) >Thread-136039::DEBUG::2014-10-29 11:14:22,891::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136039::DEBUG::2014-10-29 11:14:22,892::task::595::Storage.TaskManager.Task::(_updateState) Task=`85acef0f-e290-4d6f-a39e-1d51a007b21f`::moving from state init -> state preparing >Thread-136039::INFO::2014-10-29 11:14:22,892::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136039::DEBUG::2014-10-29 11:14:22,895::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:14:22,896::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:22,896::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:22,896::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:22,896::__init__::232::IOProcess::(_processLogs) (200505) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:22,899::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200505) Queuing response >Thread-136039::DEBUG::2014-10-29 11:14:22,900::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136039::DEBUG::2014-10-29 11:14:22,900::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136039::INFO::2014-10-29 11:14:22,900::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136039::DEBUG::2014-10-29 11:14:22,901::task::1191::Storage.TaskManager.Task::(prepare) Task=`85acef0f-e290-4d6f-a39e-1d51a007b21f`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136039::DEBUG::2014-10-29 11:14:22,901::task::595::Storage.TaskManager.Task::(_updateState) Task=`85acef0f-e290-4d6f-a39e-1d51a007b21f`::moving from state preparing -> state finished >Thread-136039::DEBUG::2014-10-29 11:14:22,901::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136039::DEBUG::2014-10-29 11:14:22,901::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136039::DEBUG::2014-10-29 11:14:22,902::task::993::Storage.TaskManager.Task::(_decref) Task=`85acef0f-e290-4d6f-a39e-1d51a007b21f`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:14:22,946::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54208 >Detector thread::DEBUG::2014-10-29 11:14:22,946::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54208 >Detector thread::DEBUG::2014-10-29 11:14:22,947::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54208 >Detector thread::DEBUG::2014-10-29 11:14:22,947::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54208) >Thread-136040::DEBUG::2014-10-29 11:14:22,986::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136040::DEBUG::2014-10-29 11:14:22,986::task::595::Storage.TaskManager.Task::(_updateState) Task=`f53f83c2-9d78-4254-b79c-49fe6ec1f951`::moving from state init -> state preparing >Thread-136040::INFO::2014-10-29 11:14:22,987::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136040::DEBUG::2014-10-29 11:14:22,988::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136040::DEBUG::2014-10-29 11:14:22,988::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136040::DEBUG::2014-10-29 11:14:22,988::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136040::DEBUG::2014-10-29 11:14:22,988::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136040::DEBUG::2014-10-29 11:14:22,989::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136040::DEBUG::2014-10-29 11:14:22,989::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136040::DEBUG::2014-10-29 11:14:23,079::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136040::DEBUG::2014-10-29 11:14:23,080::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136040::DEBUG::2014-10-29 11:14:23,245::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136040::DEBUG::2014-10-29 11:14:23,246::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136040::DEBUG::2014-10-29 11:14:23,246::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136040::DEBUG::2014-10-29 11:14:23,247::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136040::DEBUG::2014-10-29 11:14:23,247::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136040::DEBUG::2014-10-29 11:14:23,247::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136040::DEBUG::2014-10-29 11:14:23,248::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136040::DEBUG::2014-10-29 11:14:23,248::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:14:23,252::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:23,253::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:23,253::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:23,253::__init__::232::IOProcess::(_processLogs) (200506) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:23,254::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200506) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:23,261::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:23,262::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:23,262::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:23,262::__init__::232::IOProcess::(_processLogs) (200507) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:23,263::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:23,264::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:23,264::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:23,264::__init__::232::IOProcess::(_processLogs) (200508) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:23,265::__init__::232::IOProcess::(_processLogs) (200508) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:23,266::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200507) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:23,267::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:23,272::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:23,274::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:23,275::__init__::232::IOProcess::(_processLogs) (200509) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:23,277::__init__::232::IOProcess::(_processLogs) (200509) Queuing response >Thread-136040::DEBUG::2014-10-29 11:14:23,279::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:14:23,280::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:23,280::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:23,280::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:23,281::__init__::232::IOProcess::(_processLogs) (200510) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:14:23,282::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200510) Queuing response >Thread-136040::DEBUG::2014-10-29 11:14:23,282::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:14:23,284::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:23,285::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:23,285::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-136040::DEBUG::2014-10-29 11:14:23,286::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:14:23,287::__init__::232::IOProcess::(_processLogs) (200511) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:14:23,289::__init__::232::IOProcess::(_processLogs) (200511) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:23,291::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:23,291::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:23,292::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:23,292::__init__::232::IOProcess::(_processLogs) (200512) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:23,292::__init__::232::IOProcess::(_processLogs) (200512) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:23,293::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:23,293::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:23,293::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:23,294::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200513) Got request for method 'glob' >Thread-136040::DEBUG::2014-10-29 11:14:23,294::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:14:23,295::__init__::232::IOProcess::(_processLogs) (200513) Queuing response >Thread-136040::INFO::2014-10-29 11:14:23,296::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136040::INFO::2014-10-29 11:14:23,296::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136040::INFO::2014-10-29 11:14:23,297::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:14:23,298::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:23,298::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:23,298::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:23,298::__init__::232::IOProcess::(_processLogs) (200514) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:14:23,299::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200514) Queuing response >Thread-136040::DEBUG::2014-10-29 11:14:23,300::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136040::DEBUG::2014-10-29 11:14:23,302::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`786004d6-1403-4d0a-b185-44267c33e9c3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136040::DEBUG::2014-10-29 11:14:23,302::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136040::DEBUG::2014-10-29 11:14:23,303::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136040::DEBUG::2014-10-29 11:14:23,303::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`786004d6-1403-4d0a-b185-44267c33e9c3`::Granted request >Thread-136040::DEBUG::2014-10-29 11:14:23,304::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f53f83c2-9d78-4254-b79c-49fe6ec1f951`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136040::DEBUG::2014-10-29 11:14:23,304::task::993::Storage.TaskManager.Task::(_decref) Task=`f53f83c2-9d78-4254-b79c-49fe6ec1f951`::ref 1 aborting False >Thread-136040::INFO::2014-10-29 11:14:23,306::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136040::DEBUG::2014-10-29 11:14:23,307::task::1191::Storage.TaskManager.Task::(prepare) Task=`f53f83c2-9d78-4254-b79c-49fe6ec1f951`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136040::DEBUG::2014-10-29 11:14:23,307::task::595::Storage.TaskManager.Task::(_updateState) Task=`f53f83c2-9d78-4254-b79c-49fe6ec1f951`::moving from state preparing -> state finished >Thread-136040::DEBUG::2014-10-29 11:14:23,307::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136040::DEBUG::2014-10-29 11:14:23,308::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136040::DEBUG::2014-10-29 11:14:23,308::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136040::DEBUG::2014-10-29 11:14:23,308::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136040::DEBUG::2014-10-29 11:14:23,309::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136040::DEBUG::2014-10-29 11:14:23,309::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136040::DEBUG::2014-10-29 11:14:23,309::task::993::Storage.TaskManager.Task::(_decref) Task=`f53f83c2-9d78-4254-b79c-49fe6ec1f951`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:14:23,331::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54209 >Detector thread::DEBUG::2014-10-29 11:14:23,332::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54209 >Detector thread::DEBUG::2014-10-29 11:14:23,332::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54209 >Detector thread::DEBUG::2014-10-29 11:14:23,333::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54209) >Thread-136045::DEBUG::2014-10-29 11:14:23,372::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136045::DEBUG::2014-10-29 11:14:23,372::task::595::Storage.TaskManager.Task::(_updateState) Task=`a4f30750-685a-4491-b40a-714cf60d965e`::moving from state init -> state preparing >Thread-136045::INFO::2014-10-29 11:14:23,373::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136045::INFO::2014-10-29 11:14:23,373::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0015109', 'lastCheck': '4.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0023644', 'lastCheck': '4.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585827', 'lastCheck': '4.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000439776', 'lastCheck': '4.2', 'valid': True}} >Thread-136045::DEBUG::2014-10-29 11:14:23,374::task::1191::Storage.TaskManager.Task::(prepare) Task=`a4f30750-685a-4491-b40a-714cf60d965e`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0015109', 'lastCheck': '4.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0023644', 'lastCheck': '4.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585827', 'lastCheck': '4.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000439776', 'lastCheck': '4.2', 'valid': True}} >Thread-136045::DEBUG::2014-10-29 11:14:23,374::task::595::Storage.TaskManager.Task::(_updateState) Task=`a4f30750-685a-4491-b40a-714cf60d965e`::moving from state preparing -> state finished >Thread-136045::DEBUG::2014-10-29 11:14:23,374::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136045::DEBUG::2014-10-29 11:14:23,374::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136045::DEBUG::2014-10-29 11:14:23,375::task::993::Storage.TaskManager.Task::(_decref) Task=`a4f30750-685a-4491-b40a-714cf60d965e`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:24,756::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:24,757::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:24,760::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:25,010::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:25,012::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136046::DEBUG::2014-10-29 11:14:25,016::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:25,020::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:25,022::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136047::DEBUG::2014-10-29 11:14:25,025::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136047::DEBUG::2014-10-29 11:14:25,028::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:28,043::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:28,045::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136048::DEBUG::2014-10-29 11:14:28,049::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:28,051::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:28,053::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136049::DEBUG::2014-10-29 11:14:28,056::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136049::DEBUG::2014-10-29 11:14:28,058::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:14:29,086::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:29,087::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:29,087::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:29,087::__init__::232::IOProcess::(_processLogs) (200515) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:29,140::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:29,140::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:29,141::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:29,141::__init__::232::IOProcess::(_processLogs) (200516) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:29,160::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:29,161::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:29,161::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:29,161::__init__::232::IOProcess::(_processLogs) (200517) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:29,164::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:29,165::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:29,165::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:29,165::__init__::232::IOProcess::(_processLogs) (200518) Got request for method 'statvfs' >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:29,763::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:29,764::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:29,765::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:14:30,011::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54210 >Detector thread::DEBUG::2014-10-29 11:14:30,012::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54210 >Detector thread::DEBUG::2014-10-29 11:14:30,012::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54210 >Detector thread::DEBUG::2014-10-29 11:14:30,013::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54210) >Thread-136050::DEBUG::2014-10-29 11:14:30,052::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136050::DEBUG::2014-10-29 11:14:30,053::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136050::DEBUG::2014-10-29 11:14:30,053::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.81', 'elapsedTime': '513902', 'displayType': 'vnc', 'cpuSys': '0.20', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '36103175', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57126', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '33620.32'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.40', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:14:30,645::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54212 >Detector thread::DEBUG::2014-10-29 11:14:30,645::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54212 >Detector thread::DEBUG::2014-10-29 11:14:30,645::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54212 >Detector thread::DEBUG::2014-10-29 11:14:30,646::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54212) >Thread-136051::DEBUG::2014-10-29 11:14:30,685::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136051::DEBUG::2014-10-29 11:14:30,687::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136051::DEBUG::2014-10-29 11:14:30,705::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136051::DEBUG::2014-10-29 11:14:30,752::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '66', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '66', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:14:30,963::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54213 >Detector thread::DEBUG::2014-10-29 11:14:30,963::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54213 >Detector thread::DEBUG::2014-10-29 11:14:30,964::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54213 >Detector thread::DEBUG::2014-10-29 11:14:30,964::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54213) >Thread-136052::DEBUG::2014-10-29 11:14:31,004::task::595::Storage.TaskManager.Task::(_updateState) Task=`76aa2bcc-6d78-4ddf-a8c7-3b16d50cbaf6`::moving from state init -> state preparing >Thread-136052::INFO::2014-10-29 11:14:31,005::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136052::INFO::2014-10-29 11:14:31,005::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0015109', 'lastCheck': '11.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0023644', 'lastCheck': '11.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585827', 'lastCheck': '11.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000439776', 'lastCheck': '11.9', 'valid': True}} >Thread-136052::DEBUG::2014-10-29 11:14:31,006::task::1191::Storage.TaskManager.Task::(prepare) Task=`76aa2bcc-6d78-4ddf-a8c7-3b16d50cbaf6`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0015109', 'lastCheck': '11.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0023644', 'lastCheck': '11.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585827', 'lastCheck': '11.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000439776', 'lastCheck': '11.9', 'valid': True}} >Thread-136052::DEBUG::2014-10-29 11:14:31,006::task::595::Storage.TaskManager.Task::(_updateState) Task=`76aa2bcc-6d78-4ddf-a8c7-3b16d50cbaf6`::moving from state preparing -> state finished >Thread-136052::DEBUG::2014-10-29 11:14:31,006::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136052::DEBUG::2014-10-29 11:14:31,006::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136052::DEBUG::2014-10-29 11:14:31,007::task::993::Storage.TaskManager.Task::(_decref) Task=`76aa2bcc-6d78-4ddf-a8c7-3b16d50cbaf6`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:31,071::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:31,075::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136053::DEBUG::2014-10-29 11:14:31,079::task::595::Storage.TaskManager.Task::(_updateState) Task=`4a77630b-fdb8-4476-8f0c-6c20aa73768f`::moving from state init -> state preparing >Thread-136053::INFO::2014-10-29 11:14:31,079::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136053::INFO::2014-10-29 11:14:31,080::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0015109', 'lastCheck': '11.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0023644', 'lastCheck': '11.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585827', 'lastCheck': '12.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000439776', 'lastCheck': '11.9', 'valid': True}} >Thread-136053::DEBUG::2014-10-29 11:14:31,080::task::1191::Storage.TaskManager.Task::(prepare) Task=`4a77630b-fdb8-4476-8f0c-6c20aa73768f`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0015109', 'lastCheck': '11.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0023644', 'lastCheck': '11.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000585827', 'lastCheck': '12.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000439776', 'lastCheck': '11.9', 'valid': True}} >Thread-136053::DEBUG::2014-10-29 11:14:31,080::task::595::Storage.TaskManager.Task::(_updateState) Task=`4a77630b-fdb8-4476-8f0c-6c20aa73768f`::moving from state preparing -> state finished >Thread-136053::DEBUG::2014-10-29 11:14:31,081::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136053::DEBUG::2014-10-29 11:14:31,081::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136053::DEBUG::2014-10-29 11:14:31,081::task::993::Storage.TaskManager.Task::(_decref) Task=`4a77630b-fdb8-4476-8f0c-6c20aa73768f`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:14:31,789::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200516) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:31,789::__init__::232::IOProcess::(_processLogs) (200517) Queuing response >Thread-10269::DEBUG::2014-10-29 11:14:31,793::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:14:31,820::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200518) Queuing response >Thread-10269::DEBUG::2014-10-29 11:14:31,823::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000521058 s, 963 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:14:31,828::__init__::232::IOProcess::(_processLogs) (200515) Queuing response >Thread-33::DEBUG::2014-10-29 11:14:31,828::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:14:31,858::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00255625 s, 191 kB/s\n'; <rc> = 0 >Thread-178::DEBUG::2014-10-29 11:14:31,870::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:14:31,897::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-178::DEBUG::2014-10-29 11:14:31,899::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000508997 s, 998 kB/s\n'; <rc> = 0 >Thread-179::DEBUG::2014-10-29 11:14:31,903::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:14:31,905::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:31,925::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-179::DEBUG::2014-10-29 11:14:31,930::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00123088 s, 302 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:14:31,932::__init__::232::IOProcess::(_processLogs) (200519) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:31,945::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200519) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:31,953::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:31,957::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:31,959::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:31,962::__init__::232::IOProcess::(_processLogs) (200520) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:31,968::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200520) Queuing response >Thread-136053::DEBUG::2014-10-29 11:14:31,972::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:14:31,975::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:31,976::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:31,976::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:31,976::__init__::232::IOProcess::(_processLogs) (200521) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:31,978::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200521) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:31,980::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:31,980::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:31,980::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:31,981::__init__::232::IOProcess::(_processLogs) (200522) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:31,982::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200522) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:31,983::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:31,984::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:31,984::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:31,986::__init__::232::IOProcess::(_processLogs) (200523) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:31,986::__init__::232::IOProcess::(_processLogs) (200523) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:31,988::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:31,988::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:31,988::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:31,989::__init__::232::IOProcess::(_processLogs) (200524) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:31,989::__init__::232::IOProcess::(_processLogs) (200524) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:31,991::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:31,992::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:31,992::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:31,992::__init__::232::IOProcess::(_processLogs) (200525) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:31,992::__init__::232::IOProcess::(_processLogs) (200525) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:31,993::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:31,994::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:31,995::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:31,995::__init__::232::IOProcess::(_processLogs) (200526) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:31,995::__init__::232::IOProcess::(_processLogs) (200526) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:31,996::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:31,997::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:31,997::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:31,998::__init__::232::IOProcess::(_processLogs) (200527) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:31,999::__init__::232::IOProcess::(_processLogs) (200527) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:31,999::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:32,000::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:32,003::__init__::232::IOProcess::(_processLogs) Extracting request information... >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:32,003::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-17::DEBUG::2014-10-29 11:14:32,004::__init__::232::IOProcess::(_processLogs) (200528) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:32,006::__init__::232::IOProcess::(_processLogs) (200528) Queuing response >JsonRpcServer::DEBUG::2014-10-29 11:14:32,009::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136054::DEBUG::2014-10-29 11:14:32,019::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136054::DEBUG::2014-10-29 11:14:32,030::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:14:32,670::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >VM Channels Listener::DEBUG::2014-10-29 11:14:33,703::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >Detector thread::DEBUG::2014-10-29 11:14:33,941::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54215 >Detector thread::DEBUG::2014-10-29 11:14:33,941::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54215 >Detector thread::DEBUG::2014-10-29 11:14:33,942::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54215 >Detector thread::DEBUG::2014-10-29 11:14:33,942::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54215) >Thread-136055::DEBUG::2014-10-29 11:14:33,982::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136055::DEBUG::2014-10-29 11:14:33,983::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3836124-cb27-495c-b5de-fb210729343e`::moving from state init -> state preparing >Thread-136055::INFO::2014-10-29 11:14:33,983::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136055::DEBUG::2014-10-29 11:14:34,001::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:14:34,002::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:34,002::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:34,002::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:34,002::__init__::232::IOProcess::(_processLogs) (200529) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:34,003::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200529) Queuing response >Thread-136055::DEBUG::2014-10-29 11:14:34,003::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136055::DEBUG::2014-10-29 11:14:34,005::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136055::INFO::2014-10-29 11:14:34,005::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136055::DEBUG::2014-10-29 11:14:34,005::task::1191::Storage.TaskManager.Task::(prepare) Task=`d3836124-cb27-495c-b5de-fb210729343e`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136055::DEBUG::2014-10-29 11:14:34,006::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3836124-cb27-495c-b5de-fb210729343e`::moving from state preparing -> state finished >Thread-136055::DEBUG::2014-10-29 11:14:34,006::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136055::DEBUG::2014-10-29 11:14:34,006::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136055::DEBUG::2014-10-29 11:14:34,006::task::993::Storage.TaskManager.Task::(_decref) Task=`d3836124-cb27-495c-b5de-fb210729343e`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:14:34,061::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54216 >Detector thread::DEBUG::2014-10-29 11:14:34,061::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54216 >Detector thread::DEBUG::2014-10-29 11:14:34,061::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54216 >Detector thread::DEBUG::2014-10-29 11:14:34,062::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54216) >Thread-136056::DEBUG::2014-10-29 11:14:34,101::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136056::DEBUG::2014-10-29 11:14:34,101::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f2273b9-5698-4c77-8f56-0976694668ea`::moving from state init -> state preparing >Thread-136056::INFO::2014-10-29 11:14:34,102::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136056::DEBUG::2014-10-29 11:14:34,102::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136056::DEBUG::2014-10-29 11:14:34,102::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136056::DEBUG::2014-10-29 11:14:34,103::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136056::DEBUG::2014-10-29 11:14:34,103::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136056::DEBUG::2014-10-29 11:14:34,103::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136056::DEBUG::2014-10-29 11:14:34,104::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136056::DEBUG::2014-10-29 11:14:34,191::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136056::DEBUG::2014-10-29 11:14:34,192::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136056::DEBUG::2014-10-29 11:14:34,373::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136056::DEBUG::2014-10-29 11:14:34,374::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136056::DEBUG::2014-10-29 11:14:34,374::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136056::DEBUG::2014-10-29 11:14:34,375::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136056::DEBUG::2014-10-29 11:14:34,375::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136056::DEBUG::2014-10-29 11:14:34,375::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136056::DEBUG::2014-10-29 11:14:34,376::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136056::DEBUG::2014-10-29 11:14:34,376::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:14:34,383::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:34,387::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:34,388::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:34,389::__init__::232::IOProcess::(_processLogs) (200530) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:34,389::__init__::232::IOProcess::(_processLogs) (200530) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:34,390::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:34,390::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:34,390::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:34,391::__init__::232::IOProcess::(_processLogs) (200531) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:34,391::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200531) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:34,391::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:34,391::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:34,392::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:34,392::__init__::232::IOProcess::(_processLogs) (200532) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:34,392::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200532) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:34,393::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:34,393::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:34,393::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:34,393::__init__::232::IOProcess::(_processLogs) (200533) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:34,399::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200533) Queuing response >Thread-136056::DEBUG::2014-10-29 11:14:34,403::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:14:34,404::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:34,404::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:34,404::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:34,404::__init__::232::IOProcess::(_processLogs) (200534) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:14:34,405::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200534) Queuing response >Thread-136056::DEBUG::2014-10-29 11:14:34,406::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:14:34,407::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:34,407::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:34,408::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:34,408::__init__::232::IOProcess::(_processLogs) (200535) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:14:34,409::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200535) Queuing response >Thread-136056::DEBUG::2014-10-29 11:14:34,409::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:14:34,411::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:34,412::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:34,412::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:34,413::__init__::232::IOProcess::(_processLogs) (200536) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:34,413::__init__::232::IOProcess::(_processLogs) (200536) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:34,413::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:34,414::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:34,414::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:34,414::__init__::232::IOProcess::(_processLogs) (200537) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:34,416::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200537) Queuing response >Thread-136056::DEBUG::2014-10-29 11:14:34,416::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-136056::INFO::2014-10-29 11:14:34,417::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136056::INFO::2014-10-29 11:14:34,418::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136056::INFO::2014-10-29 11:14:34,418::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:14:34,419::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:34,419::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:34,419::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:34,420::__init__::232::IOProcess::(_processLogs) (200538) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:14:34,421::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200538) Queuing response >Thread-136056::DEBUG::2014-10-29 11:14:34,421::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136056::DEBUG::2014-10-29 11:14:34,423::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`c44301b7-5eb0-487b-858d-8971dfc0bbe2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136056::DEBUG::2014-10-29 11:14:34,423::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136056::DEBUG::2014-10-29 11:14:34,424::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136056::DEBUG::2014-10-29 11:14:34,424::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`c44301b7-5eb0-487b-858d-8971dfc0bbe2`::Granted request >Thread-136056::DEBUG::2014-10-29 11:14:34,425::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1f2273b9-5698-4c77-8f56-0976694668ea`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136056::DEBUG::2014-10-29 11:14:34,425::task::993::Storage.TaskManager.Task::(_decref) Task=`1f2273b9-5698-4c77-8f56-0976694668ea`::ref 1 aborting False >Thread-136056::INFO::2014-10-29 11:14:34,428::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136056::DEBUG::2014-10-29 11:14:34,428::task::1191::Storage.TaskManager.Task::(prepare) Task=`1f2273b9-5698-4c77-8f56-0976694668ea`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136056::DEBUG::2014-10-29 11:14:34,428::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f2273b9-5698-4c77-8f56-0976694668ea`::moving from state preparing -> state finished >Thread-136056::DEBUG::2014-10-29 11:14:34,428::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136056::DEBUG::2014-10-29 11:14:34,429::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136056::DEBUG::2014-10-29 11:14:34,429::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136056::DEBUG::2014-10-29 11:14:34,429::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136056::DEBUG::2014-10-29 11:14:34,430::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136056::DEBUG::2014-10-29 11:14:34,430::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136056::DEBUG::2014-10-29 11:14:34,430::task::993::Storage.TaskManager.Task::(_decref) Task=`1f2273b9-5698-4c77-8f56-0976694668ea`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:14:34,451::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54217 >Detector thread::DEBUG::2014-10-29 11:14:34,452::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54217 >Detector thread::DEBUG::2014-10-29 11:14:34,452::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54217 >Detector thread::DEBUG::2014-10-29 11:14:34,453::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54217) >Thread-136061::DEBUG::2014-10-29 11:14:34,492::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136061::DEBUG::2014-10-29 11:14:34,493::task::595::Storage.TaskManager.Task::(_updateState) Task=`719274ba-cac9-459f-b232-f6b252f92e47`::moving from state init -> state preparing >Thread-136061::INFO::2014-10-29 11:14:34,493::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136061::INFO::2014-10-29 11:14:34,494::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000508997', 'lastCheck': '2.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00255625', 'lastCheck': '2.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00123088', 'lastCheck': '2.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000521058', 'lastCheck': '2.5', 'valid': True}} >Thread-136061::DEBUG::2014-10-29 11:14:34,494::task::1191::Storage.TaskManager.Task::(prepare) Task=`719274ba-cac9-459f-b232-f6b252f92e47`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000508997', 'lastCheck': '2.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00255625', 'lastCheck': '2.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00123088', 'lastCheck': '2.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000521058', 'lastCheck': '2.5', 'valid': True}} >Thread-136061::DEBUG::2014-10-29 11:14:34,494::task::595::Storage.TaskManager.Task::(_updateState) Task=`719274ba-cac9-459f-b232-f6b252f92e47`::moving from state preparing -> state finished >Thread-136061::DEBUG::2014-10-29 11:14:34,494::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136061::DEBUG::2014-10-29 11:14:34,495::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136061::DEBUG::2014-10-29 11:14:34,495::task::993::Storage.TaskManager.Task::(_decref) Task=`719274ba-cac9-459f-b232-f6b252f92e47`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:34,772::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:34,773::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:34,778::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:35,073::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:35,075::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136062::DEBUG::2014-10-29 11:14:35,078::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:35,080::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:35,082::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136063::DEBUG::2014-10-29 11:14:35,085::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136063::DEBUG::2014-10-29 11:14:35,087::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:38,115::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:38,118::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136064::DEBUG::2014-10-29 11:14:38,122::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:38,124::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:38,125::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136065::DEBUG::2014-10-29 11:14:38,129::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136065::DEBUG::2014-10-29 11:14:38,131::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:39,785::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:39,787::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:39,788::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:14:40,206::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54218 >Detector thread::DEBUG::2014-10-29 11:14:40,206::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54218 >Detector thread::DEBUG::2014-10-29 11:14:40,207::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54218 >Detector thread::DEBUG::2014-10-29 11:14:40,207::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54218) >Thread-136066::DEBUG::2014-10-29 11:14:40,246::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136066::DEBUG::2014-10-29 11:14:40,247::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136066::DEBUG::2014-10-29 11:14:40,248::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.63', 'elapsedTime': '513912', 'displayType': 'vnc', 'cpuSys': '1.26', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '36103175', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57126', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '33620.32'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.57', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:14:40,802::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54220 >Detector thread::DEBUG::2014-10-29 11:14:40,803::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54220 >Detector thread::DEBUG::2014-10-29 11:14:40,804::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54220 >Detector thread::DEBUG::2014-10-29 11:14:40,804::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54220) >Thread-136067::DEBUG::2014-10-29 11:14:40,843::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136067::DEBUG::2014-10-29 11:14:40,845::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136067::DEBUG::2014-10-29 11:14:40,863::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136067::DEBUG::2014-10-29 11:14:40,910::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '50', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '50', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:14:41,000::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54221 >Detector thread::DEBUG::2014-10-29 11:14:41,001::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54221 >Detector thread::DEBUG::2014-10-29 11:14:41,001::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54221 >Detector thread::DEBUG::2014-10-29 11:14:41,002::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54221) >Thread-136068::DEBUG::2014-10-29 11:14:41,041::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca5b25c9-36d3-4bd7-a52a-c32b23a95fb4`::moving from state init -> state preparing >Thread-136068::INFO::2014-10-29 11:14:41,041::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136068::INFO::2014-10-29 11:14:41,042::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000508997', 'lastCheck': '9.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00255625', 'lastCheck': '9.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00123088', 'lastCheck': '9.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000521058', 'lastCheck': '9.1', 'valid': True}} >Thread-136068::DEBUG::2014-10-29 11:14:41,042::task::1191::Storage.TaskManager.Task::(prepare) Task=`ca5b25c9-36d3-4bd7-a52a-c32b23a95fb4`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000508997', 'lastCheck': '9.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00255625', 'lastCheck': '9.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00123088', 'lastCheck': '9.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000521058', 'lastCheck': '9.1', 'valid': True}} >Thread-136068::DEBUG::2014-10-29 11:14:41,043::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca5b25c9-36d3-4bd7-a52a-c32b23a95fb4`::moving from state preparing -> state finished >Thread-136068::DEBUG::2014-10-29 11:14:41,043::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136068::DEBUG::2014-10-29 11:14:41,043::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136068::DEBUG::2014-10-29 11:14:41,044::task::993::Storage.TaskManager.Task::(_decref) Task=`ca5b25c9-36d3-4bd7-a52a-c32b23a95fb4`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:41,149::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:41,151::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136069::DEBUG::2014-10-29 11:14:41,156::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:41,158::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:41,160::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136070::DEBUG::2014-10-29 11:14:41,166::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136070::DEBUG::2014-10-29 11:14:41,168::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:14:41,950::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:41,950::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:41,951::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:41,951::__init__::232::IOProcess::(_processLogs) (200539) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:41,951::__init__::232::IOProcess::(_processLogs) (200539) Queuing response >Thread-10269::DEBUG::2014-10-29 11:14:41,953::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:14:41,973::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000728737 s, 689 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:14:41,975::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:41,976::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:41,976::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:41,976::__init__::232::IOProcess::(_processLogs) (200540) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:41,977::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200540) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:41,987::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:41,988::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-179::DEBUG::2014-10-29 11:14:41,989::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:14:42,009::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:42,012::__init__::232::IOProcess::(_processLogs) (200541) Got request for method 'statvfs' >Thread-179::DEBUG::2014-10-29 11:14:42,012::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00226479 s, 164 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:14:42,014::__init__::232::IOProcess::(_processLogs) (200541) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:42,015::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:42,016::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:42,016::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:42,016::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:42,017::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:42,017::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:42,017::__init__::232::IOProcess::(_processLogs) (200542) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:42,017::__init__::232::IOProcess::(_processLogs) (200543) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:42,019::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:42,020::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:42,021::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:42,021::__init__::232::IOProcess::(_processLogs) (200544) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:42,021::__init__::232::IOProcess::(_processLogs) (200544) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:42,022::__init__::232::IOProcess::(_processLogs) (200542) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:42,022::__init__::232::IOProcess::(_processLogs) (200543) Queuing response >Thread-33::DEBUG::2014-10-29 11:14:42,027::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:14:42,046::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:14:42,048::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000645512 s, 754 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:14:42,067::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-178::DEBUG::2014-10-29 11:14:42,069::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000638617 s, 795 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:14:42,071::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:42,072::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:42,072::__init__::232::IOProcess::(_processLogs) (200545) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:42,073::__init__::232::IOProcess::(_processLogs) (200545) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:42,073::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:42,074::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:42,074::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:42,074::__init__::232::IOProcess::(_processLogs) (200546) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:42,074::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:42,075::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:42,076::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:42,077::__init__::232::IOProcess::(_processLogs) (200547) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:42,077::__init__::232::IOProcess::(_processLogs) (200547) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:42,077::__init__::232::IOProcess::(_processLogs) (200546) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:42,080::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:42,080::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:42,081::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:42,082::__init__::232::IOProcess::(_processLogs) (200548) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:42,082::__init__::232::IOProcess::(_processLogs) (200548) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:42,082::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:42,083::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:42,084::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:42,084::__init__::232::IOProcess::(_processLogs) (200549) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:42,085::__init__::232::IOProcess::(_processLogs) (200549) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:42,085::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:42,087::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:42,090::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:42,092::__init__::232::IOProcess::(_processLogs) (200550) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:42,093::__init__::232::IOProcess::(_processLogs) (200550) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:42,094::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:42,095::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:42,098::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:42,099::__init__::232::IOProcess::(_processLogs) (200551) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:42,100::__init__::232::IOProcess::(_processLogs) (200551) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:42,103::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:42,104::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:42,105::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:42,106::__init__::232::IOProcess::(_processLogs) (200552) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:42,109::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200552) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:44,182::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:44,185::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136071::DEBUG::2014-10-29 11:14:44,188::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:44,191::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:44,192::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136072::DEBUG::2014-10-29 11:14:44,196::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136072::DEBUG::2014-10-29 11:14:44,198::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:44,794::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:44,796::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:44,797::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:14:45,075::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54223 >Detector thread::DEBUG::2014-10-29 11:14:45,076::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54223 >Detector thread::DEBUG::2014-10-29 11:14:45,076::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54223 >Detector thread::DEBUG::2014-10-29 11:14:45,077::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54223) >Thread-136073::DEBUG::2014-10-29 11:14:45,117::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136073::DEBUG::2014-10-29 11:14:45,118::task::595::Storage.TaskManager.Task::(_updateState) Task=`cefd9fc4-28aa-48c9-a7d7-8acb1d43d808`::moving from state init -> state preparing >Thread-136073::INFO::2014-10-29 11:14:45,118::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136073::DEBUG::2014-10-29 11:14:45,121::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:14:45,122::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:45,123::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:45,123::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:45,123::__init__::232::IOProcess::(_processLogs) (200553) Got request for method 'glob' >Thread-136073::DEBUG::2014-10-29 11:14:45,126::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:14:45,126::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200553) Queuing response >Thread-136073::DEBUG::2014-10-29 11:14:45,127::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136073::INFO::2014-10-29 11:14:45,128::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136073::DEBUG::2014-10-29 11:14:45,128::task::1191::Storage.TaskManager.Task::(prepare) Task=`cefd9fc4-28aa-48c9-a7d7-8acb1d43d808`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136073::DEBUG::2014-10-29 11:14:45,128::task::595::Storage.TaskManager.Task::(_updateState) Task=`cefd9fc4-28aa-48c9-a7d7-8acb1d43d808`::moving from state preparing -> state finished >Thread-136073::DEBUG::2014-10-29 11:14:45,129::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136073::DEBUG::2014-10-29 11:14:45,129::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136073::DEBUG::2014-10-29 11:14:45,129::task::993::Storage.TaskManager.Task::(_decref) Task=`cefd9fc4-28aa-48c9-a7d7-8acb1d43d808`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:14:45,173::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54224 >Detector thread::DEBUG::2014-10-29 11:14:45,174::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54224 >Detector thread::DEBUG::2014-10-29 11:14:45,174::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54224 >Detector thread::DEBUG::2014-10-29 11:14:45,175::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54224) >Thread-136074::DEBUG::2014-10-29 11:14:45,214::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136074::DEBUG::2014-10-29 11:14:45,214::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a1ef9e3-f19e-4f3d-9d6f-fc0ac26a726f`::moving from state init -> state preparing >Thread-136074::INFO::2014-10-29 11:14:45,215::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136074::DEBUG::2014-10-29 11:14:45,215::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136074::DEBUG::2014-10-29 11:14:45,215::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136074::DEBUG::2014-10-29 11:14:45,216::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136074::DEBUG::2014-10-29 11:14:45,216::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136074::DEBUG::2014-10-29 11:14:45,216::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136074::DEBUG::2014-10-29 11:14:45,217::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136074::DEBUG::2014-10-29 11:14:45,307::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136074::DEBUG::2014-10-29 11:14:45,308::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136074::DEBUG::2014-10-29 11:14:45,476::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136074::DEBUG::2014-10-29 11:14:45,477::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136074::DEBUG::2014-10-29 11:14:45,478::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136074::DEBUG::2014-10-29 11:14:45,479::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136074::DEBUG::2014-10-29 11:14:45,479::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136074::DEBUG::2014-10-29 11:14:45,479::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136074::DEBUG::2014-10-29 11:14:45,480::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136074::DEBUG::2014-10-29 11:14:45,480::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:14:45,486::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:45,490::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:45,492::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:45,492::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:45,493::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:45,493::__init__::232::IOProcess::(_processLogs) (200554) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:45,493::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:45,493::__init__::232::IOProcess::(_processLogs) (200555) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:45,494::__init__::232::IOProcess::(_processLogs) (200554) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:45,494::__init__::232::IOProcess::(_processLogs) (200555) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:45,495::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:45,500::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:45,501::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:45,502::__init__::232::IOProcess::(_processLogs) (200556) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:45,502::__init__::232::IOProcess::(_processLogs) (200556) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:45,503::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:45,503::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:45,506::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:45,509::__init__::232::IOProcess::(_processLogs) (200557) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:45,511::__init__::232::IOProcess::(_processLogs) (200557) Queuing response >Thread-136074::DEBUG::2014-10-29 11:14:45,513::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:14:45,514::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:45,514::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:45,514::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:45,515::__init__::232::IOProcess::(_processLogs) (200558) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:14:45,517::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200558) Queuing response >Thread-136074::DEBUG::2014-10-29 11:14:45,518::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:14:45,519::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:45,519::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:45,519::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:45,520::__init__::232::IOProcess::(_processLogs) (200559) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:14:45,520::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200559) Queuing response >Thread-136074::DEBUG::2014-10-29 11:14:45,521::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:14:45,523::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:45,523::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:45,524::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:45,524::__init__::232::IOProcess::(_processLogs) (200560) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:45,525::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200560) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:45,526::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:45,526::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:45,526::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:45,526::__init__::232::IOProcess::(_processLogs) (200561) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:45,527::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200561) Queuing response >Thread-136074::DEBUG::2014-10-29 11:14:45,527::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-136074::INFO::2014-10-29 11:14:45,528::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136074::INFO::2014-10-29 11:14:45,529::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136074::INFO::2014-10-29 11:14:45,529::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:14:45,530::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:45,530::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:45,531::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:45,531::__init__::232::IOProcess::(_processLogs) (200562) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:14:45,534::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200562) Queuing response >Thread-136074::DEBUG::2014-10-29 11:14:45,535::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136074::DEBUG::2014-10-29 11:14:45,536::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`1f0385a1-7620-448f-a2c1-7228b65cd6bc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136074::DEBUG::2014-10-29 11:14:45,537::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136074::DEBUG::2014-10-29 11:14:45,537::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136074::DEBUG::2014-10-29 11:14:45,537::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`1f0385a1-7620-448f-a2c1-7228b65cd6bc`::Granted request >Thread-136074::DEBUG::2014-10-29 11:14:45,538::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9a1ef9e3-f19e-4f3d-9d6f-fc0ac26a726f`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136074::DEBUG::2014-10-29 11:14:45,538::task::993::Storage.TaskManager.Task::(_decref) Task=`9a1ef9e3-f19e-4f3d-9d6f-fc0ac26a726f`::ref 1 aborting False >Thread-136074::INFO::2014-10-29 11:14:45,541::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136074::DEBUG::2014-10-29 11:14:45,542::task::1191::Storage.TaskManager.Task::(prepare) Task=`9a1ef9e3-f19e-4f3d-9d6f-fc0ac26a726f`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136074::DEBUG::2014-10-29 11:14:45,542::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a1ef9e3-f19e-4f3d-9d6f-fc0ac26a726f`::moving from state preparing -> state finished >Thread-136074::DEBUG::2014-10-29 11:14:45,542::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136074::DEBUG::2014-10-29 11:14:45,542::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136074::DEBUG::2014-10-29 11:14:45,543::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136074::DEBUG::2014-10-29 11:14:45,543::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136074::DEBUG::2014-10-29 11:14:45,543::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136074::DEBUG::2014-10-29 11:14:45,544::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136074::DEBUG::2014-10-29 11:14:45,544::task::993::Storage.TaskManager.Task::(_decref) Task=`9a1ef9e3-f19e-4f3d-9d6f-fc0ac26a726f`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:14:45,568::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54225 >Detector thread::DEBUG::2014-10-29 11:14:45,569::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54225 >Detector thread::DEBUG::2014-10-29 11:14:45,569::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54225 >Detector thread::DEBUG::2014-10-29 11:14:45,569::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54225) >Thread-136079::DEBUG::2014-10-29 11:14:45,608::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136079::DEBUG::2014-10-29 11:14:45,609::task::595::Storage.TaskManager.Task::(_updateState) Task=`78c8ed8e-a985-40cd-9b47-d32a62c6c819`::moving from state init -> state preparing >Thread-136079::INFO::2014-10-29 11:14:45,609::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136079::INFO::2014-10-29 11:14:45,610::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638617', 'lastCheck': '3.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000645512', 'lastCheck': '3.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00226479', 'lastCheck': '3.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000728737', 'lastCheck': '3.6', 'valid': True}} >Thread-136079::DEBUG::2014-10-29 11:14:45,610::task::1191::Storage.TaskManager.Task::(prepare) Task=`78c8ed8e-a985-40cd-9b47-d32a62c6c819`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638617', 'lastCheck': '3.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000645512', 'lastCheck': '3.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00226479', 'lastCheck': '3.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000728737', 'lastCheck': '3.6', 'valid': True}} >Thread-136079::DEBUG::2014-10-29 11:14:45,610::task::595::Storage.TaskManager.Task::(_updateState) Task=`78c8ed8e-a985-40cd-9b47-d32a62c6c819`::moving from state preparing -> state finished >Thread-136079::DEBUG::2014-10-29 11:14:45,611::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136079::DEBUG::2014-10-29 11:14:45,611::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136079::DEBUG::2014-10-29 11:14:45,611::task::993::Storage.TaskManager.Task::(_decref) Task=`78c8ed8e-a985-40cd-9b47-d32a62c6c819`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:47,220::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:47,224::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136080::DEBUG::2014-10-29 11:14:47,228::task::595::Storage.TaskManager.Task::(_updateState) Task=`12cb5aae-d478-4b9d-ada0-2d8dc55000c7`::moving from state init -> state preparing >Thread-136080::INFO::2014-10-29 11:14:47,229::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136080::INFO::2014-10-29 11:14:47,230::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638617', 'lastCheck': '5.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000645512', 'lastCheck': '5.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00226479', 'lastCheck': '5.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000728737', 'lastCheck': '5.3', 'valid': True}} >Thread-136080::DEBUG::2014-10-29 11:14:47,230::task::1191::Storage.TaskManager.Task::(prepare) Task=`12cb5aae-d478-4b9d-ada0-2d8dc55000c7`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638617', 'lastCheck': '5.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000645512', 'lastCheck': '5.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00226479', 'lastCheck': '5.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000728737', 'lastCheck': '5.3', 'valid': True}} >Thread-136080::DEBUG::2014-10-29 11:14:47,230::task::595::Storage.TaskManager.Task::(_updateState) Task=`12cb5aae-d478-4b9d-ada0-2d8dc55000c7`::moving from state preparing -> state finished >Thread-136080::DEBUG::2014-10-29 11:14:47,230::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136080::DEBUG::2014-10-29 11:14:47,231::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136080::DEBUG::2014-10-29 11:14:47,231::task::993::Storage.TaskManager.Task::(_decref) Task=`12cb5aae-d478-4b9d-ada0-2d8dc55000c7`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:14:47,674::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4e56eb6-5692-4dc1-9401-8899d2ae4af7`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:14:47,675::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:14:47,676::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:47,676::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:47,677::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:47,677::__init__::232::IOProcess::(_processLogs) (200563) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:14:48,291::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200563) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:48,297::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:48,298::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:48,300::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:48,302::__init__::232::IOProcess::(_processLogs) (200564) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:14:48,308::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200564) Queuing response >Thread-22::INFO::2014-10-29 11:14:48,308::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010863616', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:14:48,311::task::1191::Storage.TaskManager.Task::(prepare) Task=`c4e56eb6-5692-4dc1-9401-8899d2ae4af7`::finished: {'truesize': '6010863616', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:14:48,312::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4e56eb6-5692-4dc1-9401-8899d2ae4af7`::moving from state preparing -> state finished >Thread-22::DEBUG::2014-10-29 11:14:48,313::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-10-29 11:14:48,315::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2014-10-29 11:14:48,316::task::993::Storage.TaskManager.Task::(_decref) Task=`c4e56eb6-5692-4dc1-9401-8899d2ae4af7`::ref 0 aborting False >Thread-136080::DEBUG::2014-10-29 11:14:48,320::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:48,343::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:48,345::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136081::DEBUG::2014-10-29 11:14:48,349::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136081::DEBUG::2014-10-29 11:14:48,352::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:14:48,395::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Detector thread::DEBUG::2014-10-29 11:14:49,405::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54226 >Detector thread::DEBUG::2014-10-29 11:14:49,406::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54226 >Detector thread::DEBUG::2014-10-29 11:14:49,407::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54226 >Detector thread::DEBUG::2014-10-29 11:14:49,407::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54226) >Thread-136082::DEBUG::2014-10-29 11:14:49,446::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136082::DEBUG::2014-10-29 11:14:49,447::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136082::DEBUG::2014-10-29 11:14:49,448::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.57', 'elapsedTime': '513921', 'displayType': 'vnc', 'cpuSys': '0.38', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '94300220', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '78828', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '31871.91'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.77', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:49,804::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:49,805::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:49,808::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:14:50,960::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54228 >Detector thread::DEBUG::2014-10-29 11:14:50,960::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54228 >Detector thread::DEBUG::2014-10-29 11:14:50,961::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54228 >Detector thread::DEBUG::2014-10-29 11:14:50,961::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54228) >Thread-136083::DEBUG::2014-10-29 11:14:51,000::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136083::DEBUG::2014-10-29 11:14:51,002::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136083::DEBUG::2014-10-29 11:14:51,023::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136083::DEBUG::2014-10-29 11:14:51,071::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '34', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '34', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:14:51,110::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54229 >Detector thread::DEBUG::2014-10-29 11:14:51,110::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54229 >Detector thread::DEBUG::2014-10-29 11:14:51,111::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54229 >Detector thread::DEBUG::2014-10-29 11:14:51,111::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54229) >Thread-136084::DEBUG::2014-10-29 11:14:51,151::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ed0ad40-e8cf-48c6-8790-e86301fd2754`::moving from state init -> state preparing >Thread-136084::INFO::2014-10-29 11:14:51,151::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136084::INFO::2014-10-29 11:14:51,152::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638617', 'lastCheck': '9.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000645512', 'lastCheck': '9.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00226479', 'lastCheck': '9.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000728737', 'lastCheck': '9.2', 'valid': True}} >Thread-136084::DEBUG::2014-10-29 11:14:51,152::task::1191::Storage.TaskManager.Task::(prepare) Task=`9ed0ad40-e8cf-48c6-8790-e86301fd2754`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638617', 'lastCheck': '9.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000645512', 'lastCheck': '9.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00226479', 'lastCheck': '9.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000728737', 'lastCheck': '9.2', 'valid': True}} >Thread-136084::DEBUG::2014-10-29 11:14:51,153::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ed0ad40-e8cf-48c6-8790-e86301fd2754`::moving from state preparing -> state finished >Thread-136084::DEBUG::2014-10-29 11:14:51,153::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136084::DEBUG::2014-10-29 11:14:51,153::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136084::DEBUG::2014-10-29 11:14:51,153::task::993::Storage.TaskManager.Task::(_decref) Task=`9ed0ad40-e8cf-48c6-8790-e86301fd2754`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:51,408::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:51,411::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136085::DEBUG::2014-10-29 11:14:51,415::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:51,417::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:51,420::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136086::DEBUG::2014-10-29 11:14:51,423::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136086::DEBUG::2014-10-29 11:14:51,425::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:14:51,980::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:51,980::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:51,980::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:51,981::__init__::232::IOProcess::(_processLogs) (200565) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:51,981::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200565) Queuing response >Thread-10269::DEBUG::2014-10-29 11:14:51,983::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:14:52,003::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000489661 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:14:52,005::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:52,006::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:52,006::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:52,006::__init__::232::IOProcess::(_processLogs) (200566) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:52,008::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200566) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:52,025::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:52,025::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:52,025::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:52,025::__init__::232::IOProcess::(_processLogs) (200567) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:52,027::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200567) Queuing response >Thread-179::DEBUG::2014-10-29 11:14:52,029::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:14:52,047::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000616367 s, 604 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:14:52,049::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:52,049::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:52,050::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:52,050::__init__::232::IOProcess::(_processLogs) (200568) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:52,050::__init__::232::IOProcess::(_processLogs) (200568) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:52,091::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:52,091::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:52,091::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:52,092::__init__::232::IOProcess::(_processLogs) (200569) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:52,093::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200569) Queuing response >Thread-33::DEBUG::2014-10-29 11:14:52,094::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:14:52,116::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000530776 s, 918 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:14:52,116::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:52,119::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:52,121::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:52,122::__init__::232::IOProcess::(_processLogs) (200570) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:52,123::__init__::232::IOProcess::(_processLogs) (200570) Queuing response >Thread-178::DEBUG::2014-10-29 11:14:52,123::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:14:52,124::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-178::DEBUG::2014-10-29 11:14:52,143::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000520438 s, 976 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:14:52,146::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:52,149::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:52,149::__init__::232::IOProcess::(_processLogs) (200571) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:52,149::__init__::232::IOProcess::(_processLogs) (200571) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:52,150::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:52,150::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:52,150::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:52,151::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:52,152::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:52,152::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:52,153::__init__::232::IOProcess::(_processLogs) (200572) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:14:52,153::__init__::232::IOProcess::(_processLogs) (200573) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:52,153::__init__::232::IOProcess::(_processLogs) (200573) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:52,153::__init__::232::IOProcess::(_processLogs) (200572) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:52,156::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:52,157::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:52,158::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:52,158::__init__::232::IOProcess::(_processLogs) (200574) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:52,159::__init__::232::IOProcess::(_processLogs) (200574) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:52,160::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:52,160::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:52,161::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:52,161::__init__::232::IOProcess::(_processLogs) (200575) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:52,161::__init__::232::IOProcess::(_processLogs) (200575) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:52,162::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:52,163::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:52,164::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:52,164::__init__::232::IOProcess::(_processLogs) (200576) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:52,165::__init__::232::IOProcess::(_processLogs) (200576) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:52,165::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:52,165::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:52,165::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:52,166::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200577) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:52,167::__init__::232::IOProcess::(_processLogs) (200577) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:52,168::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:52,168::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:52,168::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:52,168::__init__::232::IOProcess::(_processLogs) (200578) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:52,169::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200578) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:54,444::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:54,446::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136087::DEBUG::2014-10-29 11:14:54,450::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:54,452::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:54,454::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136088::DEBUG::2014-10-29 11:14:54,457::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136088::DEBUG::2014-10-29 11:14:54,459::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:54,814::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:54,815::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:54,817::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:14:56,189::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54231 >Detector thread::DEBUG::2014-10-29 11:14:56,192::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54231 >Detector thread::DEBUG::2014-10-29 11:14:56,193::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54231 >Detector thread::DEBUG::2014-10-29 11:14:56,195::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54231) >Thread-136089::DEBUG::2014-10-29 11:14:56,232::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136089::DEBUG::2014-10-29 11:14:56,233::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e7dbe89-f051-4042-b360-1e192880a89c`::moving from state init -> state preparing >Thread-136089::INFO::2014-10-29 11:14:56,233::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136089::DEBUG::2014-10-29 11:14:56,238::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:14:56,239::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:56,240::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-136089::DEBUG::2014-10-29 11:14:56,241::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:14:56,241::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-136089::DEBUG::2014-10-29 11:14:56,243::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-17::DEBUG::2014-10-29 11:14:56,244::__init__::232::IOProcess::(_processLogs) (200579) Got request for method 'glob' >Thread-136089::INFO::2014-10-29 11:14:56,244::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-17::DEBUG::2014-10-29 11:14:56,246::__init__::232::IOProcess::(_processLogs) (200579) Queuing response >Thread-136089::DEBUG::2014-10-29 11:14:56,246::task::1191::Storage.TaskManager.Task::(prepare) Task=`8e7dbe89-f051-4042-b360-1e192880a89c`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136089::DEBUG::2014-10-29 11:14:56,247::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e7dbe89-f051-4042-b360-1e192880a89c`::moving from state preparing -> state finished >Thread-136089::DEBUG::2014-10-29 11:14:56,248::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136089::DEBUG::2014-10-29 11:14:56,248::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136089::DEBUG::2014-10-29 11:14:56,248::task::993::Storage.TaskManager.Task::(_decref) Task=`8e7dbe89-f051-4042-b360-1e192880a89c`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:14:56,296::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54232 >Detector thread::DEBUG::2014-10-29 11:14:56,297::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54232 >Detector thread::DEBUG::2014-10-29 11:14:56,297::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54232 >Detector thread::DEBUG::2014-10-29 11:14:56,297::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54232) >Thread-136090::DEBUG::2014-10-29 11:14:56,336::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136090::DEBUG::2014-10-29 11:14:56,337::task::595::Storage.TaskManager.Task::(_updateState) Task=`f603d227-88c1-4815-b0a8-d77a3436585c`::moving from state init -> state preparing >Thread-136090::INFO::2014-10-29 11:14:56,337::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136090::DEBUG::2014-10-29 11:14:56,337::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136090::DEBUG::2014-10-29 11:14:56,338::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136090::DEBUG::2014-10-29 11:14:56,338::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136090::DEBUG::2014-10-29 11:14:56,338::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136090::DEBUG::2014-10-29 11:14:56,338::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136090::DEBUG::2014-10-29 11:14:56,339::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136090::DEBUG::2014-10-29 11:14:56,432::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136090::DEBUG::2014-10-29 11:14:56,433::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136090::DEBUG::2014-10-29 11:14:56,613::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136090::DEBUG::2014-10-29 11:14:56,614::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136090::DEBUG::2014-10-29 11:14:56,614::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136090::DEBUG::2014-10-29 11:14:56,615::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136090::DEBUG::2014-10-29 11:14:56,615::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136090::DEBUG::2014-10-29 11:14:56,615::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136090::DEBUG::2014-10-29 11:14:56,616::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136090::DEBUG::2014-10-29 11:14:56,616::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:14:56,621::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:56,621::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:56,623::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:56,627::__init__::232::IOProcess::(_processLogs) (200580) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:56,629::__init__::232::IOProcess::(_processLogs) (200580) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:56,630::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:56,630::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:56,630::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:56,630::__init__::232::IOProcess::(_processLogs) (200581) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:56,631::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200581) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:56,631::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:56,631::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:56,631::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:56,632::__init__::232::IOProcess::(_processLogs) (200582) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:56,632::__init__::232::IOProcess::(_processLogs) (200582) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:56,632::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:56,633::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:56,633::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:56,633::__init__::232::IOProcess::(_processLogs) (200583) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:14:56,634::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200583) Queuing response >Thread-136090::DEBUG::2014-10-29 11:14:56,641::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:14:56,643::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:56,643::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:56,643::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:56,643::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200584) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:14:56,644::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200584) Queuing response >Thread-136090::DEBUG::2014-10-29 11:14:56,645::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:14:56,646::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:56,646::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:56,646::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:56,646::__init__::232::IOProcess::(_processLogs) (200585) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:14:56,647::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200585) Queuing response >Thread-136090::DEBUG::2014-10-29 11:14:56,648::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:14:56,650::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:56,650::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:56,650::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:56,650::__init__::232::IOProcess::(_processLogs) (200586) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:14:56,651::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200586) Queuing response >Thread-17::DEBUG::2014-10-29 11:14:56,652::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:56,652::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:56,653::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:56,653::__init__::232::IOProcess::(_processLogs) (200587) Got request for method 'glob' >Thread-136090::DEBUG::2014-10-29 11:14:56,654::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:14:56,654::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200587) Queuing response >Thread-136090::INFO::2014-10-29 11:14:56,655::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136090::INFO::2014-10-29 11:14:56,656::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136090::INFO::2014-10-29 11:14:56,656::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:14:56,657::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:14:56,657::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:14:56,657::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:14:56,658::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200588) Got request for method 'readfile' >Thread-136090::DEBUG::2014-10-29 11:14:56,658::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:14:56,659::__init__::232::IOProcess::(_processLogs) (200588) Queuing response >Thread-136090::DEBUG::2014-10-29 11:14:56,662::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`0d91ba77-0382-486b-81b0-f54ecadf8241`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136090::DEBUG::2014-10-29 11:14:56,662::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136090::DEBUG::2014-10-29 11:14:56,663::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136090::DEBUG::2014-10-29 11:14:56,663::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`0d91ba77-0382-486b-81b0-f54ecadf8241`::Granted request >Thread-136090::DEBUG::2014-10-29 11:14:56,664::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f603d227-88c1-4815-b0a8-d77a3436585c`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136090::DEBUG::2014-10-29 11:14:56,664::task::993::Storage.TaskManager.Task::(_decref) Task=`f603d227-88c1-4815-b0a8-d77a3436585c`::ref 1 aborting False >Thread-136090::INFO::2014-10-29 11:14:56,667::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136090::DEBUG::2014-10-29 11:14:56,667::task::1191::Storage.TaskManager.Task::(prepare) Task=`f603d227-88c1-4815-b0a8-d77a3436585c`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136090::DEBUG::2014-10-29 11:14:56,667::task::595::Storage.TaskManager.Task::(_updateState) Task=`f603d227-88c1-4815-b0a8-d77a3436585c`::moving from state preparing -> state finished >Thread-136090::DEBUG::2014-10-29 11:14:56,667::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136090::DEBUG::2014-10-29 11:14:56,668::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136090::DEBUG::2014-10-29 11:14:56,668::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136090::DEBUG::2014-10-29 11:14:56,668::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136090::DEBUG::2014-10-29 11:14:56,669::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136090::DEBUG::2014-10-29 11:14:56,669::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136090::DEBUG::2014-10-29 11:14:56,669::task::993::Storage.TaskManager.Task::(_decref) Task=`f603d227-88c1-4815-b0a8-d77a3436585c`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:14:56,692::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54233 >Detector thread::DEBUG::2014-10-29 11:14:56,693::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54233 >Detector thread::DEBUG::2014-10-29 11:14:56,693::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54233 >Detector thread::DEBUG::2014-10-29 11:14:56,694::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54233) >Thread-136095::DEBUG::2014-10-29 11:14:56,733::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136095::DEBUG::2014-10-29 11:14:56,734::task::595::Storage.TaskManager.Task::(_updateState) Task=`48095aa5-1c14-4702-a7c2-e1df0a8c52d2`::moving from state init -> state preparing >Thread-136095::INFO::2014-10-29 11:14:56,734::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136095::INFO::2014-10-29 11:14:56,735::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520438', 'lastCheck': '4.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000530776', 'lastCheck': '4.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616367', 'lastCheck': '4.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000489661', 'lastCheck': '4.7', 'valid': True}} >Thread-136095::DEBUG::2014-10-29 11:14:56,735::task::1191::Storage.TaskManager.Task::(prepare) Task=`48095aa5-1c14-4702-a7c2-e1df0a8c52d2`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520438', 'lastCheck': '4.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000530776', 'lastCheck': '4.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616367', 'lastCheck': '4.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000489661', 'lastCheck': '4.7', 'valid': True}} >Thread-136095::DEBUG::2014-10-29 11:14:56,735::task::595::Storage.TaskManager.Task::(_updateState) Task=`48095aa5-1c14-4702-a7c2-e1df0a8c52d2`::moving from state preparing -> state finished >Thread-136095::DEBUG::2014-10-29 11:14:56,735::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136095::DEBUG::2014-10-29 11:14:56,736::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136095::DEBUG::2014-10-29 11:14:56,736::task::993::Storage.TaskManager.Task::(_decref) Task=`48095aa5-1c14-4702-a7c2-e1df0a8c52d2`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:57,474::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:57,477::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136096::DEBUG::2014-10-29 11:14:57,480::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:14:57,482::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:14:57,484::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136097::DEBUG::2014-10-29 11:14:57,488::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136097::DEBUG::2014-10-29 11:14:57,490::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:14:59,598::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54234 >Detector thread::DEBUG::2014-10-29 11:14:59,599::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54234 >Detector thread::DEBUG::2014-10-29 11:14:59,599::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54234 >Detector thread::DEBUG::2014-10-29 11:14:59,600::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54234) >Thread-136098::DEBUG::2014-10-29 11:14:59,638::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136098::DEBUG::2014-10-29 11:14:59,639::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136098::DEBUG::2014-10-29 11:14:59,640::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.57', 'elapsedTime': '513932', 'displayType': 'vnc', 'cpuSys': '0.38', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '94300220', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '78828', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '31871.91'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.24', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:59,825::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:59,826::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:14:59,830::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:00,504::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:00,506::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136099::DEBUG::2014-10-29 11:15:00,509::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:00,512::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:00,513::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136100::DEBUG::2014-10-29 11:15:00,516::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136100::DEBUG::2014-10-29 11:15:00,518::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:15:01,123::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54236 >Detector thread::DEBUG::2014-10-29 11:15:01,124::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54236 >Detector thread::DEBUG::2014-10-29 11:15:01,124::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54236 >Detector thread::DEBUG::2014-10-29 11:15:01,125::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54236) >Thread-136101::DEBUG::2014-10-29 11:15:01,164::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136101::DEBUG::2014-10-29 11:15:01,165::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136101::DEBUG::2014-10-29 11:15:01,184::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Detector thread::DEBUG::2014-10-29 11:15:01,211::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54237 >Detector thread::DEBUG::2014-10-29 11:15:01,214::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54237 >Detector thread::DEBUG::2014-10-29 11:15:01,216::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54237 >Detector thread::DEBUG::2014-10-29 11:15:01,219::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54237) >Thread-136101::DEBUG::2014-10-29 11:15:01,244::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '17', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '17', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-136102::DEBUG::2014-10-29 11:15:01,258::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e7b350c-785c-482e-a27c-fad75bf465eb`::moving from state init -> state preparing >Thread-136102::INFO::2014-10-29 11:15:01,258::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136102::INFO::2014-10-29 11:15:01,259::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520438', 'lastCheck': '9.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000530776', 'lastCheck': '9.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616367', 'lastCheck': '9.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000489661', 'lastCheck': '9.2', 'valid': True}} >Thread-136102::DEBUG::2014-10-29 11:15:01,259::task::1191::Storage.TaskManager.Task::(prepare) Task=`3e7b350c-785c-482e-a27c-fad75bf465eb`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520438', 'lastCheck': '9.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000530776', 'lastCheck': '9.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616367', 'lastCheck': '9.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000489661', 'lastCheck': '9.2', 'valid': True}} >Thread-136102::DEBUG::2014-10-29 11:15:01,260::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e7b350c-785c-482e-a27c-fad75bf465eb`::moving from state preparing -> state finished >Thread-136102::DEBUG::2014-10-29 11:15:01,260::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136102::DEBUG::2014-10-29 11:15:01,260::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136102::DEBUG::2014-10-29 11:15:01,260::task::993::Storage.TaskManager.Task::(_decref) Task=`3e7b350c-785c-482e-a27c-fad75bf465eb`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:15:02,011::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:02,012::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:02,012::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:02,012::__init__::232::IOProcess::(_processLogs) (200589) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:02,013::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200589) Queuing response >Thread-10269::DEBUG::2014-10-29 11:15:02,014::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:15:02,032::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.0004347 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:15:02,034::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:02,034::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:02,034::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:02,035::__init__::232::IOProcess::(_processLogs) (200590) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:02,035::__init__::232::IOProcess::(_processLogs) (200590) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:02,054::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:02,056::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:02,057::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:02,058::__init__::232::IOProcess::(_processLogs) (200591) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:02,059::__init__::232::IOProcess::(_processLogs) (200591) Queuing response >Thread-179::DEBUG::2014-10-29 11:15:02,058::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:15:02,077::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000420648 s, 884 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:15:02,079::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:02,080::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:02,080::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:02,082::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200592) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:02,083::__init__::232::IOProcess::(_processLogs) (200592) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:02,165::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:02,165::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:02,166::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-33::DEBUG::2014-10-29 11:15:02,168::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:15:02,168::__init__::232::IOProcess::(_processLogs) (200593) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:02,190::__init__::232::IOProcess::(_processLogs) (200593) Queuing response >Thread-33::DEBUG::2014-10-29 11:15:02,192::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000723696 s, 673 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:15:02,195::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:02,195::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:02,196::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:02,196::__init__::232::IOProcess::(_processLogs) (200594) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:02,199::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200594) Queuing response >Thread-178::DEBUG::2014-10-29 11:15:02,200::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:15:02,216::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:02,217::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:02,217::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:02,218::__init__::232::IOProcess::(_processLogs) (200595) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:02,220::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200595) Queuing response >Thread-178::DEBUG::2014-10-29 11:15:02,223::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00335649 s, 151 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:15:02,226::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:02,226::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:02,226::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:02,226::__init__::232::IOProcess::(_processLogs) (200596) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:02,227::__init__::232::IOProcess::(_processLogs) (200596) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:02,228::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:02,229::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:02,229::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:02,229::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:02,230::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:02,231::__init__::232::IOProcess::(_processLogs) (200597) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:02,232::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:02,232::__init__::232::IOProcess::(_processLogs) (200598) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:02,232::__init__::232::IOProcess::(_processLogs) (200598) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:02,232::__init__::232::IOProcess::(_processLogs) (200597) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:02,236::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:02,236::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:02,236::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:02,236::__init__::232::IOProcess::(_processLogs) (200599) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:02,237::__init__::232::IOProcess::(_processLogs) (200599) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:02,239::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:02,242::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:02,242::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:02,243::__init__::232::IOProcess::(_processLogs) (200600) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:02,243::__init__::232::IOProcess::(_processLogs) (200600) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:02,253::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:02,254::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:02,255::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:02,256::__init__::232::IOProcess::(_processLogs) (200601) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:02,259::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200601) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:02,262::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:02,263::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:02,265::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:02,266::__init__::232::IOProcess::(_processLogs) (200602) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:02,267::__init__::232::IOProcess::(_processLogs) (200602) Queuing response >Thread-22::DEBUG::2014-10-29 11:15:03,418::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:03,532::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:03,534::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136103::DEBUG::2014-10-29 11:15:03,538::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c049833-0c77-4447-bce6-f08a18c49522`::moving from state init -> state preparing >Thread-136103::INFO::2014-10-29 11:15:03,539::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136103::INFO::2014-10-29 11:15:03,539::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00335649', 'lastCheck': '1.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000723696', 'lastCheck': '1.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000420648', 'lastCheck': '1.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0004347', 'lastCheck': '1.5', 'valid': True}} >Thread-136103::DEBUG::2014-10-29 11:15:03,540::task::1191::Storage.TaskManager.Task::(prepare) Task=`4c049833-0c77-4447-bce6-f08a18c49522`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00335649', 'lastCheck': '1.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000723696', 'lastCheck': '1.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000420648', 'lastCheck': '1.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0004347', 'lastCheck': '1.5', 'valid': True}} >Thread-136103::DEBUG::2014-10-29 11:15:03,540::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c049833-0c77-4447-bce6-f08a18c49522`::moving from state preparing -> state finished >Thread-136103::DEBUG::2014-10-29 11:15:03,540::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136103::DEBUG::2014-10-29 11:15:03,540::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136103::DEBUG::2014-10-29 11:15:03,541::task::993::Storage.TaskManager.Task::(_decref) Task=`4c049833-0c77-4447-bce6-f08a18c49522`::ref 0 aborting False >Thread-136103::DEBUG::2014-10-29 11:15:03,561::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:03,584::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:03,586::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136104::DEBUG::2014-10-29 11:15:03,589::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136104::DEBUG::2014-10-29 11:15:03,591::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:15:03,740::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:04,836::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:04,838::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:04,839::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:06,636::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:06,650::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136105::DEBUG::2014-10-29 11:15:06,657::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:06,661::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:06,663::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136106::DEBUG::2014-10-29 11:15:06,667::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136106::DEBUG::2014-10-29 11:15:06,669::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:15:07,338::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54239 >Detector thread::DEBUG::2014-10-29 11:15:07,340::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54239 >Detector thread::DEBUG::2014-10-29 11:15:07,340::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54239 >Detector thread::DEBUG::2014-10-29 11:15:07,341::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54239) >Thread-136107::DEBUG::2014-10-29 11:15:07,379::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136107::DEBUG::2014-10-29 11:15:07,380::task::595::Storage.TaskManager.Task::(_updateState) Task=`620cab99-380c-4fe9-8ec1-250cc0f6ca10`::moving from state init -> state preparing >Thread-136107::INFO::2014-10-29 11:15:07,380::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136107::DEBUG::2014-10-29 11:15:07,385::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:15:07,386::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:07,386::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:07,387::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:07,387::__init__::232::IOProcess::(_processLogs) (200603) Got request for method 'glob' >Thread-136107::DEBUG::2014-10-29 11:15:07,388::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:15:07,388::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200603) Queuing response >Thread-136107::DEBUG::2014-10-29 11:15:07,390::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136107::INFO::2014-10-29 11:15:07,391::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136107::DEBUG::2014-10-29 11:15:07,391::task::1191::Storage.TaskManager.Task::(prepare) Task=`620cab99-380c-4fe9-8ec1-250cc0f6ca10`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136107::DEBUG::2014-10-29 11:15:07,391::task::595::Storage.TaskManager.Task::(_updateState) Task=`620cab99-380c-4fe9-8ec1-250cc0f6ca10`::moving from state preparing -> state finished >Thread-136107::DEBUG::2014-10-29 11:15:07,391::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136107::DEBUG::2014-10-29 11:15:07,392::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136107::DEBUG::2014-10-29 11:15:07,392::task::993::Storage.TaskManager.Task::(_decref) Task=`620cab99-380c-4fe9-8ec1-250cc0f6ca10`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:15:07,435::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54240 >Detector thread::DEBUG::2014-10-29 11:15:07,436::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54240 >Detector thread::DEBUG::2014-10-29 11:15:07,436::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54240 >Detector thread::DEBUG::2014-10-29 11:15:07,437::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54240) >Thread-136108::DEBUG::2014-10-29 11:15:07,475::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136108::DEBUG::2014-10-29 11:15:07,476::task::595::Storage.TaskManager.Task::(_updateState) Task=`bfcb2a61-10cc-4869-8700-02723048e949`::moving from state init -> state preparing >Thread-136108::INFO::2014-10-29 11:15:07,476::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136108::DEBUG::2014-10-29 11:15:07,477::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136108::DEBUG::2014-10-29 11:15:07,477::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136108::DEBUG::2014-10-29 11:15:07,477::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136108::DEBUG::2014-10-29 11:15:07,477::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136108::DEBUG::2014-10-29 11:15:07,478::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136108::DEBUG::2014-10-29 11:15:07,478::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136108::DEBUG::2014-10-29 11:15:07,568::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136108::DEBUG::2014-10-29 11:15:07,569::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136108::DEBUG::2014-10-29 11:15:07,801::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136108::DEBUG::2014-10-29 11:15:07,803::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136108::DEBUG::2014-10-29 11:15:07,803::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136108::DEBUG::2014-10-29 11:15:07,804::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136108::DEBUG::2014-10-29 11:15:07,804::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136108::DEBUG::2014-10-29 11:15:07,805::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136108::DEBUG::2014-10-29 11:15:07,805::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136108::DEBUG::2014-10-29 11:15:07,805::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:15:07,813::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:07,815::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:07,815::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:07,815::__init__::232::IOProcess::(_processLogs) (200604) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:15:07,816::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200604) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:07,818::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:07,819::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:07,819::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:07,819::__init__::232::IOProcess::(_processLogs) (200605) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:15:07,819::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:07,820::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:07,820::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:07,820::__init__::232::IOProcess::(_processLogs) (200606) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:15:07,820::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:07,821::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:07,821::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:07,821::__init__::232::IOProcess::(_processLogs) (200607) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:15:07,822::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200605) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:07,823::__init__::232::IOProcess::(_processLogs) (200606) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:07,824::__init__::232::IOProcess::(_processLogs) (200607) Queuing response >Thread-136108::DEBUG::2014-10-29 11:15:07,842::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:15:07,843::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:07,843::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:07,843::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:07,844::__init__::232::IOProcess::(_processLogs) (200608) Got request for method 'touch' >Thread-136108::DEBUG::2014-10-29 11:15:07,846::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:15:07,845::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200608) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:07,848::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:07,848::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:07,849::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:07,849::__init__::232::IOProcess::(_processLogs) (200609) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:15:07,850::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200609) Queuing response >Thread-136108::DEBUG::2014-10-29 11:15:07,850::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:15:07,853::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:07,853::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:07,854::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:07,854::__init__::232::IOProcess::(_processLogs) (200610) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:07,855::__init__::232::IOProcess::(_processLogs) (200610) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:07,855::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:07,855::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:07,856::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:07,856::__init__::232::IOProcess::(_processLogs) (200611) Got request for method 'glob' >Thread-136108::DEBUG::2014-10-29 11:15:07,857::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:15:07,857::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200611) Queuing response >Thread-136108::INFO::2014-10-29 11:15:07,858::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136108::INFO::2014-10-29 11:15:07,859::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136108::INFO::2014-10-29 11:15:07,859::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:15:07,860::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:07,860::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:07,860::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:07,861::__init__::232::IOProcess::(_processLogs) (200612) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:15:07,861::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200612) Queuing response >Thread-136108::DEBUG::2014-10-29 11:15:07,862::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136108::DEBUG::2014-10-29 11:15:07,864::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`620176f4-cc62-4168-9cb9-7bd27ca236af`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136108::DEBUG::2014-10-29 11:15:07,864::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136108::DEBUG::2014-10-29 11:15:07,865::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136108::DEBUG::2014-10-29 11:15:07,865::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`620176f4-cc62-4168-9cb9-7bd27ca236af`::Granted request >Thread-136108::DEBUG::2014-10-29 11:15:07,866::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bfcb2a61-10cc-4869-8700-02723048e949`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136108::DEBUG::2014-10-29 11:15:07,866::task::993::Storage.TaskManager.Task::(_decref) Task=`bfcb2a61-10cc-4869-8700-02723048e949`::ref 1 aborting False >Thread-136108::INFO::2014-10-29 11:15:07,869::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136108::DEBUG::2014-10-29 11:15:07,869::task::1191::Storage.TaskManager.Task::(prepare) Task=`bfcb2a61-10cc-4869-8700-02723048e949`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136108::DEBUG::2014-10-29 11:15:07,869::task::595::Storage.TaskManager.Task::(_updateState) Task=`bfcb2a61-10cc-4869-8700-02723048e949`::moving from state preparing -> state finished >Thread-136108::DEBUG::2014-10-29 11:15:07,869::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136108::DEBUG::2014-10-29 11:15:07,870::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136108::DEBUG::2014-10-29 11:15:07,870::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136108::DEBUG::2014-10-29 11:15:07,870::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136108::DEBUG::2014-10-29 11:15:07,871::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136108::DEBUG::2014-10-29 11:15:07,871::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136108::DEBUG::2014-10-29 11:15:07,871::task::993::Storage.TaskManager.Task::(_decref) Task=`bfcb2a61-10cc-4869-8700-02723048e949`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:15:07,899::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54241 >Detector thread::DEBUG::2014-10-29 11:15:07,900::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54241 >Detector thread::DEBUG::2014-10-29 11:15:07,900::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54241 >Detector thread::DEBUG::2014-10-29 11:15:07,901::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54241) >Thread-136113::DEBUG::2014-10-29 11:15:07,939::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136113::DEBUG::2014-10-29 11:15:07,939::task::595::Storage.TaskManager.Task::(_updateState) Task=`59bc5633-09ff-4732-a5cd-a3378db5bc24`::moving from state init -> state preparing >Thread-136113::INFO::2014-10-29 11:15:07,940::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136113::INFO::2014-10-29 11:15:07,940::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00335649', 'lastCheck': '5.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000723696', 'lastCheck': '5.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000420648', 'lastCheck': '5.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0004347', 'lastCheck': '5.9', 'valid': True}} >Thread-136113::DEBUG::2014-10-29 11:15:07,941::task::1191::Storage.TaskManager.Task::(prepare) Task=`59bc5633-09ff-4732-a5cd-a3378db5bc24`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00335649', 'lastCheck': '5.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000723696', 'lastCheck': '5.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000420648', 'lastCheck': '5.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0004347', 'lastCheck': '5.9', 'valid': True}} >Thread-136113::DEBUG::2014-10-29 11:15:07,941::task::595::Storage.TaskManager.Task::(_updateState) Task=`59bc5633-09ff-4732-a5cd-a3378db5bc24`::moving from state preparing -> state finished >Thread-136113::DEBUG::2014-10-29 11:15:07,941::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136113::DEBUG::2014-10-29 11:15:07,941::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136113::DEBUG::2014-10-29 11:15:07,942::task::993::Storage.TaskManager.Task::(_decref) Task=`59bc5633-09ff-4732-a5cd-a3378db5bc24`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:09,709::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:09,714::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136114::DEBUG::2014-10-29 11:15:09,718::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:09,720::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:09,722::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136115::DEBUG::2014-10-29 11:15:09,725::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136115::DEBUG::2014-10-29 11:15:09,728::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:15:09,793::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54242 >Detector thread::DEBUG::2014-10-29 11:15:09,793::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54242 >Detector thread::DEBUG::2014-10-29 11:15:09,794::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54242 >Detector thread::DEBUG::2014-10-29 11:15:09,794::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54242) >Thread-136116::DEBUG::2014-10-29 11:15:09,833::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136116::DEBUG::2014-10-29 11:15:09,834::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136116::DEBUG::2014-10-29 11:15:09,835::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.33', 'elapsedTime': '513942', 'displayType': 'vnc', 'cpuSys': '1.06', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '94300220', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '78828', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '31871.91'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.41', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:09,845::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:09,847::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:09,849::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:15:10,305::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54244 >Detector thread::DEBUG::2014-10-29 11:15:10,306::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54244 >Detector thread::DEBUG::2014-10-29 11:15:10,306::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54244 >Detector thread::DEBUG::2014-10-29 11:15:10,306::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54244) >Detector thread::DEBUG::2014-10-29 11:15:10,335::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54245 >Detector thread::DEBUG::2014-10-29 11:15:10,336::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54245 >Detector thread::DEBUG::2014-10-29 11:15:10,336::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54245 >Detector thread::DEBUG::2014-10-29 11:15:10,337::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54245) >Thread-136117::DEBUG::2014-10-29 11:15:10,345::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136117::DEBUG::2014-10-29 11:15:10,347::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136117::DEBUG::2014-10-29 11:15:10,368::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136118::DEBUG::2014-10-29 11:15:10,379::task::595::Storage.TaskManager.Task::(_updateState) Task=`97451fa6-030b-4dd1-9be1-e90fddc2918d`::moving from state init -> state preparing >Thread-136118::INFO::2014-10-29 11:15:10,381::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136118::INFO::2014-10-29 11:15:10,386::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00335649', 'lastCheck': '8.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000723696', 'lastCheck': '8.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000420648', 'lastCheck': '8.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0004347', 'lastCheck': '8.3', 'valid': True}} >Thread-136118::DEBUG::2014-10-29 11:15:10,388::task::1191::Storage.TaskManager.Task::(prepare) Task=`97451fa6-030b-4dd1-9be1-e90fddc2918d`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00335649', 'lastCheck': '8.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000723696', 'lastCheck': '8.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000420648', 'lastCheck': '8.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0004347', 'lastCheck': '8.3', 'valid': True}} >Thread-136118::DEBUG::2014-10-29 11:15:10,390::task::595::Storage.TaskManager.Task::(_updateState) Task=`97451fa6-030b-4dd1-9be1-e90fddc2918d`::moving from state preparing -> state finished >Thread-136118::DEBUG::2014-10-29 11:15:10,391::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136118::DEBUG::2014-10-29 11:15:10,393::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136118::DEBUG::2014-10-29 11:15:10,395::task::993::Storage.TaskManager.Task::(_decref) Task=`97451fa6-030b-4dd1-9be1-e90fddc2918d`::ref 0 aborting False >Thread-136117::DEBUG::2014-10-29 11:15:10,443::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '97', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '97', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-17::DEBUG::2014-10-29 11:15:12,038::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:12,039::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:12,039::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:12,039::__init__::232::IOProcess::(_processLogs) (200613) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:12,041::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200613) Queuing response >Thread-10269::DEBUG::2014-10-29 11:15:12,043::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:15:12,059::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000499662 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:15:12,061::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:12,063::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:12,065::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:12,065::__init__::232::IOProcess::(_processLogs) (200614) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:12,066::__init__::232::IOProcess::(_processLogs) (200614) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:12,096::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:12,097::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:12,097::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:12,097::__init__::232::IOProcess::(_processLogs) (200615) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:12,099::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200615) Queuing response >Thread-179::DEBUG::2014-10-29 11:15:12,100::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:15:12,118::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000491602 s, 757 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:15:12,120::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:12,121::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:12,121::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:12,121::__init__::232::IOProcess::(_processLogs) (200616) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:12,123::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200616) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:12,242::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:12,242::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:12,243::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:12,243::__init__::232::IOProcess::(_processLogs) (200617) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:12,244::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200617) Queuing response >Thread-33::DEBUG::2014-10-29 11:15:12,246::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:15:12,263::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000517629 s, 941 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:15:12,265::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:12,265::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:12,266::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:12,266::__init__::232::IOProcess::(_processLogs) (200618) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:12,267::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200618) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:12,270::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:12,272::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:12,272::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:12,272::__init__::232::IOProcess::(_processLogs) (200619) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:12,273::__init__::232::IOProcess::(_processLogs) (200619) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:12,273::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:12,273::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:12,274::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:12,274::__init__::232::IOProcess::(_processLogs) (200620) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:12,274::__init__::232::IOProcess::(_processLogs) (200620) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:12,278::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-178::DEBUG::2014-10-29 11:15:12,278::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:15:12,280::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-178::DEBUG::2014-10-29 11:15:12,303::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.0036375 s, 140 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:15:12,318::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:12,320::__init__::232::IOProcess::(_processLogs) (200621) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:12,322::__init__::232::IOProcess::(_processLogs) (200621) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:12,324::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:12,324::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:12,325::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:12,325::__init__::232::IOProcess::(_processLogs) (200622) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:12,327::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200622) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:12,331::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:12,332::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:12,333::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:12,335::__init__::232::IOProcess::(_processLogs) (200623) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:12,336::__init__::232::IOProcess::(_processLogs) (200623) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:12,342::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:12,343::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:12,343::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:12,343::__init__::232::IOProcess::(_processLogs) (200624) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:12,344::__init__::232::IOProcess::(_processLogs) (200624) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:12,345::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:12,345::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:12,345::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:12,346::__init__::232::IOProcess::(_processLogs) (200625) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:12,346::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200625) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:12,348::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:12,349::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:12,349::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:12,351::__init__::232::IOProcess::(_processLogs) (200626) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:12,351::__init__::232::IOProcess::(_processLogs) (200626) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:12,743::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:12,746::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136119::DEBUG::2014-10-29 11:15:12,750::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:12,752::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:12,753::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136120::DEBUG::2014-10-29 11:15:12,757::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136120::DEBUG::2014-10-29 11:15:12,759::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:14,852::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:14,854::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:14,856::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:15,774::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:15,777::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136121::DEBUG::2014-10-29 11:15:15,780::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:15,782::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:15,784::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136122::DEBUG::2014-10-29 11:15:15,787::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136122::DEBUG::2014-10-29 11:15:15,790::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:15:18,456::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Detector thread::DEBUG::2014-10-29 11:15:18,510::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54247 >Detector thread::DEBUG::2014-10-29 11:15:18,511::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54247 >Detector thread::DEBUG::2014-10-29 11:15:18,511::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54247 >Detector thread::DEBUG::2014-10-29 11:15:18,512::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54247) >Thread-136123::DEBUG::2014-10-29 11:15:18,551::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136123::DEBUG::2014-10-29 11:15:18,552::task::595::Storage.TaskManager.Task::(_updateState) Task=`101fb655-4f0a-4c9f-9251-8520b5417de0`::moving from state init -> state preparing >Thread-136123::INFO::2014-10-29 11:15:18,552::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136123::DEBUG::2014-10-29 11:15:18,555::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:15:18,556::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:18,556::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:18,556::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:18,557::__init__::232::IOProcess::(_processLogs) (200627) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:15:18,558::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200627) Queuing response >Thread-136123::DEBUG::2014-10-29 11:15:18,559::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136123::DEBUG::2014-10-29 11:15:18,559::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136123::INFO::2014-10-29 11:15:18,560::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136123::DEBUG::2014-10-29 11:15:18,560::task::1191::Storage.TaskManager.Task::(prepare) Task=`101fb655-4f0a-4c9f-9251-8520b5417de0`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136123::DEBUG::2014-10-29 11:15:18,560::task::595::Storage.TaskManager.Task::(_updateState) Task=`101fb655-4f0a-4c9f-9251-8520b5417de0`::moving from state preparing -> state finished >Thread-136123::DEBUG::2014-10-29 11:15:18,560::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136123::DEBUG::2014-10-29 11:15:18,561::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136123::DEBUG::2014-10-29 11:15:18,561::task::993::Storage.TaskManager.Task::(_decref) Task=`101fb655-4f0a-4c9f-9251-8520b5417de0`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:15:18,604::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54248 >Detector thread::DEBUG::2014-10-29 11:15:18,605::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54248 >Detector thread::DEBUG::2014-10-29 11:15:18,605::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54248 >Detector thread::DEBUG::2014-10-29 11:15:18,606::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54248) >Thread-136124::DEBUG::2014-10-29 11:15:18,645::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136124::DEBUG::2014-10-29 11:15:18,646::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1e268d4-aa04-439f-909f-24ff97dc5ad7`::moving from state init -> state preparing >Thread-136124::INFO::2014-10-29 11:15:18,646::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136124::DEBUG::2014-10-29 11:15:18,646::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136124::DEBUG::2014-10-29 11:15:18,647::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136124::DEBUG::2014-10-29 11:15:18,647::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136124::DEBUG::2014-10-29 11:15:18,647::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136124::DEBUG::2014-10-29 11:15:18,648::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136124::DEBUG::2014-10-29 11:15:18,648::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136124::DEBUG::2014-10-29 11:15:18,728::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136124::DEBUG::2014-10-29 11:15:18,729::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:18,804::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:18,807::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136125::DEBUG::2014-10-29 11:15:18,812::task::595::Storage.TaskManager.Task::(_updateState) Task=`83fcfff6-47bf-4a7b-9341-4d83f44a79b5`::moving from state init -> state preparing >Thread-136125::INFO::2014-10-29 11:15:18,813::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136125::INFO::2014-10-29 11:15:18,813::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0036375', 'lastCheck': '6.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517629', 'lastCheck': '6.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491602', 'lastCheck': '6.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000499662', 'lastCheck': '6.7', 'valid': True}} >Thread-136125::DEBUG::2014-10-29 11:15:18,814::task::1191::Storage.TaskManager.Task::(prepare) Task=`83fcfff6-47bf-4a7b-9341-4d83f44a79b5`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0036375', 'lastCheck': '6.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517629', 'lastCheck': '6.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491602', 'lastCheck': '6.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000499662', 'lastCheck': '6.7', 'valid': True}} >Thread-136125::DEBUG::2014-10-29 11:15:18,814::task::595::Storage.TaskManager.Task::(_updateState) Task=`83fcfff6-47bf-4a7b-9341-4d83f44a79b5`::moving from state preparing -> state finished >Thread-136125::DEBUG::2014-10-29 11:15:18,814::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136125::DEBUG::2014-10-29 11:15:18,815::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136125::DEBUG::2014-10-29 11:15:18,815::task::993::Storage.TaskManager.Task::(_decref) Task=`83fcfff6-47bf-4a7b-9341-4d83f44a79b5`::ref 0 aborting False >Thread-136125::DEBUG::2014-10-29 11:15:18,842::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:18,867::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:18,869::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136126::DEBUG::2014-10-29 11:15:18,880::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136126::DEBUG::2014-10-29 11:15:18,882::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-136124::DEBUG::2014-10-29 11:15:18,902::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136124::DEBUG::2014-10-29 11:15:18,903::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136124::DEBUG::2014-10-29 11:15:18,904::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136124::DEBUG::2014-10-29 11:15:18,904::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136124::DEBUG::2014-10-29 11:15:18,905::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136124::DEBUG::2014-10-29 11:15:18,905::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136124::DEBUG::2014-10-29 11:15:18,905::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136124::DEBUG::2014-10-29 11:15:18,906::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:15:18,910::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:18,914::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:18,918::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:18,920::__init__::232::IOProcess::(_processLogs) (200628) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:15:18,922::__init__::232::IOProcess::(_processLogs) (200628) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:18,926::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-136124::DEBUG::2014-10-29 11:15:18,929::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:15:18,929::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:18,931::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:18,931::__init__::232::IOProcess::(_processLogs) (200629) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:15:18,932::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200629) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:18,933::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:18,934::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:18,934::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:18,934::__init__::232::IOProcess::(_processLogs) (200630) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:15:18,935::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200630) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:18,936::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:18,936::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:18,936::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:18,936::__init__::232::IOProcess::(_processLogs) (200631) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:15:18,937::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200631) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:18,938::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:18,939::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:18,939::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:18,939::__init__::232::IOProcess::(_processLogs) (200632) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:15:18,940::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200632) Queuing response >Thread-136124::DEBUG::2014-10-29 11:15:18,941::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:15:18,942::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:18,942::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:18,943::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:18,943::__init__::232::IOProcess::(_processLogs) (200633) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:15:18,944::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200633) Queuing response >Thread-136124::DEBUG::2014-10-29 11:15:18,944::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:15:18,945::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:18,946::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:18,947::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:18,947::__init__::232::IOProcess::(_processLogs) (200634) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:18,947::__init__::232::IOProcess::(_processLogs) (200634) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:18,948::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:18,948::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:18,948::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:18,949::__init__::232::IOProcess::(_processLogs) (200635) Got request for method 'glob' >Thread-136124::DEBUG::2014-10-29 11:15:18,949::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:15:18,950::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200635) Queuing response >Thread-136124::INFO::2014-10-29 11:15:18,951::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136124::INFO::2014-10-29 11:15:18,951::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136124::INFO::2014-10-29 11:15:18,952::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:15:18,953::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:18,953::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:18,953::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:18,953::__init__::232::IOProcess::(_processLogs) (200636) Got request for method 'readfile' >Thread-136124::DEBUG::2014-10-29 11:15:18,954::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:15:18,954::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200636) Queuing response >Thread-136124::DEBUG::2014-10-29 11:15:18,957::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`db29b7d2-98de-412a-8658-840921e21c6f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136124::DEBUG::2014-10-29 11:15:18,957::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136124::DEBUG::2014-10-29 11:15:18,958::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136124::DEBUG::2014-10-29 11:15:18,958::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`db29b7d2-98de-412a-8658-840921e21c6f`::Granted request >Thread-136124::DEBUG::2014-10-29 11:15:18,959::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f1e268d4-aa04-439f-909f-24ff97dc5ad7`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136124::DEBUG::2014-10-29 11:15:18,959::task::993::Storage.TaskManager.Task::(_decref) Task=`f1e268d4-aa04-439f-909f-24ff97dc5ad7`::ref 1 aborting False >Thread-136124::INFO::2014-10-29 11:15:18,962::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136124::DEBUG::2014-10-29 11:15:18,962::task::1191::Storage.TaskManager.Task::(prepare) Task=`f1e268d4-aa04-439f-909f-24ff97dc5ad7`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136124::DEBUG::2014-10-29 11:15:18,962::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1e268d4-aa04-439f-909f-24ff97dc5ad7`::moving from state preparing -> state finished >Thread-136124::DEBUG::2014-10-29 11:15:18,962::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136124::DEBUG::2014-10-29 11:15:18,963::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136124::DEBUG::2014-10-29 11:15:18,963::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136124::DEBUG::2014-10-29 11:15:18,963::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136124::DEBUG::2014-10-29 11:15:18,964::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136124::DEBUG::2014-10-29 11:15:18,964::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136124::DEBUG::2014-10-29 11:15:18,964::task::993::Storage.TaskManager.Task::(_decref) Task=`f1e268d4-aa04-439f-909f-24ff97dc5ad7`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:15:18,984::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54249 >Detector thread::DEBUG::2014-10-29 11:15:18,985::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54249 >Detector thread::DEBUG::2014-10-29 11:15:18,985::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54249 >Detector thread::DEBUG::2014-10-29 11:15:18,985::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54249) >Thread-136131::DEBUG::2014-10-29 11:15:19,024::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136131::DEBUG::2014-10-29 11:15:19,024::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1e040e9-da5a-4a8f-8a27-d45d1ae7623d`::moving from state init -> state preparing >Thread-136131::INFO::2014-10-29 11:15:19,025::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136131::INFO::2014-10-29 11:15:19,025::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0036375', 'lastCheck': '6.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517629', 'lastCheck': '6.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491602', 'lastCheck': '6.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000499662', 'lastCheck': '7.0', 'valid': True}} >Thread-136131::DEBUG::2014-10-29 11:15:19,026::task::1191::Storage.TaskManager.Task::(prepare) Task=`b1e040e9-da5a-4a8f-8a27-d45d1ae7623d`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0036375', 'lastCheck': '6.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517629', 'lastCheck': '6.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491602', 'lastCheck': '6.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000499662', 'lastCheck': '7.0', 'valid': True}} >Thread-136131::DEBUG::2014-10-29 11:15:19,026::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1e040e9-da5a-4a8f-8a27-d45d1ae7623d`::moving from state preparing -> state finished >Thread-136131::DEBUG::2014-10-29 11:15:19,026::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136131::DEBUG::2014-10-29 11:15:19,026::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136131::DEBUG::2014-10-29 11:15:19,027::task::993::Storage.TaskManager.Task::(_decref) Task=`b1e040e9-da5a-4a8f-8a27-d45d1ae7623d`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:19,858::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:19,860::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:19,863::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:15:19,987::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54250 >Detector thread::DEBUG::2014-10-29 11:15:19,987::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54250 >Detector thread::DEBUG::2014-10-29 11:15:19,988::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54250 >Detector thread::DEBUG::2014-10-29 11:15:19,988::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54250) >Thread-136132::DEBUG::2014-10-29 11:15:20,027::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136132::DEBUG::2014-10-29 11:15:20,028::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136132::DEBUG::2014-10-29 11:15:20,028::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.85', 'elapsedTime': '513952', 'displayType': 'vnc', 'cpuSys': '0.47', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '94300220', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '78828', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '31871.91'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.60', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:15:20,507::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54252 >Detector thread::DEBUG::2014-10-29 11:15:20,508::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54252 >Detector thread::DEBUG::2014-10-29 11:15:20,508::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54252 >Detector thread::DEBUG::2014-10-29 11:15:20,508::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54252) >Detector thread::DEBUG::2014-10-29 11:15:20,523::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54253 >Detector thread::DEBUG::2014-10-29 11:15:20,524::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54253 >Detector thread::DEBUG::2014-10-29 11:15:20,524::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54253 >Detector thread::DEBUG::2014-10-29 11:15:20,524::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54253) >Thread-136133::DEBUG::2014-10-29 11:15:20,547::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136133::DEBUG::2014-10-29 11:15:20,550::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136133::DEBUG::2014-10-29 11:15:20,572::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136134::DEBUG::2014-10-29 11:15:20,573::task::595::Storage.TaskManager.Task::(_updateState) Task=`76c3264b-3a98-4f3b-9cf7-cf547ab1d50d`::moving from state init -> state preparing >Thread-136134::INFO::2014-10-29 11:15:20,577::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136134::INFO::2014-10-29 11:15:20,580::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0036375', 'lastCheck': '8.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517629', 'lastCheck': '8.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491602', 'lastCheck': '8.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000499662', 'lastCheck': '8.5', 'valid': True}} >Thread-136134::DEBUG::2014-10-29 11:15:20,582::task::1191::Storage.TaskManager.Task::(prepare) Task=`76c3264b-3a98-4f3b-9cf7-cf547ab1d50d`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0036375', 'lastCheck': '8.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517629', 'lastCheck': '8.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491602', 'lastCheck': '8.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000499662', 'lastCheck': '8.5', 'valid': True}} >Thread-136134::DEBUG::2014-10-29 11:15:20,583::task::595::Storage.TaskManager.Task::(_updateState) Task=`76c3264b-3a98-4f3b-9cf7-cf547ab1d50d`::moving from state preparing -> state finished >Thread-136134::DEBUG::2014-10-29 11:15:20,585::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136134::DEBUG::2014-10-29 11:15:20,586::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136134::DEBUG::2014-10-29 11:15:20,588::task::993::Storage.TaskManager.Task::(_decref) Task=`76c3264b-3a98-4f3b-9cf7-cf547ab1d50d`::ref 0 aborting False >Thread-136133::DEBUG::2014-10-29 11:15:20,652::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '77', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '77', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:21,935::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:21,938::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136135::DEBUG::2014-10-29 11:15:21,942::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:21,945::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:21,946::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136136::DEBUG::2014-10-29 11:15:21,950::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136136::DEBUG::2014-10-29 11:15:21,952::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:15:22,066::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:22,067::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:22,067::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:22,067::__init__::232::IOProcess::(_processLogs) (200637) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:22,068::__init__::232::IOProcess::(_processLogs) (200637) Queuing response >Thread-10269::DEBUG::2014-10-29 11:15:22,069::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:15:22,088::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00041932 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:15:22,090::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:22,090::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:22,091::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:22,091::__init__::232::IOProcess::(_processLogs) (200638) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:22,091::__init__::232::IOProcess::(_processLogs) (200638) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:22,127::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:22,127::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:22,127::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:22,128::__init__::232::IOProcess::(_processLogs) (200639) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:22,129::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200639) Queuing response >Thread-179::DEBUG::2014-10-29 11:15:22,130::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:15:22,149::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000489549 s, 760 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:15:22,150::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:22,151::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:22,151::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:22,151::__init__::232::IOProcess::(_processLogs) (200640) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:22,153::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200640) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:22,332::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:22,333::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:22,333::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:22,333::__init__::232::IOProcess::(_processLogs) (200641) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:22,333::__init__::232::IOProcess::(_processLogs) (200641) Queuing response >Thread-33::DEBUG::2014-10-29 11:15:22,335::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:15:22,355::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:22,356::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:22,356::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:22,357::__init__::232::IOProcess::(_processLogs) (200642) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:22,357::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200642) Queuing response >Thread-178::DEBUG::2014-10-29 11:15:22,360::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:15:22,384::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00556747 s, 87.5 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:15:22,387::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-178::DEBUG::2014-10-29 11:15:22,389::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00139979 s, 363 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:15:22,393::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:22,394::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:22,395::__init__::232::IOProcess::(_processLogs) (200643) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:22,395::__init__::232::IOProcess::(_processLogs) (200643) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:22,395::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:22,396::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:22,396::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:22,396::__init__::232::IOProcess::(_processLogs) (200644) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:22,396::__init__::232::IOProcess::(_processLogs) (200644) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:22,400::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:22,401::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:22,401::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:22,401::__init__::232::IOProcess::(_processLogs) (200645) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:22,401::__init__::232::IOProcess::(_processLogs) (200645) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:22,403::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:22,408::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:22,410::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:22,412::__init__::232::IOProcess::(_processLogs) (200646) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:22,414::__init__::232::IOProcess::(_processLogs) (200646) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:22,415::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:22,416::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:22,417::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:22,419::__init__::232::IOProcess::(_processLogs) (200647) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:22,422::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200647) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:22,425::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:22,426::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:22,429::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:22,430::__init__::232::IOProcess::(_processLogs) (200648) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:22,430::__init__::232::IOProcess::(_processLogs) (200648) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:22,432::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:22,432::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:22,432::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:22,433::__init__::232::IOProcess::(_processLogs) (200649) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:22,433::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200649) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:22,435::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:22,436::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:22,437::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:22,438::__init__::232::IOProcess::(_processLogs) (200650) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:22,438::__init__::232::IOProcess::(_processLogs) (200650) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:24,869::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:24,870::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:24,872::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:24,997::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:24,999::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136137::DEBUG::2014-10-29 11:15:25,002::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:25,005::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:25,006::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136138::DEBUG::2014-10-29 11:15:25,010::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136138::DEBUG::2014-10-29 11:15:25,012::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:28,026::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:28,029::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136139::DEBUG::2014-10-29 11:15:28,033::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:28,035::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:28,037::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136140::DEBUG::2014-10-29 11:15:28,040::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136140::DEBUG::2014-10-29 11:15:28,043::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:15:29,613::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54255 >Detector thread::DEBUG::2014-10-29 11:15:29,615::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54255 >Detector thread::DEBUG::2014-10-29 11:15:29,616::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54255 >Detector thread::DEBUG::2014-10-29 11:15:29,616::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54255) >Thread-136141::DEBUG::2014-10-29 11:15:29,654::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136141::DEBUG::2014-10-29 11:15:29,656::task::595::Storage.TaskManager.Task::(_updateState) Task=`8581ca2a-1587-4c35-97a8-95efc06f1414`::moving from state init -> state preparing >Thread-136141::INFO::2014-10-29 11:15:29,656::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136141::DEBUG::2014-10-29 11:15:29,660::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:15:29,661::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:29,661::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:29,662::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:29,662::__init__::232::IOProcess::(_processLogs) (200651) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:15:29,664::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200651) Queuing response >Thread-136141::DEBUG::2014-10-29 11:15:29,664::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136141::DEBUG::2014-10-29 11:15:29,666::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136141::INFO::2014-10-29 11:15:29,666::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136141::DEBUG::2014-10-29 11:15:29,666::task::1191::Storage.TaskManager.Task::(prepare) Task=`8581ca2a-1587-4c35-97a8-95efc06f1414`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136141::DEBUG::2014-10-29 11:15:29,667::task::595::Storage.TaskManager.Task::(_updateState) Task=`8581ca2a-1587-4c35-97a8-95efc06f1414`::moving from state preparing -> state finished >Thread-136141::DEBUG::2014-10-29 11:15:29,667::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136141::DEBUG::2014-10-29 11:15:29,667::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136141::DEBUG::2014-10-29 11:15:29,667::task::993::Storage.TaskManager.Task::(_decref) Task=`8581ca2a-1587-4c35-97a8-95efc06f1414`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:15:29,711::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54256 >Detector thread::DEBUG::2014-10-29 11:15:29,711::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54256 >Detector thread::DEBUG::2014-10-29 11:15:29,712::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54256 >Detector thread::DEBUG::2014-10-29 11:15:29,712::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54256) >Thread-136142::DEBUG::2014-10-29 11:15:29,751::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136142::DEBUG::2014-10-29 11:15:29,751::task::595::Storage.TaskManager.Task::(_updateState) Task=`6922a880-946d-4d33-979b-bf6512e11dcc`::moving from state init -> state preparing >Thread-136142::INFO::2014-10-29 11:15:29,752::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136142::DEBUG::2014-10-29 11:15:29,752::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136142::DEBUG::2014-10-29 11:15:29,752::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136142::DEBUG::2014-10-29 11:15:29,753::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136142::DEBUG::2014-10-29 11:15:29,753::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136142::DEBUG::2014-10-29 11:15:29,753::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136142::DEBUG::2014-10-29 11:15:29,754::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136142::DEBUG::2014-10-29 11:15:29,831::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136142::DEBUG::2014-10-29 11:15:29,834::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:29,879::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:29,880::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:29,883::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136142::DEBUG::2014-10-29 11:15:30,026::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136142::DEBUG::2014-10-29 11:15:30,026::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136142::DEBUG::2014-10-29 11:15:30,027::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136142::DEBUG::2014-10-29 11:15:30,027::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136142::DEBUG::2014-10-29 11:15:30,027::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136142::DEBUG::2014-10-29 11:15:30,028::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136142::DEBUG::2014-10-29 11:15:30,028::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136142::DEBUG::2014-10-29 11:15:30,029::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:15:30,040::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:30,041::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:30,041::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:30,041::__init__::232::IOProcess::(_processLogs) (200652) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:15:30,041::__init__::232::IOProcess::(_processLogs) (200652) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:30,042::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:30,043::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:30,043::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:30,043::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:30,044::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:30,044::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:30,044::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:30,044::__init__::232::IOProcess::(_processLogs) (200653) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:15:30,045::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:30,045::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:30,045::__init__::232::IOProcess::(_processLogs) (200654) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:15:30,046::__init__::232::IOProcess::(_processLogs) (200655) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:15:30,047::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200655) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:30,048::__init__::232::IOProcess::(_processLogs) (200653) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:30,048::__init__::232::IOProcess::(_processLogs) (200654) Queuing response >Thread-136142::DEBUG::2014-10-29 11:15:30,063::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:15:30,064::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:30,065::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:30,065::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:30,065::__init__::232::IOProcess::(_processLogs) (200656) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:15:30,071::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200656) Queuing response >Thread-136142::DEBUG::2014-10-29 11:15:30,072::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:15:30,073::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:30,073::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:30,074::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:30,074::__init__::232::IOProcess::(_processLogs) (200657) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:15:30,075::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200657) Queuing response >Thread-136142::DEBUG::2014-10-29 11:15:30,075::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:15:30,077::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:30,077::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:30,078::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:30,079::__init__::232::IOProcess::(_processLogs) (200658) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:30,079::__init__::232::IOProcess::(_processLogs) (200658) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:30,080::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:30,080::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-136142::DEBUG::2014-10-29 11:15:30,081::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:15:30,081::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-136142::INFO::2014-10-29 11:15:30,082::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:15:30,083::__init__::232::IOProcess::(_processLogs) (200659) Got request for method 'glob' >Thread-136142::INFO::2014-10-29 11:15:30,083::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:15:30,084::__init__::232::IOProcess::(_processLogs) (200659) Queuing response >Thread-136142::INFO::2014-10-29 11:15:30,085::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:15:30,086::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:30,087::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:30,087::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:30,087::__init__::232::IOProcess::(_processLogs) (200660) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:15:30,088::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200660) Queuing response >Thread-136142::DEBUG::2014-10-29 11:15:30,088::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136142::DEBUG::2014-10-29 11:15:30,091::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`a48c7419-d429-4c6e-87a2-8e945685b8fb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136142::DEBUG::2014-10-29 11:15:30,091::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136142::DEBUG::2014-10-29 11:15:30,091::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136142::DEBUG::2014-10-29 11:15:30,091::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`a48c7419-d429-4c6e-87a2-8e945685b8fb`::Granted request >Thread-136142::DEBUG::2014-10-29 11:15:30,092::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6922a880-946d-4d33-979b-bf6512e11dcc`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136142::DEBUG::2014-10-29 11:15:30,092::task::993::Storage.TaskManager.Task::(_decref) Task=`6922a880-946d-4d33-979b-bf6512e11dcc`::ref 1 aborting False >Thread-136142::INFO::2014-10-29 11:15:30,095::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136142::DEBUG::2014-10-29 11:15:30,095::task::1191::Storage.TaskManager.Task::(prepare) Task=`6922a880-946d-4d33-979b-bf6512e11dcc`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136142::DEBUG::2014-10-29 11:15:30,096::task::595::Storage.TaskManager.Task::(_updateState) Task=`6922a880-946d-4d33-979b-bf6512e11dcc`::moving from state preparing -> state finished >Thread-136142::DEBUG::2014-10-29 11:15:30,096::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136142::DEBUG::2014-10-29 11:15:30,096::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136142::DEBUG::2014-10-29 11:15:30,097::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136142::DEBUG::2014-10-29 11:15:30,097::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136142::DEBUG::2014-10-29 11:15:30,097::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136142::DEBUG::2014-10-29 11:15:30,097::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136142::DEBUG::2014-10-29 11:15:30,098::task::993::Storage.TaskManager.Task::(_decref) Task=`6922a880-946d-4d33-979b-bf6512e11dcc`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:15:30,118::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54257 >Detector thread::DEBUG::2014-10-29 11:15:30,118::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54257 >Detector thread::DEBUG::2014-10-29 11:15:30,119::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54257 >Detector thread::DEBUG::2014-10-29 11:15:30,120::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54257) >Thread-136147::DEBUG::2014-10-29 11:15:30,158::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136147::DEBUG::2014-10-29 11:15:30,158::task::595::Storage.TaskManager.Task::(_updateState) Task=`b31e2298-2f05-4fba-af6f-4ee0f09dab62`::moving from state init -> state preparing >Thread-136147::INFO::2014-10-29 11:15:30,159::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136147::INFO::2014-10-29 11:15:30,159::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00139979', 'lastCheck': '7.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00556747', 'lastCheck': '7.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489549', 'lastCheck': '8.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00041932', 'lastCheck': '8.1', 'valid': True}} >Thread-136147::DEBUG::2014-10-29 11:15:30,160::task::1191::Storage.TaskManager.Task::(prepare) Task=`b31e2298-2f05-4fba-af6f-4ee0f09dab62`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00139979', 'lastCheck': '7.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00556747', 'lastCheck': '7.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489549', 'lastCheck': '8.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00041932', 'lastCheck': '8.1', 'valid': True}} >Thread-136147::DEBUG::2014-10-29 11:15:30,160::task::595::Storage.TaskManager.Task::(_updateState) Task=`b31e2298-2f05-4fba-af6f-4ee0f09dab62`::moving from state preparing -> state finished >Thread-136147::DEBUG::2014-10-29 11:15:30,160::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136147::DEBUG::2014-10-29 11:15:30,160::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136147::DEBUG::2014-10-29 11:15:30,161::task::993::Storage.TaskManager.Task::(_decref) Task=`b31e2298-2f05-4fba-af6f-4ee0f09dab62`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:15:30,179::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54258 >Detector thread::DEBUG::2014-10-29 11:15:30,180::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54258 >Detector thread::DEBUG::2014-10-29 11:15:30,180::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54258 >Detector thread::DEBUG::2014-10-29 11:15:30,180::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54258) >Thread-136148::DEBUG::2014-10-29 11:15:30,221::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136148::DEBUG::2014-10-29 11:15:30,222::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136148::DEBUG::2014-10-29 11:15:30,223::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.85', 'elapsedTime': '513962', 'displayType': 'vnc', 'cpuSys': '0.47', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '94300220', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '78828', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '31871.91'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.76', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:15:30,735::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54260 >Detector thread::DEBUG::2014-10-29 11:15:30,737::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54260 >Detector thread::DEBUG::2014-10-29 11:15:30,737::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54260 >Detector thread::DEBUG::2014-10-29 11:15:30,738::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54260) >Detector thread::DEBUG::2014-10-29 11:15:30,753::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54261 >Detector thread::DEBUG::2014-10-29 11:15:30,754::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54261 >Detector thread::DEBUG::2014-10-29 11:15:30,754::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54261 >Detector thread::DEBUG::2014-10-29 11:15:30,754::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54261) >Thread-136149::DEBUG::2014-10-29 11:15:30,778::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5708768-d58e-4c1c-a3e7-7ee24e17d7df`::moving from state init -> state preparing >Thread-136149::INFO::2014-10-29 11:15:30,778::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136149::INFO::2014-10-29 11:15:30,778::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00139979', 'lastCheck': '8.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00556747', 'lastCheck': '8.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489549', 'lastCheck': '8.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00041932', 'lastCheck': '8.7', 'valid': True}} >Thread-136149::DEBUG::2014-10-29 11:15:30,779::task::1191::Storage.TaskManager.Task::(prepare) Task=`f5708768-d58e-4c1c-a3e7-7ee24e17d7df`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00139979', 'lastCheck': '8.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00556747', 'lastCheck': '8.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489549', 'lastCheck': '8.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00041932', 'lastCheck': '8.7', 'valid': True}} >Thread-136149::DEBUG::2014-10-29 11:15:30,779::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5708768-d58e-4c1c-a3e7-7ee24e17d7df`::moving from state preparing -> state finished >Thread-136149::DEBUG::2014-10-29 11:15:30,779::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136149::DEBUG::2014-10-29 11:15:30,780::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136149::DEBUG::2014-10-29 11:15:30,780::task::993::Storage.TaskManager.Task::(_decref) Task=`f5708768-d58e-4c1c-a3e7-7ee24e17d7df`::ref 0 aborting False >Thread-136150::DEBUG::2014-10-29 11:15:30,794::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136150::DEBUG::2014-10-29 11:15:30,797::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136150::DEBUG::2014-10-29 11:15:30,816::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136150::DEBUG::2014-10-29 11:15:30,895::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '51', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '51', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:31,056::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:31,059::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136151::DEBUG::2014-10-29 11:15:31,063::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:31,065::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:31,067::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136152::DEBUG::2014-10-29 11:15:31,070::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136152::DEBUG::2014-10-29 11:15:31,072::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:15:32,096::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-10269::DEBUG::2014-10-29 11:15:32,098::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:15:32,117::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:32,118::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:32,118::__init__::232::IOProcess::(_processLogs) (200661) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:32,119::__init__::232::IOProcess::(_processLogs) (200661) Queuing response >Thread-10269::DEBUG::2014-10-29 11:15:32,129::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.011222 s, 44.7 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:15:32,131::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:32,131::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:32,131::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:32,132::__init__::232::IOProcess::(_processLogs) (200662) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:32,133::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200662) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:32,157::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:32,157::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:32,158::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:32,158::__init__::232::IOProcess::(_processLogs) (200663) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:32,159::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200663) Queuing response >Thread-179::DEBUG::2014-10-29 11:15:32,160::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:15:32,180::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000426994 s, 871 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:15:32,182::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:32,182::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:32,184::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:32,185::__init__::232::IOProcess::(_processLogs) (200664) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:32,185::__init__::232::IOProcess::(_processLogs) (200664) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:32,436::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:32,436::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:32,437::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:32,437::__init__::232::IOProcess::(_processLogs) (200665) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:32,440::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200665) Queuing response >Thread-33::DEBUG::2014-10-29 11:15:32,441::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:15:32,460::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:32,467::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-33::DEBUG::2014-10-29 11:15:32,467::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000439542 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:15:32,469::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-178::DEBUG::2014-10-29 11:15:32,471::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:15:32,472::__init__::232::IOProcess::(_processLogs) (200666) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:32,494::__init__::232::IOProcess::(_processLogs) (200666) Queuing response >Thread-178::DEBUG::2014-10-29 11:15:32,497::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000616645 s, 824 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:15:32,502::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:32,504::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:32,506::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:32,507::__init__::232::IOProcess::(_processLogs) (200667) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:32,514::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200667) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:32,520::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:32,520::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:32,528::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:32,529::__init__::232::IOProcess::(_processLogs) (200668) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:32,529::__init__::232::IOProcess::(_processLogs) (200668) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:32,530::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:32,531::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:32,532::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:32,532::__init__::232::IOProcess::(_processLogs) (200669) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:32,533::__init__::232::IOProcess::(_processLogs) (200669) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:32,534::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:32,535::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:32,535::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:32,535::__init__::232::IOProcess::(_processLogs) (200670) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:32,536::__init__::232::IOProcess::(_processLogs) (200670) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:32,536::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:32,537::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:32,538::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:32,538::__init__::232::IOProcess::(_processLogs) (200671) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:32,538::__init__::232::IOProcess::(_processLogs) (200671) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:32,538::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:32,540::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:32,540::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:32,540::__init__::232::IOProcess::(_processLogs) (200672) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:32,541::__init__::232::IOProcess::(_processLogs) (200672) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:32,541::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:32,542::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:32,544::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:32,544::__init__::232::IOProcess::(_processLogs) (200673) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:32,545::__init__::232::IOProcess::(_processLogs) (200673) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:32,545::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:32,546::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:32,547::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:32,548::__init__::232::IOProcess::(_processLogs) (200674) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:32,548::__init__::232::IOProcess::(_processLogs) (200674) Queuing response >Thread-22::DEBUG::2014-10-29 11:15:33,484::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >VM Channels Listener::DEBUG::2014-10-29 11:15:33,775::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:34,085::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:34,087::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136153::DEBUG::2014-10-29 11:15:34,091::task::595::Storage.TaskManager.Task::(_updateState) Task=`3616362d-6ad1-4777-84d7-d74c98327cd9`::moving from state init -> state preparing >Thread-136153::INFO::2014-10-29 11:15:34,092::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136153::INFO::2014-10-29 11:15:34,092::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616645', 'lastCheck': '1.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000439542', 'lastCheck': '1.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426994', 'lastCheck': '1.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.011222', 'lastCheck': '2.0', 'valid': True}} >Thread-136153::DEBUG::2014-10-29 11:15:34,093::task::1191::Storage.TaskManager.Task::(prepare) Task=`3616362d-6ad1-4777-84d7-d74c98327cd9`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616645', 'lastCheck': '1.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000439542', 'lastCheck': '1.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426994', 'lastCheck': '1.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.011222', 'lastCheck': '2.0', 'valid': True}} >Thread-136153::DEBUG::2014-10-29 11:15:34,093::task::595::Storage.TaskManager.Task::(_updateState) Task=`3616362d-6ad1-4777-84d7-d74c98327cd9`::moving from state preparing -> state finished >Thread-136153::DEBUG::2014-10-29 11:15:34,093::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136153::DEBUG::2014-10-29 11:15:34,093::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136153::DEBUG::2014-10-29 11:15:34,094::task::993::Storage.TaskManager.Task::(_decref) Task=`3616362d-6ad1-4777-84d7-d74c98327cd9`::ref 0 aborting False >Thread-136153::DEBUG::2014-10-29 11:15:34,124::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:34,146::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:34,148::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136154::DEBUG::2014-10-29 11:15:34,152::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136154::DEBUG::2014-10-29 11:15:34,154::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:34,890::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:34,891::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:34,893::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:37,204::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:37,207::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136155::DEBUG::2014-10-29 11:15:37,212::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:37,214::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:37,216::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136156::DEBUG::2014-10-29 11:15:37,219::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136156::DEBUG::2014-10-29 11:15:37,222::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:15:39,380::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54262 >Detector thread::DEBUG::2014-10-29 11:15:39,381::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54262 >Detector thread::DEBUG::2014-10-29 11:15:39,381::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54262 >Detector thread::DEBUG::2014-10-29 11:15:39,381::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54262) >Thread-136157::DEBUG::2014-10-29 11:15:39,420::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136157::DEBUG::2014-10-29 11:15:39,421::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136157::DEBUG::2014-10-29 11:15:39,422::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.93', 'elapsedTime': '513971', 'displayType': 'vnc', 'cpuSys': '1.33', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '94300220', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '78828', 'readRate': '0.00', 'truesize': '6010863616', 'writeRate': '31871.91'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.94', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:39,900::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:39,901::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:39,903::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:40,242::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:40,245::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136158::DEBUG::2014-10-29 11:15:40,249::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:40,252::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:40,254::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136159::DEBUG::2014-10-29 11:15:40,257::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136159::DEBUG::2014-10-29 11:15:40,259::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:15:40,738::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54265 >Detector thread::DEBUG::2014-10-29 11:15:40,739::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54265 >Detector thread::DEBUG::2014-10-29 11:15:40,739::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54265 >Detector thread::DEBUG::2014-10-29 11:15:40,739::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54265) >Thread-136160::DEBUG::2014-10-29 11:15:40,779::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136160::DEBUG::2014-10-29 11:15:40,780::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b42948c-8387-4e90-bf5d-c03bd3c32d41`::moving from state init -> state preparing >Thread-136160::INFO::2014-10-29 11:15:40,780::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136160::DEBUG::2014-10-29 11:15:40,783::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:15:40,784::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:40,785::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:40,785::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:40,785::__init__::232::IOProcess::(_processLogs) (200675) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:15:40,787::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200675) Queuing response >Thread-136160::DEBUG::2014-10-29 11:15:40,787::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136160::DEBUG::2014-10-29 11:15:40,789::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136160::INFO::2014-10-29 11:15:40,789::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136160::DEBUG::2014-10-29 11:15:40,789::task::1191::Storage.TaskManager.Task::(prepare) Task=`5b42948c-8387-4e90-bf5d-c03bd3c32d41`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136160::DEBUG::2014-10-29 11:15:40,790::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b42948c-8387-4e90-bf5d-c03bd3c32d41`::moving from state preparing -> state finished >Thread-136160::DEBUG::2014-10-29 11:15:40,790::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136160::DEBUG::2014-10-29 11:15:40,790::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136160::DEBUG::2014-10-29 11:15:40,790::task::993::Storage.TaskManager.Task::(_decref) Task=`5b42948c-8387-4e90-bf5d-c03bd3c32d41`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:15:40,834::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54266 >Detector thread::DEBUG::2014-10-29 11:15:40,835::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54266 >Detector thread::DEBUG::2014-10-29 11:15:40,835::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54266 >Detector thread::DEBUG::2014-10-29 11:15:40,836::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54266) >Thread-136161::DEBUG::2014-10-29 11:15:40,874::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136161::DEBUG::2014-10-29 11:15:40,875::task::595::Storage.TaskManager.Task::(_updateState) Task=`eb111d8d-6157-4a23-b427-562097ca58c1`::moving from state init -> state preparing >Thread-136161::INFO::2014-10-29 11:15:40,875::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136161::DEBUG::2014-10-29 11:15:40,875::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136161::DEBUG::2014-10-29 11:15:40,876::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136161::DEBUG::2014-10-29 11:15:40,876::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136161::DEBUG::2014-10-29 11:15:40,876::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136161::DEBUG::2014-10-29 11:15:40,876::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136161::DEBUG::2014-10-29 11:15:40,877::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Detector thread::DEBUG::2014-10-29 11:15:40,906::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54267 >Detector thread::DEBUG::2014-10-29 11:15:40,907::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54267 >Detector thread::DEBUG::2014-10-29 11:15:40,908::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54267 >Detector thread::DEBUG::2014-10-29 11:15:40,908::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54267) >Detector thread::DEBUG::2014-10-29 11:15:40,943::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54268 >Detector thread::DEBUG::2014-10-29 11:15:40,944::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54268 >Detector thread::DEBUG::2014-10-29 11:15:40,944::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54268 >Detector thread::DEBUG::2014-10-29 11:15:40,944::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54268) >Thread-136162::DEBUG::2014-10-29 11:15:40,948::task::595::Storage.TaskManager.Task::(_updateState) Task=`79c78a84-13d8-402c-86b9-9659a2c386e1`::moving from state init -> state preparing >Thread-136162::INFO::2014-10-29 11:15:40,949::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136162::INFO::2014-10-29 11:15:40,950::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616645', 'lastCheck': '8.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000439542', 'lastCheck': '8.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426994', 'lastCheck': '8.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.011222', 'lastCheck': '8.8', 'valid': True}} >Thread-136162::DEBUG::2014-10-29 11:15:40,950::task::1191::Storage.TaskManager.Task::(prepare) Task=`79c78a84-13d8-402c-86b9-9659a2c386e1`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616645', 'lastCheck': '8.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000439542', 'lastCheck': '8.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426994', 'lastCheck': '8.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.011222', 'lastCheck': '8.8', 'valid': True}} >Thread-136162::DEBUG::2014-10-29 11:15:40,950::task::595::Storage.TaskManager.Task::(_updateState) Task=`79c78a84-13d8-402c-86b9-9659a2c386e1`::moving from state preparing -> state finished >Thread-136162::DEBUG::2014-10-29 11:15:40,950::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136162::DEBUG::2014-10-29 11:15:40,951::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136162::DEBUG::2014-10-29 11:15:40,951::task::993::Storage.TaskManager.Task::(_decref) Task=`79c78a84-13d8-402c-86b9-9659a2c386e1`::ref 0 aborting False >Thread-136161::DEBUG::2014-10-29 11:15:40,967::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136161::DEBUG::2014-10-29 11:15:40,967::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136163::DEBUG::2014-10-29 11:15:40,984::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136163::DEBUG::2014-10-29 11:15:40,988::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136163::DEBUG::2014-10-29 11:15:41,005::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136163::DEBUG::2014-10-29 11:15:41,063::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '35', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '34', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-136161::DEBUG::2014-10-29 11:15:41,129::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136161::DEBUG::2014-10-29 11:15:41,130::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136161::DEBUG::2014-10-29 11:15:41,131::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136161::DEBUG::2014-10-29 11:15:41,131::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136161::DEBUG::2014-10-29 11:15:41,132::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136161::DEBUG::2014-10-29 11:15:41,132::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136161::DEBUG::2014-10-29 11:15:41,132::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136161::DEBUG::2014-10-29 11:15:41,133::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:15:41,139::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:41,140::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:41,141::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:41,141::__init__::232::IOProcess::(_processLogs) (200676) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:15:41,143::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:41,143::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:41,143::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:41,144::__init__::232::IOProcess::(_processLogs) (200677) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:15:41,144::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:41,144::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:41,144::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:41,145::__init__::232::IOProcess::(_processLogs) (200678) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:15:41,145::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:41,145::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:41,145::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:41,146::__init__::232::IOProcess::(_processLogs) (200679) Got request for method 'glob' >Thread-10269::DEBUG::2014-10-29 11:15:42,134::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain de096187-36e2-44e5-b8db-a9b67c3960de >Thread-17::DEBUG::2014-10-29 11:15:42,140::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:42,142::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:42,142::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:42,142::__init__::232::IOProcess::(_processLogs) (200680) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:15:42,143::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:42,144::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:42,144::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:42,144::__init__::232::IOProcess::(_processLogs) (200681) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:15:42,144::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:42,145::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:42,145::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:42,145::__init__::232::IOProcess::(_processLogs) (200682) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:15:42,146::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:42,146::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:42,146::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:42,146::__init__::232::IOProcess::(_processLogs) (200683) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:15:42,187::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:42,187::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:42,187::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:42,188::__init__::232::IOProcess::(_processLogs) (200684) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:42,550::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:42,550::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:42,550::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:42,551::__init__::232::IOProcess::(_processLogs) (200685) Got request for method 'statvfs' >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:43,275::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:43,278::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136172::DEBUG::2014-10-29 11:15:43,282::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:43,284::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:43,285::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136173::DEBUG::2014-10-29 11:15:43,289::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136173::DEBUG::2014-10-29 11:15:43,291::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:15:43,780::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200677) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:43,787::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200684) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:43,787::__init__::232::IOProcess::(_processLogs) (200678) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:43,788::__init__::232::IOProcess::(_processLogs) (200681) Queuing response >Thread-179::DEBUG::2014-10-29 11:15:43,792::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:15:43,790::__init__::232::IOProcess::(_processLogs) (200683) Queuing response >Thread-136161::DEBUG::2014-10-29 11:15:43,793::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:15:43,819::__init__::232::IOProcess::(_processLogs) (200682) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:43,823::__init__::232::IOProcess::(_processLogs) (200679) Queuing response >Thread-179::DEBUG::2014-10-29 11:15:43,824::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00272654 s, 136 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:15:43,828::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200685) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:43,830::__init__::232::IOProcess::(_processLogs) (200676) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:43,831::__init__::232::IOProcess::(_processLogs) (200680) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:43,838::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:43,839::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:43,840::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:43,843::__init__::232::IOProcess::(_processLogs) (200686) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:15:43,846::__init__::232::IOProcess::(_processLogs) (200686) Queuing response >Thread-10269::DEBUG::2014-10-29 11:15:43,869::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de >Thread-17::DEBUG::2014-10-29 11:15:43,871::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-178::DEBUG::2014-10-29 11:15:43,874::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:15:43,891::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:43,896::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-178::DEBUG::2014-10-29 11:15:43,897::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000553127 s, 918 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:15:43,898::__init__::232::IOProcess::(_processLogs) (200687) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:43,902::__init__::232::IOProcess::(_processLogs) (200687) Queuing response >Thread-136161::DEBUG::2014-10-29 11:15:43,915::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:15:43,915::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:43,918::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:43,919::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:43,920::__init__::232::IOProcess::(_processLogs) (200688) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:15:43,923::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200688) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:43,924::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:43,925::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10269::DEBUG::2014-10-29 11:15:43,927::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:15:43,927::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:43,929::__init__::232::IOProcess::(_processLogs) (200689) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:43,931::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200689) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:43,932::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:43,932::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:43,933::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:43,933::__init__::232::IOProcess::(_processLogs) (200690) Got request for method 'readfile' >Thread-136161::DEBUG::2014-10-29 11:15:43,934::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:15:43,934::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200690) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:43,937::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:43,938::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:43,938::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:43,938::__init__::232::IOProcess::(_processLogs) (200691) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:15:43,939::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200691) Queuing response >Thread-10269::DEBUG::2014-10-29 11:15:43,940::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nsednev-iso-domain', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=00000002-0002-0002-0002-000000000324,00000002-0002-0002-0002-00000000002d,00000002-0002-0002-0002-0000000003d4,00000002-0002-0002-0002-000000000321', 'REMOTE_PATH=monster-nfs.scl.lab.tlv.redhat.com:/RHEV/nsednev-iso-domain', 'ROLE=Regular', 'SDUUID=de096187-36e2-44e5-b8db-a9b67c3960de', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=4fa36e197e83f2488bfc8aea7825ed34cc463260'] >Thread-17::DEBUG::2014-10-29 11:15:43,941::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:43,943::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:43,944::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:43,944::__init__::232::IOProcess::(_processLogs) (200692) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:43,945::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200692) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:43,946::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:43,947::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:43,948::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:43,948::__init__::232::IOProcess::(_processLogs) (200693) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:43,949::__init__::232::IOProcess::(_processLogs) (200693) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:43,950::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:43,951::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:43,951::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:43,951::__init__::232::IOProcess::(_processLogs) (200694) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:43,951::__init__::232::IOProcess::(_processLogs) (200694) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:43,952::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:43,953::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:43,953::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:43,954::__init__::232::IOProcess::(_processLogs) (200695) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:43,954::__init__::232::IOProcess::(_processLogs) (200695) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:43,954::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:43,955::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:43,955::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:43,955::__init__::232::IOProcess::(_processLogs) (200696) Got request for method 'glob' >Thread-136161::DEBUG::2014-10-29 11:15:43,956::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:15:43,956::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200696) Queuing response >Thread-136161::INFO::2014-10-29 11:15:43,957::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:15:43,958::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-136161::INFO::2014-10-29 11:15:43,958::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:15:43,959::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-136161::INFO::2014-10-29 11:15:43,961::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:15:43,962::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:43,963::__init__::232::IOProcess::(_processLogs) (200697) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:15:43,964::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200697) Queuing response >Thread-10269::DEBUG::2014-10-29 11:15:43,964::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-10269::INFO::2014-10-29 11:15:43,966::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace de096187-36e2-44e5-b8db-a9b67c3960de_imageNS already registered >Thread-10269::INFO::2014-10-29 11:15:43,967::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace de096187-36e2-44e5-b8db-a9b67c3960de_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:15:43,968::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:43,969::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:43,969::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:43,969::__init__::232::IOProcess::(_processLogs) (200698) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:43,970::__init__::232::IOProcess::(_processLogs) (200698) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:43,971::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:43,972::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:43,972::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:43,973::__init__::232::IOProcess::(_processLogs) (200699) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:43,974::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200699) Queuing response >Thread-33::DEBUG::2014-10-29 11:15:43,976::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:15:43,976::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:43,994::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-33::DEBUG::2014-10-29 11:15:43,996::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000503211 s, 968 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:15:43,997::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:43,999::__init__::232::IOProcess::(_processLogs) (200700) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:15:44,000::__init__::232::IOProcess::(_processLogs) (200700) Queuing response >Thread-136161::DEBUG::2014-10-29 11:15:44,001::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:15:44,003::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:44,005::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:44,007::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-136161::DEBUG::2014-10-29 11:15:44,009::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`fb071c41-b1f7-4a26-8c2f-2351604585e2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136161::DEBUG::2014-10-29 11:15:44,010::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136161::DEBUG::2014-10-29 11:15:44,013::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-17::DEBUG::2014-10-29 11:15:44,014::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200701) Got request for method 'statvfs' >Thread-136161::DEBUG::2014-10-29 11:15:44,015::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`fb071c41-b1f7-4a26-8c2f-2351604585e2`::Granted request >Thread-17::DEBUG::2014-10-29 11:15:44,017::__init__::232::IOProcess::(_processLogs) (200701) Queuing response >Thread-10269::DEBUG::2014-10-29 11:15:44,018::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:15:44,039::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-136161::DEBUG::2014-10-29 11:15:44,039::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`eb111d8d-6157-4a23-b427-562097ca58c1`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-17::DEBUG::2014-10-29 11:15:44,042::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10269::DEBUG::2014-10-29 11:15:44,043::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000543593 s, 923 kB/s\n'; <rc> = 0 >Thread-136161::DEBUG::2014-10-29 11:15:44,043::task::993::Storage.TaskManager.Task::(_decref) Task=`eb111d8d-6157-4a23-b427-562097ca58c1`::ref 1 aborting False >Thread-17::DEBUG::2014-10-29 11:15:44,045::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:44,048::__init__::232::IOProcess::(_processLogs) (200702) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:44,056::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200702) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:44,060::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:44,062::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-136161::INFO::2014-10-29 11:15:44,063::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-17::DEBUG::2014-10-29 11:15:44,064::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-136161::DEBUG::2014-10-29 11:15:44,064::task::1191::Storage.TaskManager.Task::(prepare) Task=`eb111d8d-6157-4a23-b427-562097ca58c1`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136161::DEBUG::2014-10-29 11:15:44,066::task::595::Storage.TaskManager.Task::(_updateState) Task=`eb111d8d-6157-4a23-b427-562097ca58c1`::moving from state preparing -> state finished >Thread-17::DEBUG::2014-10-29 11:15:44,066::__init__::232::IOProcess::(_processLogs) (200703) Got request for method 'statvfs' >Thread-136161::DEBUG::2014-10-29 11:15:44,067::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136161::DEBUG::2014-10-29 11:15:44,068::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136161::DEBUG::2014-10-29 11:15:44,071::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-17::DEBUG::2014-10-29 11:15:44,073::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200703) Queuing response >Thread-136161::DEBUG::2014-10-29 11:15:44,074::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136161::DEBUG::2014-10-29 11:15:44,076::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136161::DEBUG::2014-10-29 11:15:44,077::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-17::DEBUG::2014-10-29 11:15:44,078::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-136161::DEBUG::2014-10-29 11:15:44,080::task::993::Storage.TaskManager.Task::(_decref) Task=`eb111d8d-6157-4a23-b427-562097ca58c1`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:15:44,080::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:44,082::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:44,083::__init__::232::IOProcess::(_processLogs) (200704) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:44,085::__init__::232::IOProcess::(_processLogs) (200704) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:44,088::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:44,089::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:44,089::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:44,089::__init__::232::IOProcess::(_processLogs) (200705) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:44,090::__init__::232::IOProcess::(_processLogs) (200705) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:44,091::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:44,091::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:44,092::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:44,094::__init__::232::IOProcess::(_processLogs) (200706) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:44,095::__init__::232::IOProcess::(_processLogs) (200706) Queuing response >Detector thread::DEBUG::2014-10-29 11:15:44,108::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54269 >Detector thread::DEBUG::2014-10-29 11:15:44,108::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54269 >Detector thread::DEBUG::2014-10-29 11:15:44,108::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54269 >Detector thread::DEBUG::2014-10-29 11:15:44,109::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54269) >Thread-136174::DEBUG::2014-10-29 11:15:44,148::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136174::DEBUG::2014-10-29 11:15:44,149::task::595::Storage.TaskManager.Task::(_updateState) Task=`24ac8002-fc74-4302-ac84-4a04df8c0b3c`::moving from state init -> state preparing >Thread-136174::INFO::2014-10-29 11:15:44,149::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136174::INFO::2014-10-29 11:15:44,150::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000553127', 'lastCheck': '0.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503211', 'lastCheck': '0.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00272654', 'lastCheck': '0.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000543593', 'lastCheck': '0.1', 'valid': True}} >Thread-136174::DEBUG::2014-10-29 11:15:44,150::task::1191::Storage.TaskManager.Task::(prepare) Task=`24ac8002-fc74-4302-ac84-4a04df8c0b3c`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000553127', 'lastCheck': '0.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503211', 'lastCheck': '0.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00272654', 'lastCheck': '0.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000543593', 'lastCheck': '0.1', 'valid': True}} >Thread-136174::DEBUG::2014-10-29 11:15:44,150::task::595::Storage.TaskManager.Task::(_updateState) Task=`24ac8002-fc74-4302-ac84-4a04df8c0b3c`::moving from state preparing -> state finished >Thread-136174::DEBUG::2014-10-29 11:15:44,150::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136174::DEBUG::2014-10-29 11:15:44,151::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136174::DEBUG::2014-10-29 11:15:44,151::task::993::Storage.TaskManager.Task::(_decref) Task=`24ac8002-fc74-4302-ac84-4a04df8c0b3c`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:44,911::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:44,912::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:44,915::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:46,317::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:46,323::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136175::DEBUG::2014-10-29 11:15:46,332::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:46,337::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:46,342::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136176::DEBUG::2014-10-29 11:15:46,350::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136176::DEBUG::2014-10-29 11:15:46,368::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:15:48,490::task::595::Storage.TaskManager.Task::(_updateState) Task=`240ddcfa-38fb-4ca6-b765-21cb048cf696`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:15:48,490::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:15:48,492::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:48,492::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:48,492::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:48,492::__init__::232::IOProcess::(_processLogs) (200707) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:15:48,493::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200707) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:48,495::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:48,495::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:48,495::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:48,496::__init__::232::IOProcess::(_processLogs) (200708) Got request for method 'stat' >Thread-22::INFO::2014-10-29 11:15:48,497::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010871808', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:15:48,497::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200708) Queuing response >Thread-22::DEBUG::2014-10-29 11:15:48,499::task::1191::Storage.TaskManager.Task::(prepare) Task=`240ddcfa-38fb-4ca6-b765-21cb048cf696`::finished: {'truesize': '6010871808', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:15:48,499::task::595::Storage.TaskManager.Task::(_updateState) Task=`240ddcfa-38fb-4ca6-b765-21cb048cf696`::moving from state preparing -> state finished >Thread-22::DEBUG::2014-10-29 11:15:48,499::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-10-29 11:15:48,499::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2014-10-29 11:15:48,500::task::993::Storage.TaskManager.Task::(_decref) Task=`240ddcfa-38fb-4ca6-b765-21cb048cf696`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:15:48,571::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:49,386::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:49,388::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136177::DEBUG::2014-10-29 11:15:49,392::task::595::Storage.TaskManager.Task::(_updateState) Task=`497540b9-39cc-4d6a-a386-7e1efa5cdedd`::moving from state init -> state preparing >Thread-136177::INFO::2014-10-29 11:15:49,392::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136177::INFO::2014-10-29 11:15:49,393::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000553127', 'lastCheck': '5.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503211', 'lastCheck': '5.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00272654', 'lastCheck': '5.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000543593', 'lastCheck': '5.3', 'valid': True}} >Thread-136177::DEBUG::2014-10-29 11:15:49,393::task::1191::Storage.TaskManager.Task::(prepare) Task=`497540b9-39cc-4d6a-a386-7e1efa5cdedd`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000553127', 'lastCheck': '5.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503211', 'lastCheck': '5.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00272654', 'lastCheck': '5.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000543593', 'lastCheck': '5.3', 'valid': True}} >Thread-136177::DEBUG::2014-10-29 11:15:49,394::task::595::Storage.TaskManager.Task::(_updateState) Task=`497540b9-39cc-4d6a-a386-7e1efa5cdedd`::moving from state preparing -> state finished >Thread-136177::DEBUG::2014-10-29 11:15:49,394::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136177::DEBUG::2014-10-29 11:15:49,394::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136177::DEBUG::2014-10-29 11:15:49,394::task::993::Storage.TaskManager.Task::(_decref) Task=`497540b9-39cc-4d6a-a386-7e1efa5cdedd`::ref 0 aborting False >Thread-136177::DEBUG::2014-10-29 11:15:49,427::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:49,449::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:49,452::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136178::DEBUG::2014-10-29 11:15:49,455::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136178::DEBUG::2014-10-29 11:15:49,457::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:15:49,580::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54270 >Detector thread::DEBUG::2014-10-29 11:15:49,584::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54270 >Detector thread::DEBUG::2014-10-29 11:15:49,586::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54270 >Detector thread::DEBUG::2014-10-29 11:15:49,588::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54270) >Thread-136179::DEBUG::2014-10-29 11:15:49,625::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136179::DEBUG::2014-10-29 11:15:49,628::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136179::DEBUG::2014-10-29 11:15:49,632::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '6.21', 'elapsedTime': '513982', 'displayType': 'vnc', 'cpuSys': '0.40', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '57120794', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '70095', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '47442.06'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.14', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:49,922::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:49,923::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:49,925::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:15:50,955::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54272 >Detector thread::DEBUG::2014-10-29 11:15:50,955::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54272 >Detector thread::DEBUG::2014-10-29 11:15:50,955::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54272 >Detector thread::DEBUG::2014-10-29 11:15:50,956::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54272) >Thread-136180::DEBUG::2014-10-29 11:15:50,996::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3e549b5-3cca-46f8-bc3b-8c148ea29b6e`::moving from state init -> state preparing >Thread-136180::INFO::2014-10-29 11:15:50,996::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136180::INFO::2014-10-29 11:15:50,997::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000553127', 'lastCheck': '7.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503211', 'lastCheck': '6.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00272654', 'lastCheck': '7.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000543593', 'lastCheck': '6.9', 'valid': True}} >Thread-136180::DEBUG::2014-10-29 11:15:50,997::task::1191::Storage.TaskManager.Task::(prepare) Task=`f3e549b5-3cca-46f8-bc3b-8c148ea29b6e`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000553127', 'lastCheck': '7.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503211', 'lastCheck': '6.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00272654', 'lastCheck': '7.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000543593', 'lastCheck': '6.9', 'valid': True}} >Thread-136180::DEBUG::2014-10-29 11:15:50,997::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3e549b5-3cca-46f8-bc3b-8c148ea29b6e`::moving from state preparing -> state finished >Thread-136180::DEBUG::2014-10-29 11:15:50,997::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136180::DEBUG::2014-10-29 11:15:50,998::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136180::DEBUG::2014-10-29 11:15:50,998::task::993::Storage.TaskManager.Task::(_decref) Task=`f3e549b5-3cca-46f8-bc3b-8c148ea29b6e`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:15:51,111::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54273 >Detector thread::DEBUG::2014-10-29 11:15:51,111::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54273 >Detector thread::DEBUG::2014-10-29 11:15:51,111::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54273 >Detector thread::DEBUG::2014-10-29 11:15:51,112::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54273) >Thread-136181::DEBUG::2014-10-29 11:15:51,151::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136181::DEBUG::2014-10-29 11:15:51,153::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136181::DEBUG::2014-10-29 11:15:51,175::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136181::DEBUG::2014-10-29 11:15:51,221::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '18', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '18', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:52,509::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:52,512::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136182::DEBUG::2014-10-29 11:15:52,531::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:52,535::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:52,538::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136183::DEBUG::2014-10-29 11:15:52,542::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136183::DEBUG::2014-10-29 11:15:52,545::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:15:53,928::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:53,928::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:53,929::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:53,929::__init__::232::IOProcess::(_processLogs) (200709) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:53,929::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200709) Queuing response >Thread-179::DEBUG::2014-10-29 11:15:53,931::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:15:53,948::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000519993 s, 715 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:15:53,950::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:53,951::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:53,951::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:53,951::__init__::232::IOProcess::(_processLogs) (200710) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:53,953::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200710) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:53,973::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:53,973::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:53,974::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-178::DEBUG::2014-10-29 11:15:53,976::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:15:53,976::__init__::232::IOProcess::(_processLogs) (200711) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:53,992::__init__::232::IOProcess::(_processLogs) (200711) Queuing response >Thread-178::DEBUG::2014-10-29 11:15:53,994::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000517701 s, 981 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:15:53,995::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:53,996::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:53,996::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:53,996::__init__::232::IOProcess::(_processLogs) (200712) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:53,998::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200712) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:53,999::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:53,999::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:54,000::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:54,001::__init__::232::IOProcess::(_processLogs) (200713) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:54,001::__init__::232::IOProcess::(_processLogs) (200713) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:54,002::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:54,002::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:54,002::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:54,003::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200714) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:54,004::__init__::232::IOProcess::(_processLogs) (200714) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:54,004::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:54,005::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:54,005::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:54,005::__init__::232::IOProcess::(_processLogs) (200715) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:54,006::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200715) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:54,077::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:54,078::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:54,078::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:54,078::__init__::232::IOProcess::(_processLogs) (200716) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:54,079::__init__::232::IOProcess::(_processLogs) (200716) Queuing response >Thread-10269::DEBUG::2014-10-29 11:15:54,080::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:15:54,100::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-10269::DEBUG::2014-10-29 11:15:54,101::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000498888 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:15:54,102::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:54,104::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:54,104::__init__::232::IOProcess::(_processLogs) (200717) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:54,105::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200717) Queuing response >Thread-33::DEBUG::2014-10-29 11:15:54,107::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:15:54,123::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:54,126::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:54,127::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-33::DEBUG::2014-10-29 11:15:54,127::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00052481 s, 928 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:15:54,129::__init__::232::IOProcess::(_processLogs) (200718) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:54,132::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200718) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:54,134::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:54,135::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:54,135::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:54,135::__init__::232::IOProcess::(_processLogs) (200719) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:15:54,137::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200719) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:54,138::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:54,139::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:54,139::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:54,139::__init__::232::IOProcess::(_processLogs) (200720) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:54,140::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200720) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:54,141::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:54,141::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:54,141::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:54,142::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200721) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:54,143::__init__::232::IOProcess::(_processLogs) (200721) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:54,143::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:54,144::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:54,144::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:54,145::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200722) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:54,146::__init__::232::IOProcess::(_processLogs) (200722) Queuing response >Detector thread::DEBUG::2014-10-29 11:15:54,718::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54275 >Detector thread::DEBUG::2014-10-29 11:15:54,719::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54275 >Detector thread::DEBUG::2014-10-29 11:15:54,719::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54275 >Detector thread::DEBUG::2014-10-29 11:15:54,720::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54275) >Thread-136184::DEBUG::2014-10-29 11:15:54,760::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136184::DEBUG::2014-10-29 11:15:54,761::task::595::Storage.TaskManager.Task::(_updateState) Task=`6df24f22-fdfc-4734-bba3-2011effbf1d4`::moving from state init -> state preparing >Thread-136184::INFO::2014-10-29 11:15:54,761::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136184::DEBUG::2014-10-29 11:15:54,766::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:15:54,766::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:54,767::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:54,767::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:54,767::__init__::232::IOProcess::(_processLogs) (200723) Got request for method 'glob' >Thread-136184::DEBUG::2014-10-29 11:15:54,768::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:15:54,768::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200723) Queuing response >Thread-136184::DEBUG::2014-10-29 11:15:54,770::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136184::INFO::2014-10-29 11:15:54,770::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136184::DEBUG::2014-10-29 11:15:54,771::task::1191::Storage.TaskManager.Task::(prepare) Task=`6df24f22-fdfc-4734-bba3-2011effbf1d4`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136184::DEBUG::2014-10-29 11:15:54,771::task::595::Storage.TaskManager.Task::(_updateState) Task=`6df24f22-fdfc-4734-bba3-2011effbf1d4`::moving from state preparing -> state finished >Thread-136184::DEBUG::2014-10-29 11:15:54,771::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136184::DEBUG::2014-10-29 11:15:54,771::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136184::DEBUG::2014-10-29 11:15:54,772::task::993::Storage.TaskManager.Task::(_decref) Task=`6df24f22-fdfc-4734-bba3-2011effbf1d4`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:15:54,816::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54276 >Detector thread::DEBUG::2014-10-29 11:15:54,816::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54276 >Detector thread::DEBUG::2014-10-29 11:15:54,817::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54276 >Detector thread::DEBUG::2014-10-29 11:15:54,817::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54276) >Thread-136185::DEBUG::2014-10-29 11:15:54,856::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136185::DEBUG::2014-10-29 11:15:54,856::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd64e1aa-72f9-4de5-8986-bdd1f02ef133`::moving from state init -> state preparing >Thread-136185::INFO::2014-10-29 11:15:54,857::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136185::DEBUG::2014-10-29 11:15:54,857::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136185::DEBUG::2014-10-29 11:15:54,857::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136185::DEBUG::2014-10-29 11:15:54,858::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136185::DEBUG::2014-10-29 11:15:54,858::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136185::DEBUG::2014-10-29 11:15:54,858::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136185::DEBUG::2014-10-29 11:15:54,859::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:54,930::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:54,932::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:54,933::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136185::DEBUG::2014-10-29 11:15:54,948::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136185::DEBUG::2014-10-29 11:15:54,948::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136185::DEBUG::2014-10-29 11:15:55,144::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136185::DEBUG::2014-10-29 11:15:55,145::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136185::DEBUG::2014-10-29 11:15:55,145::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136185::DEBUG::2014-10-29 11:15:55,146::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136185::DEBUG::2014-10-29 11:15:55,146::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136185::DEBUG::2014-10-29 11:15:55,146::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136185::DEBUG::2014-10-29 11:15:55,147::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136185::DEBUG::2014-10-29 11:15:55,147::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:15:55,155::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:55,158::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:55,158::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:55,158::__init__::232::IOProcess::(_processLogs) (200724) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:15:55,159::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200724) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:55,161::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:55,161::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:55,161::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:55,162::__init__::232::IOProcess::(_processLogs) (200725) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:15:55,162::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200725) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:55,164::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:55,166::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:55,168::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:55,170::__init__::232::IOProcess::(_processLogs) (200726) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:15:55,175::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200726) Queuing response >Thread-136185::DEBUG::2014-10-29 11:15:55,176::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:15:55,178::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:55,179::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:55,179::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:55,179::__init__::232::IOProcess::(_processLogs) (200727) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:15:55,180::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200727) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:55,181::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:55,181::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:55,181::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:55,181::__init__::232::IOProcess::(_processLogs) (200728) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:15:55,183::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200728) Queuing response >Thread-136185::DEBUG::2014-10-29 11:15:55,183::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:15:55,185::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:55,185::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:55,186::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:55,186::__init__::232::IOProcess::(_processLogs) (200729) Got request for method 'readfile' >Thread-136185::DEBUG::2014-10-29 11:15:55,187::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:15:55,187::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200729) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:55,189::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:55,190::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:55,190::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:55,190::__init__::232::IOProcess::(_processLogs) (200730) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:15:55,191::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200730) Queuing response >Thread-17::DEBUG::2014-10-29 11:15:55,192::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:55,192::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:55,192::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:55,193::__init__::232::IOProcess::(_processLogs) (200731) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:15:55,193::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200731) Queuing response >Thread-136185::DEBUG::2014-10-29 11:15:55,193::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-136185::INFO::2014-10-29 11:15:55,195::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136185::INFO::2014-10-29 11:15:55,195::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136185::INFO::2014-10-29 11:15:55,195::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:15:55,196::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:15:55,196::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:15:55,197::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:15:55,197::__init__::232::IOProcess::(_processLogs) (200732) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:15:55,198::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200732) Queuing response >Thread-136185::DEBUG::2014-10-29 11:15:55,198::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136185::DEBUG::2014-10-29 11:15:55,200::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`fa8129d3-a151-4858-b43a-50b18e1f3095`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136185::DEBUG::2014-10-29 11:15:55,200::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136185::DEBUG::2014-10-29 11:15:55,201::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136185::DEBUG::2014-10-29 11:15:55,201::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`fa8129d3-a151-4858-b43a-50b18e1f3095`::Granted request >Thread-136185::DEBUG::2014-10-29 11:15:55,202::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bd64e1aa-72f9-4de5-8986-bdd1f02ef133`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136185::DEBUG::2014-10-29 11:15:55,202::task::993::Storage.TaskManager.Task::(_decref) Task=`bd64e1aa-72f9-4de5-8986-bdd1f02ef133`::ref 1 aborting False >Thread-136185::INFO::2014-10-29 11:15:55,205::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136185::DEBUG::2014-10-29 11:15:55,205::task::1191::Storage.TaskManager.Task::(prepare) Task=`bd64e1aa-72f9-4de5-8986-bdd1f02ef133`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136185::DEBUG::2014-10-29 11:15:55,205::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd64e1aa-72f9-4de5-8986-bdd1f02ef133`::moving from state preparing -> state finished >Thread-136185::DEBUG::2014-10-29 11:15:55,205::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136185::DEBUG::2014-10-29 11:15:55,206::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136185::DEBUG::2014-10-29 11:15:55,206::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136185::DEBUG::2014-10-29 11:15:55,207::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136185::DEBUG::2014-10-29 11:15:55,207::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136185::DEBUG::2014-10-29 11:15:55,207::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136185::DEBUG::2014-10-29 11:15:55,207::task::993::Storage.TaskManager.Task::(_decref) Task=`bd64e1aa-72f9-4de5-8986-bdd1f02ef133`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:15:55,230::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54277 >Detector thread::DEBUG::2014-10-29 11:15:55,231::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54277 >Detector thread::DEBUG::2014-10-29 11:15:55,231::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54277 >Detector thread::DEBUG::2014-10-29 11:15:55,231::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54277) >Thread-136190::DEBUG::2014-10-29 11:15:55,270::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136190::DEBUG::2014-10-29 11:15:55,271::task::595::Storage.TaskManager.Task::(_updateState) Task=`da65bf3b-d235-4473-b48f-df0604087e04`::moving from state init -> state preparing >Thread-136190::INFO::2014-10-29 11:15:55,271::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136190::INFO::2014-10-29 11:15:55,272::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517701', 'lastCheck': '1.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052481', 'lastCheck': '1.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519993', 'lastCheck': '1.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000498888', 'lastCheck': '1.1', 'valid': True}} >Thread-136190::DEBUG::2014-10-29 11:15:55,272::task::1191::Storage.TaskManager.Task::(prepare) Task=`da65bf3b-d235-4473-b48f-df0604087e04`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517701', 'lastCheck': '1.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052481', 'lastCheck': '1.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519993', 'lastCheck': '1.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000498888', 'lastCheck': '1.1', 'valid': True}} >Thread-136190::DEBUG::2014-10-29 11:15:55,272::task::595::Storage.TaskManager.Task::(_updateState) Task=`da65bf3b-d235-4473-b48f-df0604087e04`::moving from state preparing -> state finished >Thread-136190::DEBUG::2014-10-29 11:15:55,272::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136190::DEBUG::2014-10-29 11:15:55,273::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136190::DEBUG::2014-10-29 11:15:55,273::task::993::Storage.TaskManager.Task::(_decref) Task=`da65bf3b-d235-4473-b48f-df0604087e04`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:55,563::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:55,566::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136191::DEBUG::2014-10-29 11:15:55,569::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:55,571::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:55,573::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136192::DEBUG::2014-10-29 11:15:55,576::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136192::DEBUG::2014-10-29 11:15:55,578::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:58,593::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:58,597::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136193::DEBUG::2014-10-29 11:15:58,600::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:15:58,602::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:15:58,604::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136194::DEBUG::2014-10-29 11:15:58,608::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136194::DEBUG::2014-10-29 11:15:58,610::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:15:59,793::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54278 >Detector thread::DEBUG::2014-10-29 11:15:59,793::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54278 >Detector thread::DEBUG::2014-10-29 11:15:59,794::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54278 >Detector thread::DEBUG::2014-10-29 11:15:59,794::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54278) >Thread-136195::DEBUG::2014-10-29 11:15:59,833::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136195::DEBUG::2014-10-29 11:15:59,834::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136195::DEBUG::2014-10-29 11:15:59,835::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '6.21', 'elapsedTime': '513992', 'displayType': 'vnc', 'cpuSys': '0.40', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '57120794', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '70095', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '47442.06'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.26', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:59,936::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:59,937::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:15:59,939::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:16:00,278::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54280 >Detector thread::DEBUG::2014-10-29 11:16:00,278::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54280 >Detector thread::DEBUG::2014-10-29 11:16:00,279::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54280 >Detector thread::DEBUG::2014-10-29 11:16:00,279::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54280) >Thread-136196::DEBUG::2014-10-29 11:16:00,318::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136196::DEBUG::2014-10-29 11:16:00,319::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136196::DEBUG::2014-10-29 11:16:00,338::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136196::DEBUG::2014-10-29 11:16:00,385::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '102', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '2', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:16:01,062::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54281 >Detector thread::DEBUG::2014-10-29 11:16:01,062::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54281 >Detector thread::DEBUG::2014-10-29 11:16:01,062::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54281 >Detector thread::DEBUG::2014-10-29 11:16:01,063::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54281) >Thread-136197::DEBUG::2014-10-29 11:16:01,103::task::595::Storage.TaskManager.Task::(_updateState) Task=`c439d898-a445-41f3-870e-bc3181167117`::moving from state init -> state preparing >Thread-136197::INFO::2014-10-29 11:16:01,103::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136197::INFO::2014-10-29 11:16:01,104::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517701', 'lastCheck': '7.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052481', 'lastCheck': '7.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519993', 'lastCheck': '7.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000498888', 'lastCheck': '7.0', 'valid': True}} >Thread-136197::DEBUG::2014-10-29 11:16:01,104::task::1191::Storage.TaskManager.Task::(prepare) Task=`c439d898-a445-41f3-870e-bc3181167117`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517701', 'lastCheck': '7.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052481', 'lastCheck': '7.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519993', 'lastCheck': '7.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000498888', 'lastCheck': '7.0', 'valid': True}} >Thread-136197::DEBUG::2014-10-29 11:16:01,105::task::595::Storage.TaskManager.Task::(_updateState) Task=`c439d898-a445-41f3-870e-bc3181167117`::moving from state preparing -> state finished >Thread-136197::DEBUG::2014-10-29 11:16:01,105::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136197::DEBUG::2014-10-29 11:16:01,105::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136197::DEBUG::2014-10-29 11:16:01,105::task::993::Storage.TaskManager.Task::(_decref) Task=`c439d898-a445-41f3-870e-bc3181167117`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:01,624::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:01,626::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136198::DEBUG::2014-10-29 11:16:01,629::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:01,632::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:01,634::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136199::DEBUG::2014-10-29 11:16:01,637::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136199::DEBUG::2014-10-29 11:16:01,639::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:16:03,591::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >VM Channels Listener::DEBUG::2014-10-29 11:16:03,809::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >Thread-17::DEBUG::2014-10-29 11:16:03,957::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:03,958::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:03,958::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:03,958::__init__::232::IOProcess::(_processLogs) (200733) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:03,960::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200733) Queuing response >Thread-179::DEBUG::2014-10-29 11:16:03,962::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:16:03,981::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000548607 s, 678 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:16:03,983::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:03,983::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:03,983::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:03,983::__init__::232::IOProcess::(_processLogs) (200734) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:03,984::__init__::232::IOProcess::(_processLogs) (200734) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:04,008::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:04,008::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:04,010::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-178::DEBUG::2014-10-29 11:16:04,011::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:16:04,011::__init__::232::IOProcess::(_processLogs) (200735) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:04,030::__init__::232::IOProcess::(_processLogs) (200735) Queuing response >Thread-178::DEBUG::2014-10-29 11:16:04,033::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00106384 s, 478 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:16:04,034::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:04,035::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:04,035::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:04,035::__init__::232::IOProcess::(_processLogs) (200736) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:04,037::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200736) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:04,039::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:04,039::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:04,040::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:04,040::__init__::232::IOProcess::(_processLogs) (200737) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:04,041::__init__::232::IOProcess::(_processLogs) (200737) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:04,041::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:04,042::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:04,043::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:04,043::__init__::232::IOProcess::(_processLogs) (200738) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:04,043::__init__::232::IOProcess::(_processLogs) (200738) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:04,044::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:04,045::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:04,045::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:04,046::__init__::232::IOProcess::(_processLogs) (200739) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:04,047::__init__::232::IOProcess::(_processLogs) (200739) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:04,135::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:04,135::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:04,135::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:04,136::__init__::232::IOProcess::(_processLogs) (200740) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:04,137::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200740) Queuing response >Thread-10269::DEBUG::2014-10-29 11:16:04,139::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:16:04,159::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-10269::DEBUG::2014-10-29 11:16:04,159::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000423903 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:16:04,161::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:04,162::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:04,163::__init__::232::IOProcess::(_processLogs) (200741) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:04,163::__init__::232::IOProcess::(_processLogs) (200741) Queuing response >Thread-33::DEBUG::2014-10-29 11:16:04,166::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:16:04,166::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-33::DEBUG::2014-10-29 11:16:04,186::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000524607 s, 928 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:16:04,190::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:04,192::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:04,192::__init__::232::IOProcess::(_processLogs) (200742) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:04,193::__init__::232::IOProcess::(_processLogs) (200742) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:04,193::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:04,193::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:04,195::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:04,196::__init__::232::IOProcess::(_processLogs) (200743) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:04,197::__init__::232::IOProcess::(_processLogs) (200743) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:04,197::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:04,197::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:04,198::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:04,199::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200744) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:04,199::__init__::232::IOProcess::(_processLogs) (200744) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:04,200::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:04,200::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:04,200::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:04,201::__init__::232::IOProcess::(_processLogs) (200745) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:04,201::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200745) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:04,203::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:04,203::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:04,203::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:04,203::__init__::232::IOProcess::(_processLogs) (200746) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:04,204::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200746) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:04,653::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:04,655::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136200::DEBUG::2014-10-29 11:16:04,659::task::595::Storage.TaskManager.Task::(_updateState) Task=`403cb055-fe10-42ee-9555-faf6c8ed3fa1`::moving from state init -> state preparing >Thread-136200::INFO::2014-10-29 11:16:04,660::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136200::INFO::2014-10-29 11:16:04,661::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00106384', 'lastCheck': '0.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524607', 'lastCheck': '0.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548607', 'lastCheck': '0.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000423903', 'lastCheck': '0.5', 'valid': True}} >Thread-136200::DEBUG::2014-10-29 11:16:04,661::task::1191::Storage.TaskManager.Task::(prepare) Task=`403cb055-fe10-42ee-9555-faf6c8ed3fa1`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00106384', 'lastCheck': '0.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524607', 'lastCheck': '0.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548607', 'lastCheck': '0.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000423903', 'lastCheck': '0.5', 'valid': True}} >Thread-136200::DEBUG::2014-10-29 11:16:04,661::task::595::Storage.TaskManager.Task::(_updateState) Task=`403cb055-fe10-42ee-9555-faf6c8ed3fa1`::moving from state preparing -> state finished >Thread-136200::DEBUG::2014-10-29 11:16:04,661::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136200::DEBUG::2014-10-29 11:16:04,662::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136200::DEBUG::2014-10-29 11:16:04,662::task::993::Storage.TaskManager.Task::(_decref) Task=`403cb055-fe10-42ee-9555-faf6c8ed3fa1`::ref 0 aborting False >Thread-136200::DEBUG::2014-10-29 11:16:04,694::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:04,717::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:04,720::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136201::DEBUG::2014-10-29 11:16:04,723::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136201::DEBUG::2014-10-29 11:16:04,725::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:04,946::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:04,947::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:04,948::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:16:05,858::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54283 >Detector thread::DEBUG::2014-10-29 11:16:05,859::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54283 >Detector thread::DEBUG::2014-10-29 11:16:05,859::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54283 >Detector thread::DEBUG::2014-10-29 11:16:05,860::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54283) >Thread-136202::DEBUG::2014-10-29 11:16:05,899::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136202::DEBUG::2014-10-29 11:16:05,899::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe7f5e72-e522-49ff-94f6-d98e9852c601`::moving from state init -> state preparing >Thread-136202::INFO::2014-10-29 11:16:05,900::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136202::DEBUG::2014-10-29 11:16:05,903::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:16:05,903::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:05,904::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:05,904::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:05,904::__init__::232::IOProcess::(_processLogs) (200747) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:05,904::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200747) Queuing response >Thread-136202::DEBUG::2014-10-29 11:16:05,905::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136202::DEBUG::2014-10-29 11:16:05,906::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136202::INFO::2014-10-29 11:16:05,906::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136202::DEBUG::2014-10-29 11:16:05,906::task::1191::Storage.TaskManager.Task::(prepare) Task=`fe7f5e72-e522-49ff-94f6-d98e9852c601`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136202::DEBUG::2014-10-29 11:16:05,907::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe7f5e72-e522-49ff-94f6-d98e9852c601`::moving from state preparing -> state finished >Thread-136202::DEBUG::2014-10-29 11:16:05,907::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136202::DEBUG::2014-10-29 11:16:05,907::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136202::DEBUG::2014-10-29 11:16:05,907::task::993::Storage.TaskManager.Task::(_decref) Task=`fe7f5e72-e522-49ff-94f6-d98e9852c601`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:16:05,951::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54284 >Detector thread::DEBUG::2014-10-29 11:16:05,953::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54284 >Detector thread::DEBUG::2014-10-29 11:16:05,953::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54284 >Detector thread::DEBUG::2014-10-29 11:16:05,954::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54284) >Thread-136203::DEBUG::2014-10-29 11:16:05,993::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136203::DEBUG::2014-10-29 11:16:05,993::task::595::Storage.TaskManager.Task::(_updateState) Task=`c305ec3e-ea79-4422-9c5b-9549ac4e31cc`::moving from state init -> state preparing >Thread-136203::INFO::2014-10-29 11:16:05,994::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136203::DEBUG::2014-10-29 11:16:05,994::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136203::DEBUG::2014-10-29 11:16:05,994::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136203::DEBUG::2014-10-29 11:16:05,995::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136203::DEBUG::2014-10-29 11:16:05,995::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136203::DEBUG::2014-10-29 11:16:05,995::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136203::DEBUG::2014-10-29 11:16:05,996::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136203::DEBUG::2014-10-29 11:16:06,087::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136203::DEBUG::2014-10-29 11:16:06,089::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136203::DEBUG::2014-10-29 11:16:06,260::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136203::DEBUG::2014-10-29 11:16:06,262::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136203::DEBUG::2014-10-29 11:16:06,262::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136203::DEBUG::2014-10-29 11:16:06,263::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136203::DEBUG::2014-10-29 11:16:06,263::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136203::DEBUG::2014-10-29 11:16:06,263::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136203::DEBUG::2014-10-29 11:16:06,264::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136203::DEBUG::2014-10-29 11:16:06,264::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:16:06,271::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:06,273::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:06,273::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:06,273::__init__::232::IOProcess::(_processLogs) (200748) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:06,275::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200748) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:06,276::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:06,276::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:06,277::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:06,277::__init__::232::IOProcess::(_processLogs) (200749) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:06,278::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200749) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:06,279::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:06,281::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:06,283::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:06,284::__init__::232::IOProcess::(_processLogs) (200750) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:06,285::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200750) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:06,289::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:06,290::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-136203::DEBUG::2014-10-29 11:16:06,292::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:16:06,293::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:06,294::__init__::232::IOProcess::(_processLogs) (200751) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:06,295::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200751) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:06,296::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:06,297::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:06,297::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:06,297::__init__::232::IOProcess::(_processLogs) (200752) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:16:06,298::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200752) Queuing response >Thread-136203::DEBUG::2014-10-29 11:16:06,298::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:16:06,299::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:06,300::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:06,300::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:06,300::__init__::232::IOProcess::(_processLogs) (200753) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:16:06,301::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200753) Queuing response >Thread-136203::DEBUG::2014-10-29 11:16:06,301::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:16:06,303::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:06,304::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:06,304::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:06,305::__init__::232::IOProcess::(_processLogs) (200754) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:06,305::__init__::232::IOProcess::(_processLogs) (200754) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:06,306::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:06,306::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:06,306::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:06,307::__init__::232::IOProcess::(_processLogs) (200755) Got request for method 'glob' >Thread-136203::DEBUG::2014-10-29 11:16:06,307::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:16:06,307::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200755) Queuing response >Thread-136203::INFO::2014-10-29 11:16:06,308::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136203::INFO::2014-10-29 11:16:06,309::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136203::INFO::2014-10-29 11:16:06,310::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:16:06,310::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:06,311::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:06,311::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:06,311::__init__::232::IOProcess::(_processLogs) (200756) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:16:06,312::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200756) Queuing response >Thread-136203::DEBUG::2014-10-29 11:16:06,312::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136203::DEBUG::2014-10-29 11:16:06,315::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`e3888ef4-f0be-414b-b10c-8857d7def06a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136203::DEBUG::2014-10-29 11:16:06,315::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136203::DEBUG::2014-10-29 11:16:06,315::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136203::DEBUG::2014-10-29 11:16:06,316::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`e3888ef4-f0be-414b-b10c-8857d7def06a`::Granted request >Thread-136203::DEBUG::2014-10-29 11:16:06,316::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c305ec3e-ea79-4422-9c5b-9549ac4e31cc`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136203::DEBUG::2014-10-29 11:16:06,317::task::993::Storage.TaskManager.Task::(_decref) Task=`c305ec3e-ea79-4422-9c5b-9549ac4e31cc`::ref 1 aborting False >Thread-136203::INFO::2014-10-29 11:16:06,319::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136203::DEBUG::2014-10-29 11:16:06,320::task::1191::Storage.TaskManager.Task::(prepare) Task=`c305ec3e-ea79-4422-9c5b-9549ac4e31cc`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136203::DEBUG::2014-10-29 11:16:06,320::task::595::Storage.TaskManager.Task::(_updateState) Task=`c305ec3e-ea79-4422-9c5b-9549ac4e31cc`::moving from state preparing -> state finished >Thread-136203::DEBUG::2014-10-29 11:16:06,320::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136203::DEBUG::2014-10-29 11:16:06,320::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136203::DEBUG::2014-10-29 11:16:06,321::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136203::DEBUG::2014-10-29 11:16:06,321::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136203::DEBUG::2014-10-29 11:16:06,321::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136203::DEBUG::2014-10-29 11:16:06,322::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136203::DEBUG::2014-10-29 11:16:06,322::task::993::Storage.TaskManager.Task::(_decref) Task=`c305ec3e-ea79-4422-9c5b-9549ac4e31cc`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:16:06,356::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54285 >Detector thread::DEBUG::2014-10-29 11:16:06,357::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54285 >Detector thread::DEBUG::2014-10-29 11:16:06,357::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54285 >Detector thread::DEBUG::2014-10-29 11:16:06,358::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54285) >Thread-136208::DEBUG::2014-10-29 11:16:06,396::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136208::DEBUG::2014-10-29 11:16:06,397::task::595::Storage.TaskManager.Task::(_updateState) Task=`17907341-4219-4d48-8efa-5603d7cb7bec`::moving from state init -> state preparing >Thread-136208::INFO::2014-10-29 11:16:06,397::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136208::INFO::2014-10-29 11:16:06,398::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00106384', 'lastCheck': '2.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524607', 'lastCheck': '2.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548607', 'lastCheck': '2.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000423903', 'lastCheck': '2.2', 'valid': True}} >Thread-136208::DEBUG::2014-10-29 11:16:06,398::task::1191::Storage.TaskManager.Task::(prepare) Task=`17907341-4219-4d48-8efa-5603d7cb7bec`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00106384', 'lastCheck': '2.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524607', 'lastCheck': '2.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548607', 'lastCheck': '2.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000423903', 'lastCheck': '2.2', 'valid': True}} >Thread-136208::DEBUG::2014-10-29 11:16:06,398::task::595::Storage.TaskManager.Task::(_updateState) Task=`17907341-4219-4d48-8efa-5603d7cb7bec`::moving from state preparing -> state finished >Thread-136208::DEBUG::2014-10-29 11:16:06,398::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136208::DEBUG::2014-10-29 11:16:06,399::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136208::DEBUG::2014-10-29 11:16:06,399::task::993::Storage.TaskManager.Task::(_decref) Task=`17907341-4219-4d48-8efa-5603d7cb7bec`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:07,779::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:07,783::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136209::DEBUG::2014-10-29 11:16:07,788::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:07,791::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:07,792::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136210::DEBUG::2014-10-29 11:16:07,796::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136210::DEBUG::2014-10-29 11:16:07,799::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:09,954::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:09,956::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:09,959::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:16:09,995::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54286 >Detector thread::DEBUG::2014-10-29 11:16:09,996::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54286 >Detector thread::DEBUG::2014-10-29 11:16:09,996::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54286 >Detector thread::DEBUG::2014-10-29 11:16:09,997::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54286) >Thread-136211::DEBUG::2014-10-29 11:16:10,035::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136211::DEBUG::2014-10-29 11:16:10,036::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136211::DEBUG::2014-10-29 11:16:10,037::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.77', 'elapsedTime': '514002', 'displayType': 'vnc', 'cpuSys': '1.06', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '57120794', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '70095', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '47442.06'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.44', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:16:10,428::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54288 >Detector thread::DEBUG::2014-10-29 11:16:10,428::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54288 >Detector thread::DEBUG::2014-10-29 11:16:10,429::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54288 >Detector thread::DEBUG::2014-10-29 11:16:10,429::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54288) >Thread-136212::DEBUG::2014-10-29 11:16:10,468::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136212::DEBUG::2014-10-29 11:16:10,470::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136212::DEBUG::2014-10-29 11:16:10,491::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136212::DEBUG::2014-10-29 11:16:10,537::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '87', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '87', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:10,820::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:10,822::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136213::DEBUG::2014-10-29 11:16:10,826::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:10,828::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:10,829::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136214::DEBUG::2014-10-29 11:16:10,832::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136214::DEBUG::2014-10-29 11:16:10,835::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:16:11,158::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54289 >Detector thread::DEBUG::2014-10-29 11:16:11,160::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54289 >Detector thread::DEBUG::2014-10-29 11:16:11,160::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54289 >Detector thread::DEBUG::2014-10-29 11:16:11,161::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54289) >Thread-136215::DEBUG::2014-10-29 11:16:11,200::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ad984da-a8fb-46b0-87eb-85ca1f21e21d`::moving from state init -> state preparing >Thread-136215::INFO::2014-10-29 11:16:11,200::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136215::INFO::2014-10-29 11:16:11,201::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00106384', 'lastCheck': '7.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524607', 'lastCheck': '7.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548607', 'lastCheck': '7.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000423903', 'lastCheck': '7.0', 'valid': True}} >Thread-136215::DEBUG::2014-10-29 11:16:11,201::task::1191::Storage.TaskManager.Task::(prepare) Task=`4ad984da-a8fb-46b0-87eb-85ca1f21e21d`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00106384', 'lastCheck': '7.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524607', 'lastCheck': '7.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548607', 'lastCheck': '7.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000423903', 'lastCheck': '7.0', 'valid': True}} >Thread-136215::DEBUG::2014-10-29 11:16:11,202::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ad984da-a8fb-46b0-87eb-85ca1f21e21d`::moving from state preparing -> state finished >Thread-136215::DEBUG::2014-10-29 11:16:11,202::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136215::DEBUG::2014-10-29 11:16:11,202::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136215::DEBUG::2014-10-29 11:16:11,202::task::993::Storage.TaskManager.Task::(_decref) Task=`4ad984da-a8fb-46b0-87eb-85ca1f21e21d`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:13,850::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:13,852::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136216::DEBUG::2014-10-29 11:16:13,856::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:13,859::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:13,860::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136217::DEBUG::2014-10-29 11:16:13,864::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136217::DEBUG::2014-10-29 11:16:13,866::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:16:13,989::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:13,989::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:13,989::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:13,989::__init__::232::IOProcess::(_processLogs) (200757) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:13,990::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200757) Queuing response >Thread-179::DEBUG::2014-10-29 11:16:13,992::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:16:14,009::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000539627 s, 689 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:16:14,011::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:14,011::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:14,011::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:14,012::__init__::232::IOProcess::(_processLogs) (200758) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:14,012::__init__::232::IOProcess::(_processLogs) (200758) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:14,047::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:14,048::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:14,048::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:14,048::__init__::232::IOProcess::(_processLogs) (200759) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:14,050::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200759) Queuing response >Thread-178::DEBUG::2014-10-29 11:16:14,051::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:16:14,068::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000452194 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:16:14,070::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:14,070::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:14,072::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:14,073::__init__::232::IOProcess::(_processLogs) (200760) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:14,073::__init__::232::IOProcess::(_processLogs) (200760) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:14,074::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:14,074::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:14,075::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:14,075::__init__::232::IOProcess::(_processLogs) (200761) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:14,075::__init__::232::IOProcess::(_processLogs) (200761) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:14,076::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:14,077::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:14,077::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:14,078::__init__::232::IOProcess::(_processLogs) (200762) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:14,078::__init__::232::IOProcess::(_processLogs) (200762) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:14,079::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:14,079::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:14,080::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:14,080::__init__::232::IOProcess::(_processLogs) (200763) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:14,081::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200763) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:14,193::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:14,193::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:14,194::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:14,194::__init__::232::IOProcess::(_processLogs) (200764) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:14,195::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200764) Queuing response >Thread-10269::DEBUG::2014-10-29 11:16:14,197::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:16:14,218::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000445043 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:16:14,219::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:14,221::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:14,221::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:14,222::__init__::232::IOProcess::(_processLogs) (200765) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:14,223::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200765) Queuing response >Thread-33::DEBUG::2014-10-29 11:16:14,225::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:16:14,242::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:14,244::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-33::DEBUG::2014-10-29 11:16:14,246::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000425967 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:16:14,247::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:14,249::__init__::232::IOProcess::(_processLogs) (200766) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:14,251::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200766) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:14,254::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:14,254::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:14,254::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:14,254::__init__::232::IOProcess::(_processLogs) (200767) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:14,256::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200767) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:14,257::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:14,258::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:14,258::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:14,258::__init__::232::IOProcess::(_processLogs) (200768) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:14,259::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200768) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:14,260::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:14,261::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:14,261::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:14,261::__init__::232::IOProcess::(_processLogs) (200769) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:14,261::__init__::232::IOProcess::(_processLogs) (200769) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:14,263::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:14,264::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:14,265::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:14,265::__init__::232::IOProcess::(_processLogs) (200770) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:14,266::__init__::232::IOProcess::(_processLogs) (200770) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:14,966::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:14,968::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:14,969::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:16,887::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:16,894::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136218::DEBUG::2014-10-29 11:16:16,902::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:16,947::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:16,952::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136219::DEBUG::2014-10-29 11:16:16,960::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136219::DEBUG::2014-10-29 11:16:16,976::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:16:17,013::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54291 >Detector thread::DEBUG::2014-10-29 11:16:17,014::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54291 >Detector thread::DEBUG::2014-10-29 11:16:17,015::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54291 >Detector thread::DEBUG::2014-10-29 11:16:17,015::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54291) >Thread-136220::DEBUG::2014-10-29 11:16:17,055::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136220::DEBUG::2014-10-29 11:16:17,056::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc6522ef-12f4-42e5-a6bf-8d0dd7438815`::moving from state init -> state preparing >Thread-136220::INFO::2014-10-29 11:16:17,056::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136220::DEBUG::2014-10-29 11:16:17,060::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:16:17,060::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:17,061::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:17,061::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:17,061::__init__::232::IOProcess::(_processLogs) (200771) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:17,062::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200771) Queuing response >Thread-136220::DEBUG::2014-10-29 11:16:17,062::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136220::DEBUG::2014-10-29 11:16:17,064::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136220::INFO::2014-10-29 11:16:17,064::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136220::DEBUG::2014-10-29 11:16:17,064::task::1191::Storage.TaskManager.Task::(prepare) Task=`cc6522ef-12f4-42e5-a6bf-8d0dd7438815`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136220::DEBUG::2014-10-29 11:16:17,064::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc6522ef-12f4-42e5-a6bf-8d0dd7438815`::moving from state preparing -> state finished >Thread-136220::DEBUG::2014-10-29 11:16:17,065::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136220::DEBUG::2014-10-29 11:16:17,065::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136220::DEBUG::2014-10-29 11:16:17,065::task::993::Storage.TaskManager.Task::(_decref) Task=`cc6522ef-12f4-42e5-a6bf-8d0dd7438815`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:16:17,109::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54292 >Detector thread::DEBUG::2014-10-29 11:16:17,110::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54292 >Detector thread::DEBUG::2014-10-29 11:16:17,110::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54292 >Detector thread::DEBUG::2014-10-29 11:16:17,111::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54292) >Thread-136221::DEBUG::2014-10-29 11:16:17,150::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136221::DEBUG::2014-10-29 11:16:17,150::task::595::Storage.TaskManager.Task::(_updateState) Task=`56559d49-b8eb-4e0b-b864-79a2b7143dd8`::moving from state init -> state preparing >Thread-136221::INFO::2014-10-29 11:16:17,151::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136221::DEBUG::2014-10-29 11:16:17,151::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136221::DEBUG::2014-10-29 11:16:17,151::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136221::DEBUG::2014-10-29 11:16:17,152::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136221::DEBUG::2014-10-29 11:16:17,152::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136221::DEBUG::2014-10-29 11:16:17,152::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136221::DEBUG::2014-10-29 11:16:17,153::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136221::DEBUG::2014-10-29 11:16:17,239::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136221::DEBUG::2014-10-29 11:16:17,240::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136221::DEBUG::2014-10-29 11:16:17,426::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136221::DEBUG::2014-10-29 11:16:17,427::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136221::DEBUG::2014-10-29 11:16:17,428::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136221::DEBUG::2014-10-29 11:16:17,428::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136221::DEBUG::2014-10-29 11:16:17,428::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136221::DEBUG::2014-10-29 11:16:17,429::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136221::DEBUG::2014-10-29 11:16:17,429::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136221::DEBUG::2014-10-29 11:16:17,429::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:16:17,438::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:17,440::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:17,440::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:17,440::__init__::232::IOProcess::(_processLogs) (200772) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:17,441::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200772) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:17,443::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:17,443::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:17,443::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:17,444::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:17,444::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:17,444::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:17,445::__init__::232::IOProcess::(_processLogs) (200773) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:17,445::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:17,445::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:17,445::__init__::232::IOProcess::(_processLogs) (200774) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:17,446::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200773) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:17,448::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:17,450::__init__::232::IOProcess::(_processLogs) (200775) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:17,452::__init__::232::IOProcess::(_processLogs) (200774) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:17,454::__init__::232::IOProcess::(_processLogs) (200775) Queuing response >Thread-136221::DEBUG::2014-10-29 11:16:17,458::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:16:17,463::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:17,464::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:17,464::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:17,464::__init__::232::IOProcess::(_processLogs) (200776) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:16:17,468::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200776) Queuing response >Thread-136221::DEBUG::2014-10-29 11:16:17,469::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:16:17,470::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:17,471::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:17,471::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:17,471::__init__::232::IOProcess::(_processLogs) (200777) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:16:17,472::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200777) Queuing response >Thread-136221::DEBUG::2014-10-29 11:16:17,473::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:16:17,474::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:17,475::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:17,476::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:17,476::__init__::232::IOProcess::(_processLogs) (200778) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:17,476::__init__::232::IOProcess::(_processLogs) (200778) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:17,477::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:17,477::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:17,477::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:17,478::__init__::232::IOProcess::(_processLogs) (200779) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:17,478::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200779) Queuing response >Thread-136221::DEBUG::2014-10-29 11:16:17,479::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-136221::INFO::2014-10-29 11:16:17,480::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136221::INFO::2014-10-29 11:16:17,481::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136221::INFO::2014-10-29 11:16:17,481::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:16:17,482::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:17,482::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:17,482::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:17,482::__init__::232::IOProcess::(_processLogs) (200780) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:16:17,483::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200780) Queuing response >Thread-136221::DEBUG::2014-10-29 11:16:17,484::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136221::DEBUG::2014-10-29 11:16:17,486::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`89834f3a-0e39-465b-8c8d-ee76138d75e4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136221::DEBUG::2014-10-29 11:16:17,486::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136221::DEBUG::2014-10-29 11:16:17,486::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136221::DEBUG::2014-10-29 11:16:17,487::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`89834f3a-0e39-465b-8c8d-ee76138d75e4`::Granted request >Thread-136221::DEBUG::2014-10-29 11:16:17,487::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`56559d49-b8eb-4e0b-b864-79a2b7143dd8`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136221::DEBUG::2014-10-29 11:16:17,488::task::993::Storage.TaskManager.Task::(_decref) Task=`56559d49-b8eb-4e0b-b864-79a2b7143dd8`::ref 1 aborting False >Thread-136221::INFO::2014-10-29 11:16:17,490::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136221::DEBUG::2014-10-29 11:16:17,491::task::1191::Storage.TaskManager.Task::(prepare) Task=`56559d49-b8eb-4e0b-b864-79a2b7143dd8`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136221::DEBUG::2014-10-29 11:16:17,491::task::595::Storage.TaskManager.Task::(_updateState) Task=`56559d49-b8eb-4e0b-b864-79a2b7143dd8`::moving from state preparing -> state finished >Thread-136221::DEBUG::2014-10-29 11:16:17,491::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136221::DEBUG::2014-10-29 11:16:17,492::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136221::DEBUG::2014-10-29 11:16:17,492::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136221::DEBUG::2014-10-29 11:16:17,492::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136221::DEBUG::2014-10-29 11:16:17,493::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136221::DEBUG::2014-10-29 11:16:17,493::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136221::DEBUG::2014-10-29 11:16:17,493::task::993::Storage.TaskManager.Task::(_decref) Task=`56559d49-b8eb-4e0b-b864-79a2b7143dd8`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:16:17,516::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54293 >Detector thread::DEBUG::2014-10-29 11:16:17,516::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54293 >Detector thread::DEBUG::2014-10-29 11:16:17,517::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54293 >Detector thread::DEBUG::2014-10-29 11:16:17,517::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54293) >Thread-136226::DEBUG::2014-10-29 11:16:17,556::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136226::DEBUG::2014-10-29 11:16:17,557::task::595::Storage.TaskManager.Task::(_updateState) Task=`361fe85d-4fb8-4aad-9260-027cd2ea470c`::moving from state init -> state preparing >Thread-136226::INFO::2014-10-29 11:16:17,557::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136226::INFO::2014-10-29 11:16:17,558::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000452194', 'lastCheck': '3.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425967', 'lastCheck': '3.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539627', 'lastCheck': '3.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000445043', 'lastCheck': '3.3', 'valid': True}} >Thread-136226::DEBUG::2014-10-29 11:16:17,558::task::1191::Storage.TaskManager.Task::(prepare) Task=`361fe85d-4fb8-4aad-9260-027cd2ea470c`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000452194', 'lastCheck': '3.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425967', 'lastCheck': '3.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539627', 'lastCheck': '3.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000445043', 'lastCheck': '3.3', 'valid': True}} >Thread-136226::DEBUG::2014-10-29 11:16:17,558::task::595::Storage.TaskManager.Task::(_updateState) Task=`361fe85d-4fb8-4aad-9260-027cd2ea470c`::moving from state preparing -> state finished >Thread-136226::DEBUG::2014-10-29 11:16:17,558::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136226::DEBUG::2014-10-29 11:16:17,559::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136226::DEBUG::2014-10-29 11:16:17,559::task::993::Storage.TaskManager.Task::(_decref) Task=`361fe85d-4fb8-4aad-9260-027cd2ea470c`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:16:18,616::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:19,976::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:19,977::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:19,980::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:19,993::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:19,995::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136227::DEBUG::2014-10-29 11:16:19,999::task::595::Storage.TaskManager.Task::(_updateState) Task=`48b54952-67f1-4a09-93c5-20adaf87b7e1`::moving from state init -> state preparing >Thread-136227::INFO::2014-10-29 11:16:20,000::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136227::INFO::2014-10-29 11:16:20,000::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000452194', 'lastCheck': '5.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425967', 'lastCheck': '5.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539627', 'lastCheck': '6.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000445043', 'lastCheck': '5.7', 'valid': True}} >Thread-136227::DEBUG::2014-10-29 11:16:20,001::task::1191::Storage.TaskManager.Task::(prepare) Task=`48b54952-67f1-4a09-93c5-20adaf87b7e1`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000452194', 'lastCheck': '5.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425967', 'lastCheck': '5.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539627', 'lastCheck': '6.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000445043', 'lastCheck': '5.7', 'valid': True}} >Thread-136227::DEBUG::2014-10-29 11:16:20,001::task::595::Storage.TaskManager.Task::(_updateState) Task=`48b54952-67f1-4a09-93c5-20adaf87b7e1`::moving from state preparing -> state finished >Thread-136227::DEBUG::2014-10-29 11:16:20,001::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136227::DEBUG::2014-10-29 11:16:20,001::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136227::DEBUG::2014-10-29 11:16:20,002::task::993::Storage.TaskManager.Task::(_decref) Task=`48b54952-67f1-4a09-93c5-20adaf87b7e1`::ref 0 aborting False >Thread-136227::DEBUG::2014-10-29 11:16:20,024::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:20,047::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:20,049::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136228::DEBUG::2014-10-29 11:16:20,052::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136228::DEBUG::2014-10-29 11:16:20,055::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:16:20,187::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54294 >Detector thread::DEBUG::2014-10-29 11:16:20,188::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54294 >Detector thread::DEBUG::2014-10-29 11:16:20,188::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54294 >Detector thread::DEBUG::2014-10-29 11:16:20,189::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54294) >Thread-136229::DEBUG::2014-10-29 11:16:20,227::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136229::DEBUG::2014-10-29 11:16:20,228::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136229::DEBUG::2014-10-29 11:16:20,229::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.55', 'elapsedTime': '514012', 'displayType': 'vnc', 'cpuSys': '0.80', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '57120794', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '70095', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '47442.06'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.63', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:16:20,281::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54295 >Detector thread::DEBUG::2014-10-29 11:16:20,282::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54295 >Detector thread::DEBUG::2014-10-29 11:16:20,282::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54295 >Detector thread::DEBUG::2014-10-29 11:16:20,283::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54295) >Thread-136230::DEBUG::2014-10-29 11:16:20,323::task::595::Storage.TaskManager.Task::(_updateState) Task=`c1b2e43b-01d5-427f-ad3e-d6cf05eeec92`::moving from state init -> state preparing >Thread-136230::INFO::2014-10-29 11:16:20,323::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136230::INFO::2014-10-29 11:16:20,324::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000452194', 'lastCheck': '6.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425967', 'lastCheck': '6.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539627', 'lastCheck': '6.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000445043', 'lastCheck': '6.1', 'valid': True}} >Thread-136230::DEBUG::2014-10-29 11:16:20,324::task::1191::Storage.TaskManager.Task::(prepare) Task=`c1b2e43b-01d5-427f-ad3e-d6cf05eeec92`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000452194', 'lastCheck': '6.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425967', 'lastCheck': '6.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539627', 'lastCheck': '6.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000445043', 'lastCheck': '6.1', 'valid': True}} >Thread-136230::DEBUG::2014-10-29 11:16:20,324::task::595::Storage.TaskManager.Task::(_updateState) Task=`c1b2e43b-01d5-427f-ad3e-d6cf05eeec92`::moving from state preparing -> state finished >Thread-136230::DEBUG::2014-10-29 11:16:20,325::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136230::DEBUG::2014-10-29 11:16:20,325::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136230::DEBUG::2014-10-29 11:16:20,325::task::993::Storage.TaskManager.Task::(_decref) Task=`c1b2e43b-01d5-427f-ad3e-d6cf05eeec92`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:16:20,587::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54297 >Detector thread::DEBUG::2014-10-29 11:16:20,587::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54297 >Detector thread::DEBUG::2014-10-29 11:16:20,588::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54297 >Detector thread::DEBUG::2014-10-29 11:16:20,588::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54297) >Thread-136231::DEBUG::2014-10-29 11:16:20,627::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136231::DEBUG::2014-10-29 11:16:20,628::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136231::DEBUG::2014-10-29 11:16:20,646::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136231::DEBUG::2014-10-29 11:16:20,693::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '71', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '71', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:23,104::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:23,109::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136232::DEBUG::2014-10-29 11:16:23,113::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:23,117::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:23,118::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136233::DEBUG::2014-10-29 11:16:23,121::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136233::DEBUG::2014-10-29 11:16:23,126::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:16:24,017::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:24,017::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:24,018::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:24,018::__init__::232::IOProcess::(_processLogs) (200781) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:24,020::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200781) Queuing response >Thread-179::DEBUG::2014-10-29 11:16:24,022::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:16:24,045::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000563349 s, 660 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:16:24,047::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:24,047::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:24,049::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:24,050::__init__::232::IOProcess::(_processLogs) (200782) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:24,050::__init__::232::IOProcess::(_processLogs) (200782) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:24,083::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:24,083::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:24,083::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:24,084::__init__::232::IOProcess::(_processLogs) (200783) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:24,085::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200783) Queuing response >Thread-178::DEBUG::2014-10-29 11:16:24,087::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:16:24,104::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000505915 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:16:24,105::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:24,106::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:24,106::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:24,106::__init__::232::IOProcess::(_processLogs) (200784) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:24,108::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200784) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:24,109::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:24,110::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:24,110::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:24,110::__init__::232::IOProcess::(_processLogs) (200785) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:24,110::__init__::232::IOProcess::(_processLogs) (200785) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:24,112::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:24,112::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:24,112::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:24,112::__init__::232::IOProcess::(_processLogs) (200786) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:24,113::__init__::232::IOProcess::(_processLogs) (200786) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:24,114::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:24,115::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:24,115::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:24,116::__init__::232::IOProcess::(_processLogs) (200787) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:24,117::__init__::232::IOProcess::(_processLogs) (200787) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:24,254::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:24,254::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:24,256::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-10269::DEBUG::2014-10-29 11:16:24,257::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:16:24,258::__init__::232::IOProcess::(_processLogs) (200788) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:24,278::__init__::232::IOProcess::(_processLogs) (200788) Queuing response >Thread-10269::DEBUG::2014-10-29 11:16:24,280::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000427004 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:16:24,283::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:24,283::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:24,283::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:24,284::__init__::232::IOProcess::(_processLogs) (200789) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:24,285::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200789) Queuing response >Thread-33::DEBUG::2014-10-29 11:16:24,287::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:16:24,287::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:24,304::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-33::DEBUG::2014-10-29 11:16:24,306::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000682381 s, 714 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:16:24,309::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:24,312::__init__::232::IOProcess::(_processLogs) (200790) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:24,312::__init__::232::IOProcess::(_processLogs) (200790) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:24,313::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:24,313::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:24,315::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:24,316::__init__::232::IOProcess::(_processLogs) (200791) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:24,317::__init__::232::IOProcess::(_processLogs) (200791) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:24,317::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:24,318::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:24,319::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:24,320::__init__::232::IOProcess::(_processLogs) (200792) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:24,320::__init__::232::IOProcess::(_processLogs) (200792) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:24,320::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:24,321::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:24,321::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:24,322::__init__::232::IOProcess::(_processLogs) (200793) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:24,322::__init__::232::IOProcess::(_processLogs) (200793) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:24,323::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:24,323::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:24,324::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:24,324::__init__::232::IOProcess::(_processLogs) (200794) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:24,325::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200794) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:24,988::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:24,989::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:24,991::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:26,145::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:26,148::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136234::DEBUG::2014-10-29 11:16:26,152::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:26,156::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:26,158::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136235::DEBUG::2014-10-29 11:16:26,162::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136235::DEBUG::2014-10-29 11:16:26,165::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:16:28,143::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54299 >Detector thread::DEBUG::2014-10-29 11:16:28,145::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54299 >Detector thread::DEBUG::2014-10-29 11:16:28,145::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54299 >Detector thread::DEBUG::2014-10-29 11:16:28,146::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54299) >Thread-136236::DEBUG::2014-10-29 11:16:28,186::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136236::DEBUG::2014-10-29 11:16:28,187::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f66a847-0e6f-48a2-94d6-8a40fb727d0f`::moving from state init -> state preparing >Thread-136236::INFO::2014-10-29 11:16:28,187::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136236::DEBUG::2014-10-29 11:16:28,190::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:16:28,191::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:28,192::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:28,192::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:28,192::__init__::232::IOProcess::(_processLogs) (200795) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:28,200::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200795) Queuing response >Thread-136236::DEBUG::2014-10-29 11:16:28,206::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136236::DEBUG::2014-10-29 11:16:28,207::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136236::INFO::2014-10-29 11:16:28,208::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136236::DEBUG::2014-10-29 11:16:28,209::task::1191::Storage.TaskManager.Task::(prepare) Task=`8f66a847-0e6f-48a2-94d6-8a40fb727d0f`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136236::DEBUG::2014-10-29 11:16:28,209::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f66a847-0e6f-48a2-94d6-8a40fb727d0f`::moving from state preparing -> state finished >Thread-136236::DEBUG::2014-10-29 11:16:28,209::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136236::DEBUG::2014-10-29 11:16:28,210::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136236::DEBUG::2014-10-29 11:16:28,210::task::993::Storage.TaskManager.Task::(_decref) Task=`8f66a847-0e6f-48a2-94d6-8a40fb727d0f`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:16:28,276::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54300 >Detector thread::DEBUG::2014-10-29 11:16:28,276::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54300 >Detector thread::DEBUG::2014-10-29 11:16:28,277::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54300 >Detector thread::DEBUG::2014-10-29 11:16:28,277::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54300) >Thread-136237::DEBUG::2014-10-29 11:16:28,316::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136237::DEBUG::2014-10-29 11:16:28,317::task::595::Storage.TaskManager.Task::(_updateState) Task=`4cd9e95c-c077-45fe-9985-f47ce0eb0884`::moving from state init -> state preparing >Thread-136237::INFO::2014-10-29 11:16:28,317::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136237::DEBUG::2014-10-29 11:16:28,318::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136237::DEBUG::2014-10-29 11:16:28,318::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136237::DEBUG::2014-10-29 11:16:28,318::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136237::DEBUG::2014-10-29 11:16:28,318::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136237::DEBUG::2014-10-29 11:16:28,319::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136237::DEBUG::2014-10-29 11:16:28,319::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136237::DEBUG::2014-10-29 11:16:28,409::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136237::DEBUG::2014-10-29 11:16:28,411::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136237::DEBUG::2014-10-29 11:16:28,580::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136237::DEBUG::2014-10-29 11:16:28,581::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136237::DEBUG::2014-10-29 11:16:28,582::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136237::DEBUG::2014-10-29 11:16:28,582::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136237::DEBUG::2014-10-29 11:16:28,582::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136237::DEBUG::2014-10-29 11:16:28,583::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136237::DEBUG::2014-10-29 11:16:28,583::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136237::DEBUG::2014-10-29 11:16:28,584::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:16:28,589::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:28,593::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:28,593::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:28,593::__init__::232::IOProcess::(_processLogs) (200796) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:28,594::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200796) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:28,596::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:28,596::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:28,596::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:28,597::__init__::232::IOProcess::(_processLogs) (200797) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:28,597::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200797) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:28,599::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:28,600::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:28,602::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:28,604::__init__::232::IOProcess::(_processLogs) (200798) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:28,607::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200798) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:28,611::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-136237::DEBUG::2014-10-29 11:16:28,612::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:16:28,613::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:28,614::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:28,614::__init__::232::IOProcess::(_processLogs) (200799) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:28,615::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200799) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:28,616::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:28,617::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:28,617::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:28,617::__init__::232::IOProcess::(_processLogs) (200800) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:16:28,620::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200800) Queuing response >Thread-136237::DEBUG::2014-10-29 11:16:28,620::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:16:28,622::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:28,622::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:28,623::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:28,623::__init__::232::IOProcess::(_processLogs) (200801) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:16:28,624::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200801) Queuing response >Thread-136237::DEBUG::2014-10-29 11:16:28,624::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:16:28,626::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:28,626::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:28,627::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:28,628::__init__::232::IOProcess::(_processLogs) (200802) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:28,628::__init__::232::IOProcess::(_processLogs) (200802) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:28,628::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:28,629::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:28,629::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:28,629::__init__::232::IOProcess::(_processLogs) (200803) Got request for method 'glob' >Thread-136237::DEBUG::2014-10-29 11:16:28,630::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:16:28,630::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200803) Queuing response >Thread-136237::INFO::2014-10-29 11:16:28,631::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136237::INFO::2014-10-29 11:16:28,632::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136237::INFO::2014-10-29 11:16:28,632::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:16:28,633::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:28,633::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:28,633::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:28,634::__init__::232::IOProcess::(_processLogs) (200804) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:16:28,634::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200804) Queuing response >Thread-136237::DEBUG::2014-10-29 11:16:28,635::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136237::DEBUG::2014-10-29 11:16:28,636::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`81c6edae-77b9-4fec-9a3f-27d893e83f55`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136237::DEBUG::2014-10-29 11:16:28,636::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136237::DEBUG::2014-10-29 11:16:28,637::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136237::DEBUG::2014-10-29 11:16:28,637::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`81c6edae-77b9-4fec-9a3f-27d893e83f55`::Granted request >Thread-136237::DEBUG::2014-10-29 11:16:28,638::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4cd9e95c-c077-45fe-9985-f47ce0eb0884`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136237::DEBUG::2014-10-29 11:16:28,638::task::993::Storage.TaskManager.Task::(_decref) Task=`4cd9e95c-c077-45fe-9985-f47ce0eb0884`::ref 1 aborting False >Thread-136237::INFO::2014-10-29 11:16:28,641::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136237::DEBUG::2014-10-29 11:16:28,641::task::1191::Storage.TaskManager.Task::(prepare) Task=`4cd9e95c-c077-45fe-9985-f47ce0eb0884`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136237::DEBUG::2014-10-29 11:16:28,641::task::595::Storage.TaskManager.Task::(_updateState) Task=`4cd9e95c-c077-45fe-9985-f47ce0eb0884`::moving from state preparing -> state finished >Thread-136237::DEBUG::2014-10-29 11:16:28,641::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136237::DEBUG::2014-10-29 11:16:28,642::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136237::DEBUG::2014-10-29 11:16:28,642::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136237::DEBUG::2014-10-29 11:16:28,642::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136237::DEBUG::2014-10-29 11:16:28,643::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136237::DEBUG::2014-10-29 11:16:28,643::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136237::DEBUG::2014-10-29 11:16:28,643::task::993::Storage.TaskManager.Task::(_decref) Task=`4cd9e95c-c077-45fe-9985-f47ce0eb0884`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:16:28,666::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54301 >Detector thread::DEBUG::2014-10-29 11:16:28,666::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54301 >Detector thread::DEBUG::2014-10-29 11:16:28,666::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54301 >Detector thread::DEBUG::2014-10-29 11:16:28,667::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54301) >Thread-136242::DEBUG::2014-10-29 11:16:28,706::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136242::DEBUG::2014-10-29 11:16:28,707::task::595::Storage.TaskManager.Task::(_updateState) Task=`93e00eba-a29f-4b42-91b3-324e59ab76b7`::moving from state init -> state preparing >Thread-136242::INFO::2014-10-29 11:16:28,707::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136242::INFO::2014-10-29 11:16:28,708::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505915', 'lastCheck': '4.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682381', 'lastCheck': '4.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000563349', 'lastCheck': '4.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000427004', 'lastCheck': '4.4', 'valid': True}} >Thread-136242::DEBUG::2014-10-29 11:16:28,708::task::1191::Storage.TaskManager.Task::(prepare) Task=`93e00eba-a29f-4b42-91b3-324e59ab76b7`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505915', 'lastCheck': '4.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682381', 'lastCheck': '4.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000563349', 'lastCheck': '4.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000427004', 'lastCheck': '4.4', 'valid': True}} >Thread-136242::DEBUG::2014-10-29 11:16:28,708::task::595::Storage.TaskManager.Task::(_updateState) Task=`93e00eba-a29f-4b42-91b3-324e59ab76b7`::moving from state preparing -> state finished >Thread-136242::DEBUG::2014-10-29 11:16:28,708::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136242::DEBUG::2014-10-29 11:16:28,709::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136242::DEBUG::2014-10-29 11:16:28,709::task::993::Storage.TaskManager.Task::(_decref) Task=`93e00eba-a29f-4b42-91b3-324e59ab76b7`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:29,193::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:29,195::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136243::DEBUG::2014-10-29 11:16:29,199::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:29,202::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:29,204::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136244::DEBUG::2014-10-29 11:16:29,207::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136244::DEBUG::2014-10-29 11:16:29,209::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:16:29,388::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54302 >Detector thread::DEBUG::2014-10-29 11:16:29,388::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54302 >Detector thread::DEBUG::2014-10-29 11:16:29,389::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54302 >Detector thread::DEBUG::2014-10-29 11:16:29,389::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54302) >Thread-136245::DEBUG::2014-10-29 11:16:29,428::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136245::DEBUG::2014-10-29 11:16:29,429::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136245::DEBUG::2014-10-29 11:16:29,430::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.55', 'elapsedTime': '514021', 'displayType': 'vnc', 'cpuSys': '0.80', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '57120794', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '70095', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '47442.06'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.81', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:29,998::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:29,999::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:30,002::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:16:30,388::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54304 >Detector thread::DEBUG::2014-10-29 11:16:30,389::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54304 >Detector thread::DEBUG::2014-10-29 11:16:30,389::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54304 >Detector thread::DEBUG::2014-10-29 11:16:30,390::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54304) >Thread-136246::DEBUG::2014-10-29 11:16:30,429::task::595::Storage.TaskManager.Task::(_updateState) Task=`28ca0176-4613-4537-9566-20a565ee29a3`::moving from state init -> state preparing >Thread-136246::INFO::2014-10-29 11:16:30,429::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136246::INFO::2014-10-29 11:16:30,430::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505915', 'lastCheck': '6.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682381', 'lastCheck': '6.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000563349', 'lastCheck': '6.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000427004', 'lastCheck': '6.1', 'valid': True}} >Thread-136246::DEBUG::2014-10-29 11:16:30,430::task::1191::Storage.TaskManager.Task::(prepare) Task=`28ca0176-4613-4537-9566-20a565ee29a3`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505915', 'lastCheck': '6.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682381', 'lastCheck': '6.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000563349', 'lastCheck': '6.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000427004', 'lastCheck': '6.1', 'valid': True}} >Thread-136246::DEBUG::2014-10-29 11:16:30,430::task::595::Storage.TaskManager.Task::(_updateState) Task=`28ca0176-4613-4537-9566-20a565ee29a3`::moving from state preparing -> state finished >Thread-136246::DEBUG::2014-10-29 11:16:30,431::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136246::DEBUG::2014-10-29 11:16:30,431::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136246::DEBUG::2014-10-29 11:16:30,431::task::993::Storage.TaskManager.Task::(_decref) Task=`28ca0176-4613-4537-9566-20a565ee29a3`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:16:30,741::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54305 >Detector thread::DEBUG::2014-10-29 11:16:30,742::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54305 >Detector thread::DEBUG::2014-10-29 11:16:30,742::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54305 >Detector thread::DEBUG::2014-10-29 11:16:30,743::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54305) >Thread-136247::DEBUG::2014-10-29 11:16:30,781::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136247::DEBUG::2014-10-29 11:16:30,783::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136247::DEBUG::2014-10-29 11:16:30,803::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136247::DEBUG::2014-10-29 11:16:30,856::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '56', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '56', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:32,224::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:32,227::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136248::DEBUG::2014-10-29 11:16:32,230::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:32,232::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:32,234::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136249::DEBUG::2014-10-29 11:16:32,238::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136249::DEBUG::2014-10-29 11:16:32,240::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:16:33,640::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >VM Channels Listener::DEBUG::2014-10-29 11:16:33,852::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >Thread-17::DEBUG::2014-10-29 11:16:34,053::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:34,054::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:34,054::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:34,054::__init__::232::IOProcess::(_processLogs) (200805) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:34,055::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200805) Queuing response >Thread-179::DEBUG::2014-10-29 11:16:34,057::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:16:34,075::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000485752 s, 766 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:16:34,077::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:34,077::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:34,078::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:34,078::__init__::232::IOProcess::(_processLogs) (200806) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:34,080::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200806) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:34,117::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:34,118::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:34,119::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:34,121::__init__::232::IOProcess::(_processLogs) (200807) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:16:34,120::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:16:34,122::__init__::232::IOProcess::(_processLogs) (200807) Queuing response >Thread-178::DEBUG::2014-10-29 11:16:34,138::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000618379 s, 822 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:16:34,140::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:34,140::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:34,141::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:34,141::__init__::232::IOProcess::(_processLogs) (200808) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:34,143::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200808) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:34,145::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:34,145::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:34,146::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:34,147::__init__::232::IOProcess::(_processLogs) (200809) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:34,147::__init__::232::IOProcess::(_processLogs) (200809) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:34,147::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:34,148::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:34,148::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:34,149::__init__::232::IOProcess::(_processLogs) (200810) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:34,149::__init__::232::IOProcess::(_processLogs) (200810) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:34,150::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:34,150::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:34,151::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:34,152::__init__::232::IOProcess::(_processLogs) (200811) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:34,153::__init__::232::IOProcess::(_processLogs) (200811) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:34,313::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:34,314::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:34,314::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:34,315::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200812) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:34,317::__init__::232::IOProcess::(_processLogs) (200812) Queuing response >Thread-10269::DEBUG::2014-10-29 11:16:34,317::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:16:34,339::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000531243 s, 945 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:16:34,338::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:34,341::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:34,342::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:34,342::__init__::232::IOProcess::(_processLogs) (200813) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:34,344::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200813) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:34,345::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-33::DEBUG::2014-10-29 11:16:34,345::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:16:34,346::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:34,365::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:34,369::__init__::232::IOProcess::(_processLogs) (200814) Got request for method 'statvfs' >Thread-33::DEBUG::2014-10-29 11:16:34,369::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000524239 s, 929 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:16:34,371::__init__::232::IOProcess::(_processLogs) (200814) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:34,372::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:34,373::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:34,374::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:34,376::__init__::232::IOProcess::(_processLogs) (200815) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:34,376::__init__::232::IOProcess::(_processLogs) (200815) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:34,376::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:34,377::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:34,378::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:34,378::__init__::232::IOProcess::(_processLogs) (200816) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:34,379::__init__::232::IOProcess::(_processLogs) (200816) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:34,379::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:34,380::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:34,381::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:34,381::__init__::232::IOProcess::(_processLogs) (200817) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:34,381::__init__::232::IOProcess::(_processLogs) (200817) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:34,382::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:34,383::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:34,383::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:34,384::__init__::232::IOProcess::(_processLogs) (200818) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:34,385::__init__::232::IOProcess::(_processLogs) (200818) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:35,009::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:35,011::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:35,012::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:35,254::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:35,256::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136250::DEBUG::2014-10-29 11:16:35,260::task::595::Storage.TaskManager.Task::(_updateState) Task=`0413c477-eaba-4a55-8940-5db5255610bc`::moving from state init -> state preparing >Thread-136250::INFO::2014-10-29 11:16:35,261::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136250::INFO::2014-10-29 11:16:35,261::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618379', 'lastCheck': '1.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524239', 'lastCheck': '0.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485752', 'lastCheck': '1.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000531243', 'lastCheck': '0.9', 'valid': True}} >Thread-136250::DEBUG::2014-10-29 11:16:35,262::task::1191::Storage.TaskManager.Task::(prepare) Task=`0413c477-eaba-4a55-8940-5db5255610bc`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618379', 'lastCheck': '1.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524239', 'lastCheck': '0.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485752', 'lastCheck': '1.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000531243', 'lastCheck': '0.9', 'valid': True}} >Thread-136250::DEBUG::2014-10-29 11:16:35,262::task::595::Storage.TaskManager.Task::(_updateState) Task=`0413c477-eaba-4a55-8940-5db5255610bc`::moving from state preparing -> state finished >Thread-136250::DEBUG::2014-10-29 11:16:35,262::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136250::DEBUG::2014-10-29 11:16:35,262::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136250::DEBUG::2014-10-29 11:16:35,263::task::993::Storage.TaskManager.Task::(_decref) Task=`0413c477-eaba-4a55-8940-5db5255610bc`::ref 0 aborting False >Thread-136250::DEBUG::2014-10-29 11:16:35,288::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:35,310::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:35,312::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136251::DEBUG::2014-10-29 11:16:35,315::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136251::DEBUG::2014-10-29 11:16:35,317::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:38,378::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:38,381::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136252::DEBUG::2014-10-29 11:16:38,385::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:38,387::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:38,389::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136253::DEBUG::2014-10-29 11:16:38,393::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136253::DEBUG::2014-10-29 11:16:38,395::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:16:39,287::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54307 >Detector thread::DEBUG::2014-10-29 11:16:39,288::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54307 >Detector thread::DEBUG::2014-10-29 11:16:39,288::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54307 >Detector thread::DEBUG::2014-10-29 11:16:39,288::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54307) >Thread-136254::DEBUG::2014-10-29 11:16:39,328::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136254::DEBUG::2014-10-29 11:16:39,329::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a85b798-7390-49d6-8b35-849295a929f5`::moving from state init -> state preparing >Thread-136254::INFO::2014-10-29 11:16:39,329::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136254::DEBUG::2014-10-29 11:16:39,334::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:16:39,335::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:39,335::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:39,336::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:39,336::__init__::232::IOProcess::(_processLogs) (200819) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:39,336::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200819) Queuing response >Thread-136254::DEBUG::2014-10-29 11:16:39,337::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136254::DEBUG::2014-10-29 11:16:39,338::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136254::INFO::2014-10-29 11:16:39,338::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136254::DEBUG::2014-10-29 11:16:39,338::task::1191::Storage.TaskManager.Task::(prepare) Task=`3a85b798-7390-49d6-8b35-849295a929f5`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136254::DEBUG::2014-10-29 11:16:39,338::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a85b798-7390-49d6-8b35-849295a929f5`::moving from state preparing -> state finished >Thread-136254::DEBUG::2014-10-29 11:16:39,339::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136254::DEBUG::2014-10-29 11:16:39,339::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136254::DEBUG::2014-10-29 11:16:39,339::task::993::Storage.TaskManager.Task::(_decref) Task=`3a85b798-7390-49d6-8b35-849295a929f5`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:16:39,386::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54308 >Detector thread::DEBUG::2014-10-29 11:16:39,387::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54308 >Detector thread::DEBUG::2014-10-29 11:16:39,387::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54308 >Detector thread::DEBUG::2014-10-29 11:16:39,387::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54308) >Thread-136255::DEBUG::2014-10-29 11:16:39,426::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136255::DEBUG::2014-10-29 11:16:39,427::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca042d71-0d78-4c2c-8a52-fe6a95474dab`::moving from state init -> state preparing >Thread-136255::INFO::2014-10-29 11:16:39,427::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136255::DEBUG::2014-10-29 11:16:39,427::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136255::DEBUG::2014-10-29 11:16:39,428::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136255::DEBUG::2014-10-29 11:16:39,428::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136255::DEBUG::2014-10-29 11:16:39,428::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136255::DEBUG::2014-10-29 11:16:39,428::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136255::DEBUG::2014-10-29 11:16:39,429::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136255::DEBUG::2014-10-29 11:16:39,518::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136255::DEBUG::2014-10-29 11:16:39,519::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Detector thread::DEBUG::2014-10-29 11:16:39,580::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54309 >Detector thread::DEBUG::2014-10-29 11:16:39,582::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54309 >Detector thread::DEBUG::2014-10-29 11:16:39,582::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54309 >Detector thread::DEBUG::2014-10-29 11:16:39,583::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54309) >Thread-136256::DEBUG::2014-10-29 11:16:39,621::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136256::DEBUG::2014-10-29 11:16:39,623::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136256::DEBUG::2014-10-29 11:16:39,624::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.18', 'elapsedTime': '514032', 'displayType': 'vnc', 'cpuSys': '0.67', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '57120794', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '70095', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '47442.06'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.98', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-136255::DEBUG::2014-10-29 11:16:39,726::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136255::DEBUG::2014-10-29 11:16:39,726::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136255::DEBUG::2014-10-29 11:16:39,727::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136255::DEBUG::2014-10-29 11:16:39,727::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136255::DEBUG::2014-10-29 11:16:39,728::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136255::DEBUG::2014-10-29 11:16:39,728::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136255::DEBUG::2014-10-29 11:16:39,728::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136255::DEBUG::2014-10-29 11:16:39,729::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:16:39,736::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:39,740::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:39,740::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:39,740::__init__::232::IOProcess::(_processLogs) (200820) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:39,741::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200820) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:39,742::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:39,745::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:39,745::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:39,745::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:39,746::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:39,746::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:39,746::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:39,746::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:39,747::__init__::232::IOProcess::(_processLogs) (200822) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:39,747::__init__::232::IOProcess::(_processLogs) (200821) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:39,747::__init__::232::IOProcess::(_processLogs) (200822) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:39,747::__init__::232::IOProcess::(_processLogs) (200821) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:39,748::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:39,748::__init__::232::IOProcess::(_processLogs) (200823) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:39,748::__init__::232::IOProcess::(_processLogs) (200823) Queuing response >Thread-136255::DEBUG::2014-10-29 11:16:39,753::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:16:39,754::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:39,755::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:39,755::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:39,755::__init__::232::IOProcess::(_processLogs) (200824) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:16:39,756::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200824) Queuing response >Thread-136255::DEBUG::2014-10-29 11:16:39,757::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:16:39,758::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:39,758::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:39,759::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:39,759::__init__::232::IOProcess::(_processLogs) (200825) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:16:39,760::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200825) Queuing response >Thread-136255::DEBUG::2014-10-29 11:16:39,760::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:16:39,761::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:39,762::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:39,762::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:39,763::__init__::232::IOProcess::(_processLogs) (200826) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:39,763::__init__::232::IOProcess::(_processLogs) (200826) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:39,764::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:39,764::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:39,765::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:39,765::__init__::232::IOProcess::(_processLogs) (200827) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:39,765::__init__::232::IOProcess::(_processLogs) (200827) Queuing response >Thread-136255::DEBUG::2014-10-29 11:16:39,766::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-136255::INFO::2014-10-29 11:16:39,766::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136255::INFO::2014-10-29 11:16:39,766::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136255::INFO::2014-10-29 11:16:39,767::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:16:39,768::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:39,768::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:39,768::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:39,769::__init__::232::IOProcess::(_processLogs) (200828) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:16:39,770::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200828) Queuing response >Thread-136255::DEBUG::2014-10-29 11:16:39,770::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136255::DEBUG::2014-10-29 11:16:39,773::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`946080fa-6f72-4abe-9d49-ab0afbe54ec6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136255::DEBUG::2014-10-29 11:16:39,773::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136255::DEBUG::2014-10-29 11:16:39,773::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136255::DEBUG::2014-10-29 11:16:39,774::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`946080fa-6f72-4abe-9d49-ab0afbe54ec6`::Granted request >Thread-136255::DEBUG::2014-10-29 11:16:39,774::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ca042d71-0d78-4c2c-8a52-fe6a95474dab`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136255::DEBUG::2014-10-29 11:16:39,775::task::993::Storage.TaskManager.Task::(_decref) Task=`ca042d71-0d78-4c2c-8a52-fe6a95474dab`::ref 1 aborting False >Thread-136255::INFO::2014-10-29 11:16:39,777::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136255::DEBUG::2014-10-29 11:16:39,778::task::1191::Storage.TaskManager.Task::(prepare) Task=`ca042d71-0d78-4c2c-8a52-fe6a95474dab`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136255::DEBUG::2014-10-29 11:16:39,778::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca042d71-0d78-4c2c-8a52-fe6a95474dab`::moving from state preparing -> state finished >Thread-136255::DEBUG::2014-10-29 11:16:39,778::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136255::DEBUG::2014-10-29 11:16:39,779::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136255::DEBUG::2014-10-29 11:16:39,779::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136255::DEBUG::2014-10-29 11:16:39,779::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136255::DEBUG::2014-10-29 11:16:39,780::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136255::DEBUG::2014-10-29 11:16:39,780::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136255::DEBUG::2014-10-29 11:16:39,780::task::993::Storage.TaskManager.Task::(_decref) Task=`ca042d71-0d78-4c2c-8a52-fe6a95474dab`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:16:39,801::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54311 >Detector thread::DEBUG::2014-10-29 11:16:39,802::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54311 >Detector thread::DEBUG::2014-10-29 11:16:39,802::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54311 >Detector thread::DEBUG::2014-10-29 11:16:39,803::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54311) >Thread-136261::DEBUG::2014-10-29 11:16:39,841::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136261::DEBUG::2014-10-29 11:16:39,842::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8191647-9860-4a31-9343-0c0e0016240a`::moving from state init -> state preparing >Thread-136261::INFO::2014-10-29 11:16:39,842::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136261::INFO::2014-10-29 11:16:39,843::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618379', 'lastCheck': '5.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524239', 'lastCheck': '5.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485752', 'lastCheck': '5.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000531243', 'lastCheck': '5.5', 'valid': True}} >Thread-136261::DEBUG::2014-10-29 11:16:39,843::task::1191::Storage.TaskManager.Task::(prepare) Task=`d8191647-9860-4a31-9343-0c0e0016240a`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618379', 'lastCheck': '5.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524239', 'lastCheck': '5.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485752', 'lastCheck': '5.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000531243', 'lastCheck': '5.5', 'valid': True}} >Thread-136261::DEBUG::2014-10-29 11:16:39,843::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8191647-9860-4a31-9343-0c0e0016240a`::moving from state preparing -> state finished >Thread-136261::DEBUG::2014-10-29 11:16:39,843::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136261::DEBUG::2014-10-29 11:16:39,844::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136261::DEBUG::2014-10-29 11:16:39,844::task::993::Storage.TaskManager.Task::(_decref) Task=`d8191647-9860-4a31-9343-0c0e0016240a`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:40,019::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:40,020::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:40,024::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:16:40,495::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54312 >Detector thread::DEBUG::2014-10-29 11:16:40,496::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54312 >Detector thread::DEBUG::2014-10-29 11:16:40,496::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54312 >Detector thread::DEBUG::2014-10-29 11:16:40,497::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54312) >Thread-136262::DEBUG::2014-10-29 11:16:40,537::task::595::Storage.TaskManager.Task::(_updateState) Task=`79787f90-f7dd-4671-b0c9-740337d7765d`::moving from state init -> state preparing >Thread-136262::INFO::2014-10-29 11:16:40,537::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136262::INFO::2014-10-29 11:16:40,538::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618379', 'lastCheck': '6.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524239', 'lastCheck': '6.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485752', 'lastCheck': '6.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000531243', 'lastCheck': '6.2', 'valid': True}} >Thread-136262::DEBUG::2014-10-29 11:16:40,538::task::1191::Storage.TaskManager.Task::(prepare) Task=`79787f90-f7dd-4671-b0c9-740337d7765d`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618379', 'lastCheck': '6.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524239', 'lastCheck': '6.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485752', 'lastCheck': '6.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000531243', 'lastCheck': '6.2', 'valid': True}} >Thread-136262::DEBUG::2014-10-29 11:16:40,538::task::595::Storage.TaskManager.Task::(_updateState) Task=`79787f90-f7dd-4671-b0c9-740337d7765d`::moving from state preparing -> state finished >Thread-136262::DEBUG::2014-10-29 11:16:40,539::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136262::DEBUG::2014-10-29 11:16:40,539::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136262::DEBUG::2014-10-29 11:16:40,539::task::993::Storage.TaskManager.Task::(_decref) Task=`79787f90-f7dd-4671-b0c9-740337d7765d`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:16:40,919::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54313 >Detector thread::DEBUG::2014-10-29 11:16:40,919::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54313 >Detector thread::DEBUG::2014-10-29 11:16:40,920::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54313 >Detector thread::DEBUG::2014-10-29 11:16:40,920::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54313) >Thread-136263::DEBUG::2014-10-29 11:16:40,959::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136263::DEBUG::2014-10-29 11:16:40,960::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136263::DEBUG::2014-10-29 11:16:40,979::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136263::DEBUG::2014-10-29 11:16:41,038::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '37', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '37', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:41,417::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:41,419::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136264::DEBUG::2014-10-29 11:16:41,423::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:41,425::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:41,426::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136265::DEBUG::2014-10-29 11:16:41,430::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136265::DEBUG::2014-10-29 11:16:41,432::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-179::DEBUG::2014-10-29 11:16:44,083::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 38dc6c98-2b6a-45c0-b765-c5ce685415f9 >Thread-17::DEBUG::2014-10-29 11:16:44,091::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:44,092::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:44,092::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:44,093::__init__::232::IOProcess::(_processLogs) (200829) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:44,094::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200829) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:44,096::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:44,096::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:44,096::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:44,097::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:44,097::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:44,098::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:44,099::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:44,099::__init__::232::IOProcess::(_processLogs) (200830) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:44,100::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:44,100::__init__::232::IOProcess::(_processLogs) (200831) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:44,100::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:44,100::__init__::232::IOProcess::(_processLogs) (200832) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:44,101::__init__::232::IOProcess::(_processLogs) (200832) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:44,101::__init__::232::IOProcess::(_processLogs) (200831) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:44,101::__init__::232::IOProcess::(_processLogs) (200830) Queuing response >Thread-179::DEBUG::2014-10-29 11:16:44,107::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9 >Thread-17::DEBUG::2014-10-29 11:16:44,108::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:44,109::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:44,109::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:44,109::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200833) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:16:44,113::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200833) Queuing response >Thread-179::DEBUG::2014-10-29 11:16:44,114::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:16:44,115::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:44,115::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:44,116::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:44,116::__init__::232::IOProcess::(_processLogs) (200834) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:16:44,117::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200834) Queuing response >Thread-179::DEBUG::2014-10-29 11:16:44,117::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nsednev_rhevm_3_5_second_SD', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=00000002-0002-0002-0002-000000000321', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_rhevm_3_5_second_SD', 'ROLE=Regular', 'SDUUID=38dc6c98-2b6a-45c0-b765-c5ce685415f9', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ea5c54387b91bc1e37853d7501f0d1b2d7d233e7'] >Thread-17::DEBUG::2014-10-29 11:16:44,119::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:44,120::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:44,120::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:44,121::__init__::232::IOProcess::(_processLogs) (200835) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:44,121::__init__::232::IOProcess::(_processLogs) (200835) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:44,122::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:44,122::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:44,123::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:44,123::__init__::232::IOProcess::(_processLogs) (200836) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:44,124::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200836) Queuing response >Thread-179::DEBUG::2014-10-29 11:16:44,124::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-179::INFO::2014-10-29 11:16:44,125::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 38dc6c98-2b6a-45c0-b765-c5ce685415f9_imageNS already registered >Thread-179::INFO::2014-10-29 11:16:44,125::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 38dc6c98-2b6a-45c0-b765-c5ce685415f9_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:16:44,126::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:44,126::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:44,127::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:44,127::__init__::232::IOProcess::(_processLogs) (200837) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:44,128::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200837) Queuing response >Thread-179::DEBUG::2014-10-29 11:16:44,130::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:16:44,148::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000426602 s, 872 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:16:44,150::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:44,150::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:44,151::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:44,151::__init__::232::IOProcess::(_processLogs) (200838) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:44,151::__init__::232::IOProcess::(_processLogs) (200838) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:44,154::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:44,154::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:44,155::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:44,156::__init__::232::IOProcess::(_processLogs) (200839) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:44,158::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200839) Queuing response >Thread-178::DEBUG::2014-10-29 11:16:44,159::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:16:44,178::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000425723 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:16:44,179::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:44,180::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:44,180::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:44,180::__init__::232::IOProcess::(_processLogs) (200840) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:44,181::__init__::232::IOProcess::(_processLogs) (200840) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:44,183::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:44,183::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:44,184::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:44,184::__init__::232::IOProcess::(_processLogs) (200841) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:44,184::__init__::232::IOProcess::(_processLogs) (200841) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:44,185::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:44,186::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:44,186::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:44,186::__init__::232::IOProcess::(_processLogs) (200842) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:44,186::__init__::232::IOProcess::(_processLogs) (200842) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:44,187::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:44,188::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:44,188::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:44,188::__init__::232::IOProcess::(_processLogs) (200843) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:44,189::__init__::232::IOProcess::(_processLogs) (200843) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:44,369::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:44,370::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:44,370::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:44,370::__init__::232::IOProcess::(_processLogs) (200844) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:44,372::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200844) Queuing response >Thread-10269::DEBUG::2014-10-29 11:16:44,373::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:16:44,390::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-10269::DEBUG::2014-10-29 11:16:44,394::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000448709 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:16:44,401::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:44,404::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:44,406::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:44,407::__init__::232::IOProcess::(_processLogs) (200845) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:44,408::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200845) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:44,413::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:44,414::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:44,416::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:44,418::__init__::232::IOProcess::(_processLogs) (200846) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:44,420::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:44,422::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:44,424::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-33::DEBUG::2014-10-29 11:16:44,425::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:16:44,426::__init__::232::IOProcess::(_processLogs) (200847) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:44,428::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:44,428::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:44,428::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:44,428::__init__::232::IOProcess::(_processLogs) (200848) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:44,429::__init__::232::IOProcess::(_processLogs) (200846) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:44,429::__init__::232::IOProcess::(_processLogs) (200847) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:44,429::__init__::232::IOProcess::(_processLogs) (200848) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:44,429::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:44,430::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:44,430::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:44,430::__init__::232::IOProcess::(_processLogs) (200849) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:44,430::__init__::232::IOProcess::(_processLogs) (200849) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:44,433::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:44,433::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:44,434::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:44,434::__init__::232::IOProcess::(_processLogs) (200850) Got request for method 'touch' >Thread-33::DEBUG::2014-10-29 11:16:44,435::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:16:44,435::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200850) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:44,438::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:44,438::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:44,439::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-33::DEBUG::2014-10-29 11:16:44,440::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:16:44,441::__init__::232::IOProcess::(_processLogs) (200851) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:16:44,444::__init__::232::IOProcess::(_processLogs) (200851) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:44,446::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:44,447::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:44,449::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-17::DEBUG::2014-10-29 11:16:44,449::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:44,451::__init__::232::IOProcess::(_processLogs) (200852) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:44,454::__init__::232::IOProcess::(_processLogs) (200852) Queuing response >JsonRpcServer::DEBUG::2014-10-29 11:16:44,455::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:16:44,461::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:44,461::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:44,462::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:44,462::__init__::232::IOProcess::(_processLogs) (200853) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:44,463::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200853) Queuing response >Thread-33::DEBUG::2014-10-29 11:16:44,463::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-33::INFO::2014-10-29 11:16:44,466::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136274::DEBUG::2014-10-29 11:16:44,467::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-33::INFO::2014-10-29 11:16:44,468::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:16:44,472::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:44,473::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-17::DEBUG::2014-10-29 11:16:44,477::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >JsonRpcServer::DEBUG::2014-10-29 11:16:44,480::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:16:44,480::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-33::DEBUG::2014-10-29 11:16:44,482::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:16:44,485::__init__::232::IOProcess::(_processLogs) (200854) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:44,505::__init__::232::IOProcess::(_processLogs) (200854) Queuing response >Thread-33::DEBUG::2014-10-29 11:16:44,507::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000558563 s, 872 kB/s\n'; <rc> = 0 >Thread-136275::DEBUG::2014-10-29 11:16:44,514::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:16:44,515::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:44,517::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:44,519::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:44,520::__init__::232::IOProcess::(_processLogs) (200855) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:44,527::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200855) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:44,531::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:44,532::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:44,536::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:44,538::__init__::232::IOProcess::(_processLogs) (200856) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:44,540::__init__::232::IOProcess::(_processLogs) (200856) Queuing response >Thread-136275::DEBUG::2014-10-29 11:16:44,540::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:16:44,546::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:44,547::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:44,547::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:44,548::__init__::232::IOProcess::(_processLogs) (200857) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:44,548::__init__::232::IOProcess::(_processLogs) (200857) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:44,549::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:44,550::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:44,551::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:44,552::__init__::232::IOProcess::(_processLogs) (200858) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:44,553::__init__::232::IOProcess::(_processLogs) (200858) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:45,031::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:45,032::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:45,034::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:47,575::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:47,577::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136276::DEBUG::2014-10-29 11:16:47,580::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:47,582::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:47,584::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136277::DEBUG::2014-10-29 11:16:47,587::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136277::DEBUG::2014-10-29 11:16:47,589::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:16:48,647::task::595::Storage.TaskManager.Task::(_updateState) Task=`b829c607-9e13-4459-b9e4-23d1bf2ecc5c`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:16:48,648::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:16:48,649::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:48,649::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:48,650::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:48,650::__init__::232::IOProcess::(_processLogs) (200859) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:16:48,651::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200859) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:48,653::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-22::INFO::2014-10-29 11:16:48,655::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010871808', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:16:48,655::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-22::DEBUG::2014-10-29 11:16:48,656::task::1191::Storage.TaskManager.Task::(prepare) Task=`b829c607-9e13-4459-b9e4-23d1bf2ecc5c`::finished: {'truesize': '6010871808', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:16:48,656::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-22::DEBUG::2014-10-29 11:16:48,657::task::595::Storage.TaskManager.Task::(_updateState) Task=`b829c607-9e13-4459-b9e4-23d1bf2ecc5c`::moving from state preparing -> state finished >Thread-22::DEBUG::2014-10-29 11:16:48,658::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17::DEBUG::2014-10-29 11:16:48,658::__init__::232::IOProcess::(_processLogs) (200860) Got request for method 'stat' >Thread-22::DEBUG::2014-10-29 11:16:48,659::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17::DEBUG::2014-10-29 11:16:48,660::__init__::232::IOProcess::(_processLogs) (200860) Queuing response >Thread-22::DEBUG::2014-10-29 11:16:48,660::task::993::Storage.TaskManager.Task::(_decref) Task=`b829c607-9e13-4459-b9e4-23d1bf2ecc5c`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:16:48,729::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Detector thread::DEBUG::2014-10-29 11:16:49,810::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54314 >Detector thread::DEBUG::2014-10-29 11:16:49,810::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54314 >Detector thread::DEBUG::2014-10-29 11:16:49,811::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54314 >Detector thread::DEBUG::2014-10-29 11:16:49,811::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54314) >Thread-136278::DEBUG::2014-10-29 11:16:49,850::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136278::DEBUG::2014-10-29 11:16:49,852::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136278::DEBUG::2014-10-29 11:16:49,853::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.23', 'elapsedTime': '514042', 'displayType': 'vnc', 'cpuSys': '0.66', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '5908092', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '64146', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '35744.96'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.21', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:50,042::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:50,048::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:50,053::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:16:50,412::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54317 >Detector thread::DEBUG::2014-10-29 11:16:50,413::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54317 >Detector thread::DEBUG::2014-10-29 11:16:50,413::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54317 >Detector thread::DEBUG::2014-10-29 11:16:50,413::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54317) >Thread-136279::DEBUG::2014-10-29 11:16:50,453::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136279::DEBUG::2014-10-29 11:16:50,454::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f4e95dc-ae93-4349-8f78-158d14c38e8e`::moving from state init -> state preparing >Thread-136279::INFO::2014-10-29 11:16:50,454::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136279::DEBUG::2014-10-29 11:16:50,457::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:16:50,457::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:50,458::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:50,458::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:50,458::__init__::232::IOProcess::(_processLogs) (200861) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:50,460::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200861) Queuing response >Thread-136279::DEBUG::2014-10-29 11:16:50,461::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136279::DEBUG::2014-10-29 11:16:50,461::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136279::INFO::2014-10-29 11:16:50,461::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136279::DEBUG::2014-10-29 11:16:50,462::task::1191::Storage.TaskManager.Task::(prepare) Task=`3f4e95dc-ae93-4349-8f78-158d14c38e8e`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136279::DEBUG::2014-10-29 11:16:50,462::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f4e95dc-ae93-4349-8f78-158d14c38e8e`::moving from state preparing -> state finished >Thread-136279::DEBUG::2014-10-29 11:16:50,462::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136279::DEBUG::2014-10-29 11:16:50,462::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136279::DEBUG::2014-10-29 11:16:50,463::task::993::Storage.TaskManager.Task::(_decref) Task=`3f4e95dc-ae93-4349-8f78-158d14c38e8e`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:16:50,506::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54318 >Detector thread::DEBUG::2014-10-29 11:16:50,507::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54318 >Detector thread::DEBUG::2014-10-29 11:16:50,507::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54318 >Detector thread::DEBUG::2014-10-29 11:16:50,508::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54318) >Thread-136280::DEBUG::2014-10-29 11:16:50,547::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136280::DEBUG::2014-10-29 11:16:50,547::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd94d801-ba8a-4c78-b0be-9be1cc330050`::moving from state init -> state preparing >Thread-136280::INFO::2014-10-29 11:16:50,548::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136280::DEBUG::2014-10-29 11:16:50,548::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136280::DEBUG::2014-10-29 11:16:50,548::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136280::DEBUG::2014-10-29 11:16:50,549::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136280::DEBUG::2014-10-29 11:16:50,549::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136280::DEBUG::2014-10-29 11:16:50,550::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136280::DEBUG::2014-10-29 11:16:50,550::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Detector thread::DEBUG::2014-10-29 11:16:50,600::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54319 >Detector thread::DEBUG::2014-10-29 11:16:50,606::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54319 >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:50,607::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Detector thread::DEBUG::2014-10-29 11:16:50,609::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54319 >Detector thread::DEBUG::2014-10-29 11:16:50,613::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54319) >JsonRpcServer::DEBUG::2014-10-29 11:16:50,615::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136281::DEBUG::2014-10-29 11:16:50,623::task::595::Storage.TaskManager.Task::(_updateState) Task=`48dde12c-0563-4c15-8f8d-dca4c280bc49`::moving from state init -> state preparing >Thread-136281::INFO::2014-10-29 11:16:50,623::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136281::INFO::2014-10-29 11:16:50,624::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425723', 'lastCheck': '6.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558563', 'lastCheck': '6.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426602', 'lastCheck': '6.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000448709', 'lastCheck': '6.2', 'valid': True}} >Thread-136281::DEBUG::2014-10-29 11:16:50,624::task::1191::Storage.TaskManager.Task::(prepare) Task=`48dde12c-0563-4c15-8f8d-dca4c280bc49`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425723', 'lastCheck': '6.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558563', 'lastCheck': '6.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426602', 'lastCheck': '6.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000448709', 'lastCheck': '6.2', 'valid': True}} >Thread-136281::DEBUG::2014-10-29 11:16:50,625::task::595::Storage.TaskManager.Task::(_updateState) Task=`48dde12c-0563-4c15-8f8d-dca4c280bc49`::moving from state preparing -> state finished >Thread-136281::DEBUG::2014-10-29 11:16:50,625::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136281::DEBUG::2014-10-29 11:16:50,625::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136281::DEBUG::2014-10-29 11:16:50,626::task::993::Storage.TaskManager.Task::(_decref) Task=`48dde12c-0563-4c15-8f8d-dca4c280bc49`::ref 0 aborting False >Thread-136280::DEBUG::2014-10-29 11:16:50,644::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136280::DEBUG::2014-10-29 11:16:50,648::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136282::DEBUG::2014-10-29 11:16:50,671::task::595::Storage.TaskManager.Task::(_updateState) Task=`58a13ea9-284b-4a16-b037-97f1a95d561a`::moving from state init -> state preparing >Thread-136282::INFO::2014-10-29 11:16:50,673::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136282::INFO::2014-10-29 11:16:50,677::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425723', 'lastCheck': '6.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558563', 'lastCheck': '6.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426602', 'lastCheck': '6.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000448709', 'lastCheck': '6.3', 'valid': True}} >Thread-136282::DEBUG::2014-10-29 11:16:50,679::task::1191::Storage.TaskManager.Task::(prepare) Task=`58a13ea9-284b-4a16-b037-97f1a95d561a`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425723', 'lastCheck': '6.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558563', 'lastCheck': '6.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426602', 'lastCheck': '6.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000448709', 'lastCheck': '6.3', 'valid': True}} >Thread-136282::DEBUG::2014-10-29 11:16:50,680::task::595::Storage.TaskManager.Task::(_updateState) Task=`58a13ea9-284b-4a16-b037-97f1a95d561a`::moving from state preparing -> state finished >Thread-136282::DEBUG::2014-10-29 11:16:50,681::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136282::DEBUG::2014-10-29 11:16:50,682::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136282::DEBUG::2014-10-29 11:16:50,683::task::993::Storage.TaskManager.Task::(_decref) Task=`58a13ea9-284b-4a16-b037-97f1a95d561a`::ref 0 aborting False >Thread-136281::DEBUG::2014-10-29 11:16:50,696::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:50,724::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:50,726::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136283::DEBUG::2014-10-29 11:16:50,731::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136283::DEBUG::2014-10-29 11:16:50,734::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-136280::DEBUG::2014-10-29 11:16:50,827::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136280::DEBUG::2014-10-29 11:16:50,828::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136280::DEBUG::2014-10-29 11:16:50,828::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136280::DEBUG::2014-10-29 11:16:50,828::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136280::DEBUG::2014-10-29 11:16:50,829::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136280::DEBUG::2014-10-29 11:16:50,829::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136280::DEBUG::2014-10-29 11:16:50,829::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136280::DEBUG::2014-10-29 11:16:50,830::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:16:50,836::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:50,838::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:50,839::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:50,839::__init__::232::IOProcess::(_processLogs) (200862) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:50,840::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200862) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:50,841::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:50,842::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:50,842::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:50,842::__init__::232::IOProcess::(_processLogs) (200863) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:50,843::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200863) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:50,845::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:50,846::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:50,848::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:50,850::__init__::232::IOProcess::(_processLogs) (200864) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:50,852::__init__::232::IOProcess::(_processLogs) (200864) Queuing response >Thread-136280::DEBUG::2014-10-29 11:16:50,857::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:16:50,859::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:50,860::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:50,861::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:50,861::__init__::232::IOProcess::(_processLogs) (200865) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:16:50,862::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200865) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:50,863::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:50,863::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:50,864::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:50,864::__init__::232::IOProcess::(_processLogs) (200866) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:16:50,865::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200866) Queuing response >Thread-136280::DEBUG::2014-10-29 11:16:50,866::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:16:50,867::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:50,867::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:50,867::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:50,868::__init__::232::IOProcess::(_processLogs) (200867) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:16:50,869::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200867) Queuing response >Thread-136280::DEBUG::2014-10-29 11:16:50,869::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:16:50,871::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:50,872::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:50,873::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:50,873::__init__::232::IOProcess::(_processLogs) (200868) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:50,873::__init__::232::IOProcess::(_processLogs) (200868) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:50,874::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:50,874::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:50,875::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:50,875::__init__::232::IOProcess::(_processLogs) (200869) Got request for method 'glob' >Thread-136280::DEBUG::2014-10-29 11:16:50,876::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:16:50,876::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200869) Queuing response >Thread-136280::INFO::2014-10-29 11:16:50,877::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136280::INFO::2014-10-29 11:16:50,877::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136280::INFO::2014-10-29 11:16:50,878::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:16:50,879::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:50,879::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:50,879::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:50,879::__init__::232::IOProcess::(_processLogs) (200870) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:16:50,880::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200870) Queuing response >Thread-136280::DEBUG::2014-10-29 11:16:50,880::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136280::DEBUG::2014-10-29 11:16:50,883::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`b738e586-aaba-451d-8cfa-aac90e442309`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136280::DEBUG::2014-10-29 11:16:50,883::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136280::DEBUG::2014-10-29 11:16:50,883::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136280::DEBUG::2014-10-29 11:16:50,884::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`b738e586-aaba-451d-8cfa-aac90e442309`::Granted request >Thread-136280::DEBUG::2014-10-29 11:16:50,884::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fd94d801-ba8a-4c78-b0be-9be1cc330050`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136280::DEBUG::2014-10-29 11:16:50,884::task::993::Storage.TaskManager.Task::(_decref) Task=`fd94d801-ba8a-4c78-b0be-9be1cc330050`::ref 1 aborting False >Thread-136280::INFO::2014-10-29 11:16:50,887::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136280::DEBUG::2014-10-29 11:16:50,887::task::1191::Storage.TaskManager.Task::(prepare) Task=`fd94d801-ba8a-4c78-b0be-9be1cc330050`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136280::DEBUG::2014-10-29 11:16:50,888::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd94d801-ba8a-4c78-b0be-9be1cc330050`::moving from state preparing -> state finished >Thread-136280::DEBUG::2014-10-29 11:16:50,888::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136280::DEBUG::2014-10-29 11:16:50,888::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136280::DEBUG::2014-10-29 11:16:50,889::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136280::DEBUG::2014-10-29 11:16:50,889::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136280::DEBUG::2014-10-29 11:16:50,889::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136280::DEBUG::2014-10-29 11:16:50,889::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136280::DEBUG::2014-10-29 11:16:50,890::task::993::Storage.TaskManager.Task::(_decref) Task=`fd94d801-ba8a-4c78-b0be-9be1cc330050`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:16:50,910::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54320 >Detector thread::DEBUG::2014-10-29 11:16:50,911::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54320 >Detector thread::DEBUG::2014-10-29 11:16:50,911::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54320 >Detector thread::DEBUG::2014-10-29 11:16:50,911::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54320) >Thread-136288::DEBUG::2014-10-29 11:16:50,950::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136288::DEBUG::2014-10-29 11:16:50,950::task::595::Storage.TaskManager.Task::(_updateState) Task=`92080731-35f2-483c-9609-1b8211c37d56`::moving from state init -> state preparing >Thread-136288::INFO::2014-10-29 11:16:50,951::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136288::INFO::2014-10-29 11:16:50,951::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425723', 'lastCheck': '6.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558563', 'lastCheck': '6.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426602', 'lastCheck': '6.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000448709', 'lastCheck': '6.5', 'valid': True}} >Thread-136288::DEBUG::2014-10-29 11:16:50,952::task::1191::Storage.TaskManager.Task::(prepare) Task=`92080731-35f2-483c-9609-1b8211c37d56`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425723', 'lastCheck': '6.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558563', 'lastCheck': '6.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426602', 'lastCheck': '6.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000448709', 'lastCheck': '6.5', 'valid': True}} >Thread-136288::DEBUG::2014-10-29 11:16:50,952::task::595::Storage.TaskManager.Task::(_updateState) Task=`92080731-35f2-483c-9609-1b8211c37d56`::moving from state preparing -> state finished >Thread-136288::DEBUG::2014-10-29 11:16:50,952::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136288::DEBUG::2014-10-29 11:16:50,952::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136288::DEBUG::2014-10-29 11:16:50,953::task::993::Storage.TaskManager.Task::(_decref) Task=`92080731-35f2-483c-9609-1b8211c37d56`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:16:51,095::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54322 >Detector thread::DEBUG::2014-10-29 11:16:51,097::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54322 >Detector thread::DEBUG::2014-10-29 11:16:51,097::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54322 >Detector thread::DEBUG::2014-10-29 11:16:51,098::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54322) >Thread-136289::DEBUG::2014-10-29 11:16:51,135::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136289::DEBUG::2014-10-29 11:16:51,138::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136289::DEBUG::2014-10-29 11:16:51,156::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136289::DEBUG::2014-10-29 11:16:51,205::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '20', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '20', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:53,878::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:53,882::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136290::DEBUG::2014-10-29 11:16:53,886::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:53,888::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:53,890::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136291::DEBUG::2014-10-29 11:16:53,894::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136291::DEBUG::2014-10-29 11:16:53,896::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:16:54,157::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:54,158::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:54,158::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:54,158::__init__::232::IOProcess::(_processLogs) (200871) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:54,159::__init__::232::IOProcess::(_processLogs) (200871) Queuing response >Thread-179::DEBUG::2014-10-29 11:16:54,160::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:16:54,177::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000481515 s, 773 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:16:54,179::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:54,179::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:54,180::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:54,180::__init__::232::IOProcess::(_processLogs) (200872) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:54,180::__init__::232::IOProcess::(_processLogs) (200872) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:54,191::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:54,191::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:54,191::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:54,192::__init__::232::IOProcess::(_processLogs) (200873) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:54,192::__init__::232::IOProcess::(_processLogs) (200873) Queuing response >Thread-178::DEBUG::2014-10-29 11:16:54,193::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:16:54,212::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000499342 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:16:54,213::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:54,214::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:54,214::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:54,214::__init__::232::IOProcess::(_processLogs) (200874) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:54,216::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200874) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:54,218::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:54,218::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:54,219::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:54,219::__init__::232::IOProcess::(_processLogs) (200875) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:54,220::__init__::232::IOProcess::(_processLogs) (200875) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:54,220::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:54,220::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:54,221::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:54,221::__init__::232::IOProcess::(_processLogs) (200876) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:54,222::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200876) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:54,223::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:54,223::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:54,224::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:54,224::__init__::232::IOProcess::(_processLogs) (200877) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:54,225::__init__::232::IOProcess::(_processLogs) (200877) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:54,411::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:54,411::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:54,413::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:54,413::__init__::232::IOProcess::(_processLogs) (200878) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:54,413::__init__::232::IOProcess::(_processLogs) (200878) Queuing response >Thread-10269::DEBUG::2014-10-29 11:16:54,414::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:16:54,432::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000644748 s, 779 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:16:54,433::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:54,435::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:54,437::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:54,437::__init__::232::IOProcess::(_processLogs) (200879) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:54,437::__init__::232::IOProcess::(_processLogs) (200879) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:54,553::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:54,554::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:54,556::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-33::DEBUG::2014-10-29 11:16:54,557::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:16:54,558::__init__::232::IOProcess::(_processLogs) (200880) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:54,573::__init__::232::IOProcess::(_processLogs) (200880) Queuing response >Thread-33::DEBUG::2014-10-29 11:16:54,575::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000557003 s, 874 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:16:54,577::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:54,577::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:54,578::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:54,578::__init__::232::IOProcess::(_processLogs) (200881) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:16:54,578::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200881) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:54,580::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:54,581::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:54,582::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:54,582::__init__::232::IOProcess::(_processLogs) (200882) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:54,582::__init__::232::IOProcess::(_processLogs) (200882) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:54,583::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:54,584::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:54,584::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:54,585::__init__::232::IOProcess::(_processLogs) (200883) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:54,585::__init__::232::IOProcess::(_processLogs) (200883) Queuing response >Thread-17::DEBUG::2014-10-29 11:16:54,585::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:16:54,586::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:16:54,587::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:16:54,588::__init__::232::IOProcess::(_processLogs) (200884) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:16:54,588::__init__::232::IOProcess::(_processLogs) (200884) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:55,061::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:55,062::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:16:55,064::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:56,915::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:56,918::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136292::DEBUG::2014-10-29 11:16:56,921::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:56,924::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:56,926::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136293::DEBUG::2014-10-29 11:16:56,928::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136293::DEBUG::2014-10-29 11:16:56,931::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:59,945::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:59,948::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136294::DEBUG::2014-10-29 11:16:59,952::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:16:59,954::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:16:59,956::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136295::DEBUG::2014-10-29 11:16:59,959::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136295::DEBUG::2014-10-29 11:16:59,962::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:17:00,006::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54323 >Detector thread::DEBUG::2014-10-29 11:17:00,007::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54323 >Detector thread::DEBUG::2014-10-29 11:17:00,007::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54323 >Detector thread::DEBUG::2014-10-29 11:17:00,008::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54323) >Thread-136296::DEBUG::2014-10-29 11:17:00,047::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136296::DEBUG::2014-10-29 11:17:00,048::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136296::DEBUG::2014-10-29 11:17:00,049::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.23', 'elapsedTime': '514052', 'displayType': 'vnc', 'cpuSys': '0.66', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '5908092', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '64146', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '35744.96'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.32', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:00,071::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:00,073::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:00,074::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:17:00,253::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54325 >Detector thread::DEBUG::2014-10-29 11:17:00,253::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54325 >Detector thread::DEBUG::2014-10-29 11:17:00,254::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54325 >Detector thread::DEBUG::2014-10-29 11:17:00,254::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54325) >Thread-136297::DEBUG::2014-10-29 11:17:00,293::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136297::DEBUG::2014-10-29 11:17:00,294::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136297::DEBUG::2014-10-29 11:17:00,312::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136297::DEBUG::2014-10-29 11:17:00,357::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '105', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '5', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:17:00,759::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54326 >Detector thread::DEBUG::2014-10-29 11:17:00,760::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54326 >Detector thread::DEBUG::2014-10-29 11:17:00,760::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54326 >Detector thread::DEBUG::2014-10-29 11:17:00,760::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54326) >Thread-136298::DEBUG::2014-10-29 11:17:00,800::task::595::Storage.TaskManager.Task::(_updateState) Task=`4862b18f-41d5-4ebe-bf61-ca5df6684b06`::moving from state init -> state preparing >Thread-136298::INFO::2014-10-29 11:17:00,800::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136298::INFO::2014-10-29 11:17:00,801::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000499342', 'lastCheck': '6.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000557003', 'lastCheck': '6.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481515', 'lastCheck': '6.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000644748', 'lastCheck': '6.4', 'valid': True}} >Thread-136298::DEBUG::2014-10-29 11:17:00,801::task::1191::Storage.TaskManager.Task::(prepare) Task=`4862b18f-41d5-4ebe-bf61-ca5df6684b06`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000499342', 'lastCheck': '6.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000557003', 'lastCheck': '6.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481515', 'lastCheck': '6.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000644748', 'lastCheck': '6.4', 'valid': True}} >Thread-136298::DEBUG::2014-10-29 11:17:00,802::task::595::Storage.TaskManager.Task::(_updateState) Task=`4862b18f-41d5-4ebe-bf61-ca5df6684b06`::moving from state preparing -> state finished >Thread-136298::DEBUG::2014-10-29 11:17:00,802::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136298::DEBUG::2014-10-29 11:17:00,802::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136298::DEBUG::2014-10-29 11:17:00,803::task::993::Storage.TaskManager.Task::(_decref) Task=`4862b18f-41d5-4ebe-bf61-ca5df6684b06`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:17:01,517::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54328 >Detector thread::DEBUG::2014-10-29 11:17:01,517::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54328 >Detector thread::DEBUG::2014-10-29 11:17:01,517::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54328 >Detector thread::DEBUG::2014-10-29 11:17:01,518::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54328) >Thread-136299::DEBUG::2014-10-29 11:17:01,558::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136299::DEBUG::2014-10-29 11:17:01,558::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe613d12-ca9b-4e1d-95ae-b135e5e25cb5`::moving from state init -> state preparing >Thread-136299::INFO::2014-10-29 11:17:01,559::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136299::DEBUG::2014-10-29 11:17:01,576::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:17:01,577::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:01,578::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:01,578::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:01,578::__init__::232::IOProcess::(_processLogs) (200885) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:01,579::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200885) Queuing response >Thread-136299::DEBUG::2014-10-29 11:17:01,580::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136299::DEBUG::2014-10-29 11:17:01,581::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136299::INFO::2014-10-29 11:17:01,581::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136299::DEBUG::2014-10-29 11:17:01,581::task::1191::Storage.TaskManager.Task::(prepare) Task=`fe613d12-ca9b-4e1d-95ae-b135e5e25cb5`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136299::DEBUG::2014-10-29 11:17:01,582::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe613d12-ca9b-4e1d-95ae-b135e5e25cb5`::moving from state preparing -> state finished >Thread-136299::DEBUG::2014-10-29 11:17:01,582::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136299::DEBUG::2014-10-29 11:17:01,582::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136299::DEBUG::2014-10-29 11:17:01,582::task::993::Storage.TaskManager.Task::(_decref) Task=`fe613d12-ca9b-4e1d-95ae-b135e5e25cb5`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:17:01,626::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54329 >Detector thread::DEBUG::2014-10-29 11:17:01,627::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54329 >Detector thread::DEBUG::2014-10-29 11:17:01,627::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54329 >Detector thread::DEBUG::2014-10-29 11:17:01,627::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54329) >Thread-136300::DEBUG::2014-10-29 11:17:01,666::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136300::DEBUG::2014-10-29 11:17:01,666::task::595::Storage.TaskManager.Task::(_updateState) Task=`03aeb0ad-14c6-4548-89b1-ba4a9703ca12`::moving from state init -> state preparing >Thread-136300::INFO::2014-10-29 11:17:01,667::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136300::DEBUG::2014-10-29 11:17:01,667::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136300::DEBUG::2014-10-29 11:17:01,667::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136300::DEBUG::2014-10-29 11:17:01,668::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136300::DEBUG::2014-10-29 11:17:01,668::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136300::DEBUG::2014-10-29 11:17:01,668::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136300::DEBUG::2014-10-29 11:17:01,669::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136300::DEBUG::2014-10-29 11:17:01,757::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136300::DEBUG::2014-10-29 11:17:01,758::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136300::DEBUG::2014-10-29 11:17:01,944::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136300::DEBUG::2014-10-29 11:17:01,945::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136300::DEBUG::2014-10-29 11:17:01,945::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136300::DEBUG::2014-10-29 11:17:01,946::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136300::DEBUG::2014-10-29 11:17:01,946::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136300::DEBUG::2014-10-29 11:17:01,947::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136300::DEBUG::2014-10-29 11:17:01,947::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136300::DEBUG::2014-10-29 11:17:01,947::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:17:01,954::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:01,955::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:01,956::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:01,956::__init__::232::IOProcess::(_processLogs) (200886) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:01,957::__init__::232::IOProcess::(_processLogs) (200886) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:01,957::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:01,959::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:01,962::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:01,965::__init__::232::IOProcess::(_processLogs) (200887) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:01,968::__init__::232::IOProcess::(_processLogs) (200887) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:01,970::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:01,971::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:01,972::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:01,973::__init__::232::IOProcess::(_processLogs) (200888) Got request for method 'glob' >Thread-136300::DEBUG::2014-10-29 11:17:01,976::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:17:01,976::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200888) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:01,979::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:01,979::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:01,979::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:01,979::__init__::232::IOProcess::(_processLogs) (200889) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:01,981::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200889) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:01,981::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:01,982::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:01,982::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:01,982::__init__::232::IOProcess::(_processLogs) (200890) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:17:01,983::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200890) Queuing response >Thread-136300::DEBUG::2014-10-29 11:17:01,983::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:17:01,985::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:01,985::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:01,986::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:01,987::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200891) Got request for method 'readfile' >Thread-136300::DEBUG::2014-10-29 11:17:01,987::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:17:01,988::__init__::232::IOProcess::(_processLogs) (200891) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:01,990::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:01,991::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:01,992::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:01,992::__init__::232::IOProcess::(_processLogs) (200892) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:01,992::__init__::232::IOProcess::(_processLogs) (200892) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:01,993::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:01,993::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:01,993::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:01,994::__init__::232::IOProcess::(_processLogs) (200893) Got request for method 'glob' >Thread-136300::DEBUG::2014-10-29 11:17:01,994::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:17:01,994::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200893) Queuing response >Thread-136300::INFO::2014-10-29 11:17:01,996::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136300::INFO::2014-10-29 11:17:01,996::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136300::INFO::2014-10-29 11:17:01,997::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:17:01,997::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:01,998::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:01,998::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:01,998::__init__::232::IOProcess::(_processLogs) (200894) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:17:01,999::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200894) Queuing response >Thread-136300::DEBUG::2014-10-29 11:17:01,999::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136300::DEBUG::2014-10-29 11:17:02,001::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`9d00b571-2f64-4b5b-80ba-8fc4ceb33c91`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136300::DEBUG::2014-10-29 11:17:02,002::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136300::DEBUG::2014-10-29 11:17:02,002::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136300::DEBUG::2014-10-29 11:17:02,002::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`9d00b571-2f64-4b5b-80ba-8fc4ceb33c91`::Granted request >Thread-136300::DEBUG::2014-10-29 11:17:02,003::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`03aeb0ad-14c6-4548-89b1-ba4a9703ca12`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136300::DEBUG::2014-10-29 11:17:02,003::task::993::Storage.TaskManager.Task::(_decref) Task=`03aeb0ad-14c6-4548-89b1-ba4a9703ca12`::ref 1 aborting False >Thread-136300::INFO::2014-10-29 11:17:02,006::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136300::DEBUG::2014-10-29 11:17:02,006::task::1191::Storage.TaskManager.Task::(prepare) Task=`03aeb0ad-14c6-4548-89b1-ba4a9703ca12`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136300::DEBUG::2014-10-29 11:17:02,007::task::595::Storage.TaskManager.Task::(_updateState) Task=`03aeb0ad-14c6-4548-89b1-ba4a9703ca12`::moving from state preparing -> state finished >Thread-136300::DEBUG::2014-10-29 11:17:02,007::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136300::DEBUG::2014-10-29 11:17:02,007::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136300::DEBUG::2014-10-29 11:17:02,008::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136300::DEBUG::2014-10-29 11:17:02,008::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136300::DEBUG::2014-10-29 11:17:02,008::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136300::DEBUG::2014-10-29 11:17:02,008::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136300::DEBUG::2014-10-29 11:17:02,009::task::993::Storage.TaskManager.Task::(_decref) Task=`03aeb0ad-14c6-4548-89b1-ba4a9703ca12`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:17:02,033::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54330 >Detector thread::DEBUG::2014-10-29 11:17:02,034::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54330 >Detector thread::DEBUG::2014-10-29 11:17:02,034::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54330 >Detector thread::DEBUG::2014-10-29 11:17:02,034::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54330) >Thread-136305::DEBUG::2014-10-29 11:17:02,073::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136305::DEBUG::2014-10-29 11:17:02,073::task::595::Storage.TaskManager.Task::(_updateState) Task=`e67fa252-58b2-4158-8ad4-aac6db55d12d`::moving from state init -> state preparing >Thread-136305::INFO::2014-10-29 11:17:02,074::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136305::INFO::2014-10-29 11:17:02,074::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000499342', 'lastCheck': '7.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000557003', 'lastCheck': '7.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481515', 'lastCheck': '7.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000644748', 'lastCheck': '7.6', 'valid': True}} >Thread-136305::DEBUG::2014-10-29 11:17:02,075::task::1191::Storage.TaskManager.Task::(prepare) Task=`e67fa252-58b2-4158-8ad4-aac6db55d12d`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000499342', 'lastCheck': '7.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000557003', 'lastCheck': '7.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000481515', 'lastCheck': '7.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000644748', 'lastCheck': '7.6', 'valid': True}} >Thread-136305::DEBUG::2014-10-29 11:17:02,075::task::595::Storage.TaskManager.Task::(_updateState) Task=`e67fa252-58b2-4158-8ad4-aac6db55d12d`::moving from state preparing -> state finished >Thread-136305::DEBUG::2014-10-29 11:17:02,075::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136305::DEBUG::2014-10-29 11:17:02,075::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136305::DEBUG::2014-10-29 11:17:02,076::task::993::Storage.TaskManager.Task::(_decref) Task=`e67fa252-58b2-4158-8ad4-aac6db55d12d`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:02,976::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:02,978::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136306::DEBUG::2014-10-29 11:17:02,982::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:02,984::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:02,986::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136307::DEBUG::2014-10-29 11:17:02,989::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136307::DEBUG::2014-10-29 11:17:02,991::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:17:03,762::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >VM Channels Listener::DEBUG::2014-10-29 11:17:03,884::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >Thread-17::DEBUG::2014-10-29 11:17:04,185::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:04,185::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:04,186::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:04,186::__init__::232::IOProcess::(_processLogs) (200895) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:04,188::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200895) Queuing response >Thread-179::DEBUG::2014-10-29 11:17:04,189::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:17:04,208::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00045222 s, 823 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:17:04,210::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:04,210::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:04,210::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:04,211::__init__::232::IOProcess::(_processLogs) (200896) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:04,212::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200896) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:04,226::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:04,226::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:04,227::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:04,227::__init__::232::IOProcess::(_processLogs) (200897) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:04,227::__init__::232::IOProcess::(_processLogs) (200897) Queuing response >Thread-178::DEBUG::2014-10-29 11:17:04,229::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:17:04,245::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000534314 s, 951 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:17:04,247::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:04,247::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:04,248::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:04,248::__init__::232::IOProcess::(_processLogs) (200898) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:04,250::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200898) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:04,251::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:04,251::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:04,252::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:04,253::__init__::232::IOProcess::(_processLogs) (200899) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:04,253::__init__::232::IOProcess::(_processLogs) (200899) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:04,254::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:04,254::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:04,254::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:04,255::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200900) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:04,256::__init__::232::IOProcess::(_processLogs) (200900) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:04,257::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:04,257::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:04,257::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:04,258::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200901) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:04,258::__init__::232::IOProcess::(_processLogs) (200901) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:04,438::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:04,438::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:04,438::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:04,438::__init__::232::IOProcess::(_processLogs) (200902) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:04,439::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200902) Queuing response >Thread-10269::DEBUG::2014-10-29 11:17:04,440::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:17:04,461::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000416309 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:17:04,462::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:04,463::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:04,463::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:04,463::__init__::232::IOProcess::(_processLogs) (200903) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:04,464::__init__::232::IOProcess::(_processLogs) (200903) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:04,589::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:04,590::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:04,591::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:04,591::__init__::232::IOProcess::(_processLogs) (200904) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:04,591::__init__::232::IOProcess::(_processLogs) (200904) Queuing response >Thread-33::DEBUG::2014-10-29 11:17:04,592::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:17:04,609::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000531732 s, 916 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:17:04,611::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:04,611::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:04,611::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:04,611::__init__::232::IOProcess::(_processLogs) (200905) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:04,613::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200905) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:04,615::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:04,615::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:04,615::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:04,616::__init__::232::IOProcess::(_processLogs) (200906) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:04,617::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200906) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:04,618::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:04,618::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:04,618::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:04,618::__init__::232::IOProcess::(_processLogs) (200907) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:04,619::__init__::232::IOProcess::(_processLogs) (200907) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:04,620::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:04,620::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:04,620::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:04,621::__init__::232::IOProcess::(_processLogs) (200908) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:04,621::__init__::232::IOProcess::(_processLogs) (200908) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:05,081::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:05,082::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:05,085::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:06,007::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:06,009::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136308::DEBUG::2014-10-29 11:17:06,013::task::595::Storage.TaskManager.Task::(_updateState) Task=`d4d4a1e0-5a76-4865-b937-d8df8e4f90fb`::moving from state init -> state preparing >Thread-136308::INFO::2014-10-29 11:17:06,014::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136308::INFO::2014-10-29 11:17:06,014::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534314', 'lastCheck': '1.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531732', 'lastCheck': '1.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00045222', 'lastCheck': '1.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000416309', 'lastCheck': '1.5', 'valid': True}} >Thread-136308::DEBUG::2014-10-29 11:17:06,015::task::1191::Storage.TaskManager.Task::(prepare) Task=`d4d4a1e0-5a76-4865-b937-d8df8e4f90fb`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534314', 'lastCheck': '1.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531732', 'lastCheck': '1.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00045222', 'lastCheck': '1.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000416309', 'lastCheck': '1.5', 'valid': True}} >Thread-136308::DEBUG::2014-10-29 11:17:06,015::task::595::Storage.TaskManager.Task::(_updateState) Task=`d4d4a1e0-5a76-4865-b937-d8df8e4f90fb`::moving from state preparing -> state finished >Thread-136308::DEBUG::2014-10-29 11:17:06,015::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136308::DEBUG::2014-10-29 11:17:06,015::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136308::DEBUG::2014-10-29 11:17:06,016::task::993::Storage.TaskManager.Task::(_decref) Task=`d4d4a1e0-5a76-4865-b937-d8df8e4f90fb`::ref 0 aborting False >Thread-136308::DEBUG::2014-10-29 11:17:06,045::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:06,067::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:06,069::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136309::DEBUG::2014-10-29 11:17:06,072::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136309::DEBUG::2014-10-29 11:17:06,074::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:09,125::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:09,127::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136310::DEBUG::2014-10-29 11:17:09,131::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:09,134::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:09,135::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136311::DEBUG::2014-10-29 11:17:09,139::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136311::DEBUG::2014-10-29 11:17:09,141::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:10,092::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:10,094::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:10,096::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:17:10,203::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54331 >Detector thread::DEBUG::2014-10-29 11:17:10,206::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54331 >Detector thread::DEBUG::2014-10-29 11:17:10,208::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54331 >Detector thread::DEBUG::2014-10-29 11:17:10,209::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54331) >Thread-136312::DEBUG::2014-10-29 11:17:10,246::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136312::DEBUG::2014-10-29 11:17:10,250::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136312::DEBUG::2014-10-29 11:17:10,253::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.15', 'elapsedTime': '514062', 'displayType': 'vnc', 'cpuSys': '0.80', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '5908092', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '64146', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '35744.96'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.48', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:17:10,407::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54333 >Detector thread::DEBUG::2014-10-29 11:17:10,408::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54333 >Detector thread::DEBUG::2014-10-29 11:17:10,408::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54333 >Detector thread::DEBUG::2014-10-29 11:17:10,409::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54333) >Thread-136313::DEBUG::2014-10-29 11:17:10,447::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136313::DEBUG::2014-10-29 11:17:10,449::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136313::DEBUG::2014-10-29 11:17:10,467::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136313::DEBUG::2014-10-29 11:17:10,514::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '89', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '89', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:17:10,905::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54334 >Detector thread::DEBUG::2014-10-29 11:17:10,905::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54334 >Detector thread::DEBUG::2014-10-29 11:17:10,906::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54334 >Detector thread::DEBUG::2014-10-29 11:17:10,906::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54334) >Thread-136314::DEBUG::2014-10-29 11:17:10,946::task::595::Storage.TaskManager.Task::(_updateState) Task=`a2c209e8-6d82-425c-b5c9-dbf7b236e729`::moving from state init -> state preparing >Thread-136314::INFO::2014-10-29 11:17:10,947::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136314::INFO::2014-10-29 11:17:10,947::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534314', 'lastCheck': '6.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531732', 'lastCheck': '6.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00045222', 'lastCheck': '6.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000416309', 'lastCheck': '6.5', 'valid': True}} >Thread-136314::DEBUG::2014-10-29 11:17:10,948::task::1191::Storage.TaskManager.Task::(prepare) Task=`a2c209e8-6d82-425c-b5c9-dbf7b236e729`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534314', 'lastCheck': '6.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531732', 'lastCheck': '6.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00045222', 'lastCheck': '6.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000416309', 'lastCheck': '6.5', 'valid': True}} >Thread-136314::DEBUG::2014-10-29 11:17:10,948::task::595::Storage.TaskManager.Task::(_updateState) Task=`a2c209e8-6d82-425c-b5c9-dbf7b236e729`::moving from state preparing -> state finished >Thread-136314::DEBUG::2014-10-29 11:17:10,948::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136314::DEBUG::2014-10-29 11:17:10,948::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136314::DEBUG::2014-10-29 11:17:10,949::task::993::Storage.TaskManager.Task::(_decref) Task=`a2c209e8-6d82-425c-b5c9-dbf7b236e729`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:12,161::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:12,164::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136315::DEBUG::2014-10-29 11:17:12,166::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:12,169::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:12,171::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136316::DEBUG::2014-10-29 11:17:12,175::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136316::DEBUG::2014-10-29 11:17:12,177::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:17:12,646::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54336 >Detector thread::DEBUG::2014-10-29 11:17:12,647::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54336 >Detector thread::DEBUG::2014-10-29 11:17:12,647::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54336 >Detector thread::DEBUG::2014-10-29 11:17:12,648::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54336) >Thread-136317::DEBUG::2014-10-29 11:17:12,688::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136317::DEBUG::2014-10-29 11:17:12,689::task::595::Storage.TaskManager.Task::(_updateState) Task=`9cadbf0d-a529-4d38-bb64-4ed925e75a3e`::moving from state init -> state preparing >Thread-136317::INFO::2014-10-29 11:17:12,689::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136317::DEBUG::2014-10-29 11:17:12,692::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:17:12,693::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:12,693::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:12,693::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:12,694::__init__::232::IOProcess::(_processLogs) (200909) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:12,695::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200909) Queuing response >Thread-136317::DEBUG::2014-10-29 11:17:12,696::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136317::DEBUG::2014-10-29 11:17:12,696::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136317::INFO::2014-10-29 11:17:12,696::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136317::DEBUG::2014-10-29 11:17:12,697::task::1191::Storage.TaskManager.Task::(prepare) Task=`9cadbf0d-a529-4d38-bb64-4ed925e75a3e`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136317::DEBUG::2014-10-29 11:17:12,697::task::595::Storage.TaskManager.Task::(_updateState) Task=`9cadbf0d-a529-4d38-bb64-4ed925e75a3e`::moving from state preparing -> state finished >Thread-136317::DEBUG::2014-10-29 11:17:12,697::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136317::DEBUG::2014-10-29 11:17:12,697::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136317::DEBUG::2014-10-29 11:17:12,698::task::993::Storage.TaskManager.Task::(_decref) Task=`9cadbf0d-a529-4d38-bb64-4ed925e75a3e`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:17:12,741::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54337 >Detector thread::DEBUG::2014-10-29 11:17:12,742::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54337 >Detector thread::DEBUG::2014-10-29 11:17:12,742::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54337 >Detector thread::DEBUG::2014-10-29 11:17:12,743::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54337) >Thread-136318::DEBUG::2014-10-29 11:17:12,782::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136318::DEBUG::2014-10-29 11:17:12,783::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6c9cb27-16b3-4ea5-97bc-b1b96614f46d`::moving from state init -> state preparing >Thread-136318::INFO::2014-10-29 11:17:12,783::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136318::DEBUG::2014-10-29 11:17:12,783::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136318::DEBUG::2014-10-29 11:17:12,783::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136318::DEBUG::2014-10-29 11:17:12,784::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136318::DEBUG::2014-10-29 11:17:12,784::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136318::DEBUG::2014-10-29 11:17:12,784::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136318::DEBUG::2014-10-29 11:17:12,785::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136318::DEBUG::2014-10-29 11:17:12,879::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136318::DEBUG::2014-10-29 11:17:12,880::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136318::DEBUG::2014-10-29 11:17:13,053::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136318::DEBUG::2014-10-29 11:17:13,054::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136318::DEBUG::2014-10-29 11:17:13,055::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136318::DEBUG::2014-10-29 11:17:13,055::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136318::DEBUG::2014-10-29 11:17:13,056::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136318::DEBUG::2014-10-29 11:17:13,056::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136318::DEBUG::2014-10-29 11:17:13,056::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136318::DEBUG::2014-10-29 11:17:13,057::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:17:13,063::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:13,064::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:13,064::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:13,064::__init__::232::IOProcess::(_processLogs) (200910) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:13,069::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200910) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:13,070::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:13,070::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:13,070::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:13,070::__init__::232::IOProcess::(_processLogs) (200911) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:13,071::__init__::232::IOProcess::(_processLogs) (200911) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:13,080::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:13,084::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:13,087::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:13,089::__init__::232::IOProcess::(_processLogs) (200912) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:13,092::__init__::232::IOProcess::(_processLogs) (200912) Queuing response >Thread-136318::DEBUG::2014-10-29 11:17:13,095::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:17:13,095::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:13,099::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:13,100::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:13,101::__init__::232::IOProcess::(_processLogs) (200913) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:13,104::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200913) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:13,107::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:13,108::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:13,109::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:13,109::__init__::232::IOProcess::(_processLogs) (200914) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:17:13,112::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200914) Queuing response >Thread-136318::DEBUG::2014-10-29 11:17:13,113::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:17:13,116::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:13,116::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:13,116::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:13,117::__init__::232::IOProcess::(_processLogs) (200915) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:17:13,118::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200915) Queuing response >Thread-136318::DEBUG::2014-10-29 11:17:13,118::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:17:13,120::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:13,121::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:13,121::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:13,122::__init__::232::IOProcess::(_processLogs) (200916) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:13,122::__init__::232::IOProcess::(_processLogs) (200916) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:13,122::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:13,123::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:13,123::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:13,123::__init__::232::IOProcess::(_processLogs) (200917) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:13,124::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200917) Queuing response >Thread-136318::DEBUG::2014-10-29 11:17:13,124::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-136318::INFO::2014-10-29 11:17:13,125::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136318::INFO::2014-10-29 11:17:13,126::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136318::INFO::2014-10-29 11:17:13,126::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:17:13,127::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:13,127::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:13,127::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:13,128::__init__::232::IOProcess::(_processLogs) (200918) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:17:13,128::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200918) Queuing response >Thread-136318::DEBUG::2014-10-29 11:17:13,129::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136318::DEBUG::2014-10-29 11:17:13,131::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`57372a7b-2053-49dc-82d4-5b9c70e5e86a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136318::DEBUG::2014-10-29 11:17:13,131::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136318::DEBUG::2014-10-29 11:17:13,132::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136318::DEBUG::2014-10-29 11:17:13,132::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`57372a7b-2053-49dc-82d4-5b9c70e5e86a`::Granted request >Thread-136318::DEBUG::2014-10-29 11:17:13,133::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e6c9cb27-16b3-4ea5-97bc-b1b96614f46d`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136318::DEBUG::2014-10-29 11:17:13,133::task::993::Storage.TaskManager.Task::(_decref) Task=`e6c9cb27-16b3-4ea5-97bc-b1b96614f46d`::ref 1 aborting False >Thread-136318::INFO::2014-10-29 11:17:13,136::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136318::DEBUG::2014-10-29 11:17:13,136::task::1191::Storage.TaskManager.Task::(prepare) Task=`e6c9cb27-16b3-4ea5-97bc-b1b96614f46d`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136318::DEBUG::2014-10-29 11:17:13,136::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6c9cb27-16b3-4ea5-97bc-b1b96614f46d`::moving from state preparing -> state finished >Thread-136318::DEBUG::2014-10-29 11:17:13,137::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136318::DEBUG::2014-10-29 11:17:13,137::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136318::DEBUG::2014-10-29 11:17:13,137::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136318::DEBUG::2014-10-29 11:17:13,138::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136318::DEBUG::2014-10-29 11:17:13,138::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136318::DEBUG::2014-10-29 11:17:13,138::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136318::DEBUG::2014-10-29 11:17:13,138::task::993::Storage.TaskManager.Task::(_decref) Task=`e6c9cb27-16b3-4ea5-97bc-b1b96614f46d`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:17:13,160::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54338 >Detector thread::DEBUG::2014-10-29 11:17:13,161::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54338 >Detector thread::DEBUG::2014-10-29 11:17:13,161::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54338 >Detector thread::DEBUG::2014-10-29 11:17:13,161::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54338) >Thread-136323::DEBUG::2014-10-29 11:17:13,200::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136323::DEBUG::2014-10-29 11:17:13,201::task::595::Storage.TaskManager.Task::(_updateState) Task=`38e0b5ee-8ee0-4879-8f38-f4eec36fbea5`::moving from state init -> state preparing >Thread-136323::INFO::2014-10-29 11:17:13,201::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136323::INFO::2014-10-29 11:17:13,202::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534314', 'lastCheck': '8.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531732', 'lastCheck': '8.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00045222', 'lastCheck': '9.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000416309', 'lastCheck': '8.7', 'valid': True}} >Thread-136323::DEBUG::2014-10-29 11:17:13,202::task::1191::Storage.TaskManager.Task::(prepare) Task=`38e0b5ee-8ee0-4879-8f38-f4eec36fbea5`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534314', 'lastCheck': '8.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531732', 'lastCheck': '8.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00045222', 'lastCheck': '9.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000416309', 'lastCheck': '8.7', 'valid': True}} >Thread-136323::DEBUG::2014-10-29 11:17:13,202::task::595::Storage.TaskManager.Task::(_updateState) Task=`38e0b5ee-8ee0-4879-8f38-f4eec36fbea5`::moving from state preparing -> state finished >Thread-136323::DEBUG::2014-10-29 11:17:13,203::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136323::DEBUG::2014-10-29 11:17:13,203::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136323::DEBUG::2014-10-29 11:17:13,203::task::993::Storage.TaskManager.Task::(_decref) Task=`38e0b5ee-8ee0-4879-8f38-f4eec36fbea5`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:17:14,217::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:14,220::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-179::DEBUG::2014-10-29 11:17:14,222::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:17:14,222::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:14,238::__init__::232::IOProcess::(_processLogs) (200919) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:14,239::__init__::232::IOProcess::(_processLogs) (200919) Queuing response >Thread-179::DEBUG::2014-10-29 11:17:14,240::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000582324 s, 639 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:17:14,241::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:14,242::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:14,242::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:14,242::__init__::232::IOProcess::(_processLogs) (200920) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:14,244::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200920) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:14,260::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:14,261::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:14,261::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:14,262::__init__::232::IOProcess::(_processLogs) (200921) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:14,263::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200921) Queuing response >Thread-178::DEBUG::2014-10-29 11:17:14,265::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:17:14,286::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000996186 s, 510 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:17:14,288::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:14,288::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:14,288::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:14,289::__init__::232::IOProcess::(_processLogs) (200922) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:14,290::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200922) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:14,292::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:14,292::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:14,293::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:14,293::__init__::232::IOProcess::(_processLogs) (200923) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:14,294::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200923) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:14,295::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:14,295::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:14,295::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:14,296::__init__::232::IOProcess::(_processLogs) (200924) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:14,296::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200924) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:14,298::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:14,298::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:14,299::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:14,301::__init__::232::IOProcess::(_processLogs) (200925) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:14,301::__init__::232::IOProcess::(_processLogs) (200925) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:14,466::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:14,467::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:14,467::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:14,467::__init__::232::IOProcess::(_processLogs) (200926) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:14,469::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200926) Queuing response >Thread-10269::DEBUG::2014-10-29 11:17:14,470::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:17:14,488::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000485004 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:17:14,490::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:14,491::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:14,491::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:14,491::__init__::232::IOProcess::(_processLogs) (200927) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:14,491::__init__::232::IOProcess::(_processLogs) (200927) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:14,623::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:14,625::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-33::DEBUG::2014-10-29 11:17:14,626::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:17:14,626::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:14,643::__init__::232::IOProcess::(_processLogs) (200928) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:14,645::__init__::232::IOProcess::(_processLogs) (200928) Queuing response >Thread-33::DEBUG::2014-10-29 11:17:14,646::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000608509 s, 800 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:17:14,648::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:14,648::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:14,649::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:14,649::__init__::232::IOProcess::(_processLogs) (200929) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:14,649::__init__::232::IOProcess::(_processLogs) (200929) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:14,652::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:14,652::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:14,652::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:14,652::__init__::232::IOProcess::(_processLogs) (200930) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:14,653::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200930) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:14,654::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:14,655::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:14,655::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:14,655::__init__::232::IOProcess::(_processLogs) (200931) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:14,656::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200931) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:14,657::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:14,657::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:14,658::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:14,658::__init__::232::IOProcess::(_processLogs) (200932) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:14,660::__init__::232::IOProcess::(_processLogs) (200932) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:15,099::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:15,101::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:15,120::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:15,205::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:15,207::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136324::DEBUG::2014-10-29 11:17:15,211::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:15,214::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:15,215::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136325::DEBUG::2014-10-29 11:17:15,219::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136325::DEBUG::2014-10-29 11:17:15,222::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:18,238::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:18,240::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136326::DEBUG::2014-10-29 11:17:18,243::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:18,245::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:18,247::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136327::DEBUG::2014-10-29 11:17:18,250::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136327::DEBUG::2014-10-29 11:17:18,252::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:17:18,786::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Detector thread::DEBUG::2014-10-29 11:17:19,436::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54339 >Detector thread::DEBUG::2014-10-29 11:17:19,437::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54339 >Detector thread::DEBUG::2014-10-29 11:17:19,437::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54339 >Detector thread::DEBUG::2014-10-29 11:17:19,438::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54339) >Thread-136328::DEBUG::2014-10-29 11:17:19,476::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136328::DEBUG::2014-10-29 11:17:19,478::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136328::DEBUG::2014-10-29 11:17:19,478::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.06', 'elapsedTime': '514071', 'displayType': 'vnc', 'cpuSys': '0.67', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '5908092', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '64146', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '35744.96'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.71', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:20,131::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:20,132::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:20,133::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:17:20,563::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54341 >Detector thread::DEBUG::2014-10-29 11:17:20,564::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54341 >Detector thread::DEBUG::2014-10-29 11:17:20,564::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54341 >Detector thread::DEBUG::2014-10-29 11:17:20,565::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54341) >Thread-136329::DEBUG::2014-10-29 11:17:20,604::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136329::DEBUG::2014-10-29 11:17:20,605::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136329::DEBUG::2014-10-29 11:17:20,625::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136329::DEBUG::2014-10-29 11:17:20,673::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '73', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '73', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:17:20,998::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54342 >Detector thread::DEBUG::2014-10-29 11:17:20,999::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54342 >Detector thread::DEBUG::2014-10-29 11:17:20,999::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54342 >Detector thread::DEBUG::2014-10-29 11:17:21,000::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54342) >Thread-136330::DEBUG::2014-10-29 11:17:21,040::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8ebe497-8ae7-4e5d-8f5e-0504e6ce452d`::moving from state init -> state preparing >Thread-136330::INFO::2014-10-29 11:17:21,041::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136330::INFO::2014-10-29 11:17:21,041::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000996186', 'lastCheck': '6.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000608509', 'lastCheck': '6.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582324', 'lastCheck': '6.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000485004', 'lastCheck': '6.5', 'valid': True}} >Thread-136330::DEBUG::2014-10-29 11:17:21,042::task::1191::Storage.TaskManager.Task::(prepare) Task=`f8ebe497-8ae7-4e5d-8f5e-0504e6ce452d`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000996186', 'lastCheck': '6.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000608509', 'lastCheck': '6.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582324', 'lastCheck': '6.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000485004', 'lastCheck': '6.5', 'valid': True}} >Thread-136330::DEBUG::2014-10-29 11:17:21,042::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8ebe497-8ae7-4e5d-8f5e-0504e6ce452d`::moving from state preparing -> state finished >Thread-136330::DEBUG::2014-10-29 11:17:21,042::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136330::DEBUG::2014-10-29 11:17:21,042::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136330::DEBUG::2014-10-29 11:17:21,043::task::993::Storage.TaskManager.Task::(_decref) Task=`f8ebe497-8ae7-4e5d-8f5e-0504e6ce452d`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:21,267::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:21,270::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136331::DEBUG::2014-10-29 11:17:21,273::task::595::Storage.TaskManager.Task::(_updateState) Task=`477e48d5-7d14-4212-a004-2cd17946931d`::moving from state init -> state preparing >Thread-136331::INFO::2014-10-29 11:17:21,274::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136331::INFO::2014-10-29 11:17:21,274::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000996186', 'lastCheck': '7.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000608509', 'lastCheck': '6.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582324', 'lastCheck': '7.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000485004', 'lastCheck': '6.8', 'valid': True}} >Thread-136331::DEBUG::2014-10-29 11:17:21,274::task::1191::Storage.TaskManager.Task::(prepare) Task=`477e48d5-7d14-4212-a004-2cd17946931d`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000996186', 'lastCheck': '7.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000608509', 'lastCheck': '6.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582324', 'lastCheck': '7.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000485004', 'lastCheck': '6.8', 'valid': True}} >Thread-136331::DEBUG::2014-10-29 11:17:21,275::task::595::Storage.TaskManager.Task::(_updateState) Task=`477e48d5-7d14-4212-a004-2cd17946931d`::moving from state preparing -> state finished >Thread-136331::DEBUG::2014-10-29 11:17:21,275::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136331::DEBUG::2014-10-29 11:17:21,275::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136331::DEBUG::2014-10-29 11:17:21,275::task::993::Storage.TaskManager.Task::(_decref) Task=`477e48d5-7d14-4212-a004-2cd17946931d`::ref 0 aborting False >Thread-136331::DEBUG::2014-10-29 11:17:21,295::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:21,317::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:21,319::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136332::DEBUG::2014-10-29 11:17:21,322::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136332::DEBUG::2014-10-29 11:17:21,325::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:17:23,769::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54344 >Detector thread::DEBUG::2014-10-29 11:17:23,772::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54344 >Detector thread::DEBUG::2014-10-29 11:17:23,772::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54344 >Detector thread::DEBUG::2014-10-29 11:17:23,772::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54344) >Thread-136333::DEBUG::2014-10-29 11:17:23,810::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136333::DEBUG::2014-10-29 11:17:23,811::task::595::Storage.TaskManager.Task::(_updateState) Task=`931f5c97-f7b6-4eb9-9fe2-f910523bc271`::moving from state init -> state preparing >Thread-136333::INFO::2014-10-29 11:17:23,811::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136333::DEBUG::2014-10-29 11:17:23,828::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:17:23,830::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:23,830::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:23,830::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:23,830::__init__::232::IOProcess::(_processLogs) (200933) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:23,831::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200933) Queuing response >Thread-136333::DEBUG::2014-10-29 11:17:23,832::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136333::DEBUG::2014-10-29 11:17:23,832::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136333::INFO::2014-10-29 11:17:23,833::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136333::DEBUG::2014-10-29 11:17:23,833::task::1191::Storage.TaskManager.Task::(prepare) Task=`931f5c97-f7b6-4eb9-9fe2-f910523bc271`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136333::DEBUG::2014-10-29 11:17:23,833::task::595::Storage.TaskManager.Task::(_updateState) Task=`931f5c97-f7b6-4eb9-9fe2-f910523bc271`::moving from state preparing -> state finished >Thread-136333::DEBUG::2014-10-29 11:17:23,834::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136333::DEBUG::2014-10-29 11:17:23,834::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136333::DEBUG::2014-10-29 11:17:23,834::task::993::Storage.TaskManager.Task::(_decref) Task=`931f5c97-f7b6-4eb9-9fe2-f910523bc271`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:17:23,880::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54345 >Detector thread::DEBUG::2014-10-29 11:17:23,881::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54345 >Detector thread::DEBUG::2014-10-29 11:17:23,881::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54345 >Detector thread::DEBUG::2014-10-29 11:17:23,882::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54345) >Thread-136334::DEBUG::2014-10-29 11:17:23,920::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136334::DEBUG::2014-10-29 11:17:23,920::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1b559bd-82b5-46f9-afa4-fa851d76c1ad`::moving from state init -> state preparing >Thread-136334::INFO::2014-10-29 11:17:23,921::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136334::DEBUG::2014-10-29 11:17:23,921::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136334::DEBUG::2014-10-29 11:17:23,921::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136334::DEBUG::2014-10-29 11:17:23,922::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136334::DEBUG::2014-10-29 11:17:23,922::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136334::DEBUG::2014-10-29 11:17:23,922::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136334::DEBUG::2014-10-29 11:17:23,923::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136334::DEBUG::2014-10-29 11:17:24,011::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136334::DEBUG::2014-10-29 11:17:24,012::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136334::DEBUG::2014-10-29 11:17:24,209::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136334::DEBUG::2014-10-29 11:17:24,212::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136334::DEBUG::2014-10-29 11:17:24,212::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136334::DEBUG::2014-10-29 11:17:24,213::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136334::DEBUG::2014-10-29 11:17:24,213::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136334::DEBUG::2014-10-29 11:17:24,214::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136334::DEBUG::2014-10-29 11:17:24,214::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136334::DEBUG::2014-10-29 11:17:24,214::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:17:24,224::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:24,226::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:24,227::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:24,227::__init__::232::IOProcess::(_processLogs) (200934) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:24,228::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200934) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:24,230::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:24,230::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:24,231::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:24,231::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:24,231::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:24,231::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:24,232::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:24,232::__init__::232::IOProcess::(_processLogs) (200935) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:24,232::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:24,232::__init__::232::IOProcess::(_processLogs) (200936) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:24,233::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200935) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:24,236::__init__::232::IOProcess::(_processLogs) (200936) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:24,238::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:24,239::__init__::232::IOProcess::(_processLogs) (200937) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:24,243::__init__::232::IOProcess::(_processLogs) (200937) Queuing response >Thread-136334::DEBUG::2014-10-29 11:17:24,248::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:17:24,252::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:24,253::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:24,253::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:24,253::__init__::232::IOProcess::(_processLogs) (200938) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:24,255::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200938) Queuing response >Thread-179::DEBUG::2014-10-29 11:17:24,256::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:17:24,256::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:24,274::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:24,275::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:24,275::__init__::232::IOProcess::(_processLogs) (200939) Got request for method 'touch' >Thread-136334::DEBUG::2014-10-29 11:17:24,277::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:17:24,277::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200939) Queuing response >Thread-179::DEBUG::2014-10-29 11:17:24,282::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000595054 s, 625 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:17:24,283::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:24,285::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:24,285::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:24,285::__init__::232::IOProcess::(_processLogs) (200940) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:17:24,286::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200940) Queuing response >Thread-136334::DEBUG::2014-10-29 11:17:24,286::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:17:24,289::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:24,290::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:24,290::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:24,291::__init__::232::IOProcess::(_processLogs) (200941) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:24,292::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200941) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:24,293::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:24,294::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:24,296::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:24,296::__init__::232::IOProcess::(_processLogs) (200942) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:24,297::__init__::232::IOProcess::(_processLogs) (200942) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:24,297::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:24,297::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:24,298::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:24,298::__init__::232::IOProcess::(_processLogs) (200943) Got request for method 'glob' >Thread-136334::DEBUG::2014-10-29 11:17:24,299::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-136334::INFO::2014-10-29 11:17:24,300::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:17:24,299::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200943) Queuing response >Thread-136334::INFO::2014-10-29 11:17:24,300::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136334::INFO::2014-10-29 11:17:24,303::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:17:24,304::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:24,305::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:24,305::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:24,305::__init__::232::IOProcess::(_processLogs) (200944) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:24,306::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200944) Queuing response >Thread-178::DEBUG::2014-10-29 11:17:24,308::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:17:24,309::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:24,325::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:24,325::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:24,326::__init__::232::IOProcess::(_processLogs) (200945) Got request for method 'readfile' >Thread-136334::DEBUG::2014-10-29 11:17:24,327::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:17:24,327::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200945) Queuing response >Thread-178::DEBUG::2014-10-29 11:17:24,333::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00154482 s, 329 kB/s\n'; <rc> = 0 >Thread-136334::DEBUG::2014-10-29 11:17:24,334::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`ba35e9fb-d220-4e67-a81b-375ac94341bf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136334::DEBUG::2014-10-29 11:17:24,336::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-17::DEBUG::2014-10-29 11:17:24,337::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:24,338::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-136334::DEBUG::2014-10-29 11:17:24,339::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-17::DEBUG::2014-10-29 11:17:24,339::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-136334::DEBUG::2014-10-29 11:17:24,340::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`ba35e9fb-d220-4e67-a81b-375ac94341bf`::Granted request >Thread-17::DEBUG::2014-10-29 11:17:24,341::__init__::232::IOProcess::(_processLogs) (200946) Got request for method 'statvfs' >Thread-136334::DEBUG::2014-10-29 11:17:24,345::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f1b559bd-82b5-46f9-afa4-fa851d76c1ad`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-17::DEBUG::2014-10-29 11:17:24,347::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200946) Queuing response >Thread-136334::DEBUG::2014-10-29 11:17:24,348::task::993::Storage.TaskManager.Task::(_decref) Task=`f1b559bd-82b5-46f9-afa4-fa851d76c1ad`::ref 1 aborting False >Thread-17::DEBUG::2014-10-29 11:17:24,351::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:24,352::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:24,354::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:24,355::__init__::232::IOProcess::(_processLogs) (200947) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:24,358::__init__::232::IOProcess::(_processLogs) (200947) Queuing response >Thread-136334::INFO::2014-10-29 11:17:24,364::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136334::DEBUG::2014-10-29 11:17:24,364::task::1191::Storage.TaskManager.Task::(prepare) Task=`f1b559bd-82b5-46f9-afa4-fa851d76c1ad`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136334::DEBUG::2014-10-29 11:17:24,365::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1b559bd-82b5-46f9-afa4-fa851d76c1ad`::moving from state preparing -> state finished >Thread-136334::DEBUG::2014-10-29 11:17:24,365::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136334::DEBUG::2014-10-29 11:17:24,365::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136334::DEBUG::2014-10-29 11:17:24,366::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-17::DEBUG::2014-10-29 11:17:24,369::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-136334::DEBUG::2014-10-29 11:17:24,370::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:24,369::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-136334::DEBUG::2014-10-29 11:17:24,371::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-17::DEBUG::2014-10-29 11:17:24,372::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-136334::DEBUG::2014-10-29 11:17:24,374::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-17::DEBUG::2014-10-29 11:17:24,376::__init__::232::IOProcess::(_processLogs) Extracting request information... >JsonRpcServer::DEBUG::2014-10-29 11:17:24,379::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:17:24,379::__init__::232::IOProcess::(_processLogs) (200948) Got request for method 'access' >Thread-136334::DEBUG::2014-10-29 11:17:24,383::task::993::Storage.TaskManager.Task::(_decref) Task=`f1b559bd-82b5-46f9-afa4-fa851d76c1ad`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:17:24,384::__init__::232::IOProcess::(_processLogs) (200948) Queuing response >Thread-136339::DEBUG::2014-10-29 11:17:24,396::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:17:24,400::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:24,401::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:24,401::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:24,402::__init__::232::IOProcess::(_processLogs) (200949) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:24,402::__init__::232::IOProcess::(_processLogs) (200949) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:24,404::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:24,406::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136340::DEBUG::2014-10-29 11:17:24,410::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136340::DEBUG::2014-10-29 11:17:24,412::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:17:24,420::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54346 >Detector thread::DEBUG::2014-10-29 11:17:24,420::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54346 >Detector thread::DEBUG::2014-10-29 11:17:24,421::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54346 >Detector thread::DEBUG::2014-10-29 11:17:24,421::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54346) >Thread-136341::DEBUG::2014-10-29 11:17:24,460::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136341::DEBUG::2014-10-29 11:17:24,460::task::595::Storage.TaskManager.Task::(_updateState) Task=`422fa6d7-0132-4ceb-9a3d-814e8bf65bea`::moving from state init -> state preparing >Thread-136341::INFO::2014-10-29 11:17:24,461::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136341::INFO::2014-10-29 11:17:24,461::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00154482', 'lastCheck': '0.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000608509', 'lastCheck': '9.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595054', 'lastCheck': '0.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000485004', 'lastCheck': '10.0', 'valid': True}} >Thread-136341::DEBUG::2014-10-29 11:17:24,462::task::1191::Storage.TaskManager.Task::(prepare) Task=`422fa6d7-0132-4ceb-9a3d-814e8bf65bea`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00154482', 'lastCheck': '0.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000608509', 'lastCheck': '9.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595054', 'lastCheck': '0.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000485004', 'lastCheck': '10.0', 'valid': True}} >Thread-136341::DEBUG::2014-10-29 11:17:24,462::task::595::Storage.TaskManager.Task::(_updateState) Task=`422fa6d7-0132-4ceb-9a3d-814e8bf65bea`::moving from state preparing -> state finished >Thread-136341::DEBUG::2014-10-29 11:17:24,462::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136341::DEBUG::2014-10-29 11:17:24,462::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136341::DEBUG::2014-10-29 11:17:24,463::task::993::Storage.TaskManager.Task::(_decref) Task=`422fa6d7-0132-4ceb-9a3d-814e8bf65bea`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:17:24,494::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:24,495::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:24,495::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:24,495::__init__::232::IOProcess::(_processLogs) (200950) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:24,497::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200950) Queuing response >Thread-10269::DEBUG::2014-10-29 11:17:24,498::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:17:24,515::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000407166 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:17:24,517::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:24,517::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:24,517::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:24,518::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200951) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:24,519::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200951) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:24,661::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:24,661::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:24,661::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:24,662::__init__::232::IOProcess::(_processLogs) (200952) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:24,663::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200952) Queuing response >Thread-33::DEBUG::2014-10-29 11:17:24,664::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:17:24,683::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000642793 s, 758 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:17:24,685::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:24,685::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:24,685::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:24,686::__init__::232::IOProcess::(_processLogs) (200953) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:24,688::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200953) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:24,689::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:24,689::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:24,690::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:24,690::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200954) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:24,691::__init__::232::IOProcess::(_processLogs) (200954) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:24,692::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:24,692::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:24,693::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:24,694::__init__::232::IOProcess::(_processLogs) (200955) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:24,694::__init__::232::IOProcess::(_processLogs) (200955) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:24,694::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:24,695::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:24,695::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:24,696::__init__::232::IOProcess::(_processLogs) (200956) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:24,697::__init__::232::IOProcess::(_processLogs) (200956) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:25,141::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:25,142::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:25,145::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:27,431::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:27,434::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136342::DEBUG::2014-10-29 11:17:27,438::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:27,440::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:27,442::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136343::DEBUG::2014-10-29 11:17:27,446::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136343::DEBUG::2014-10-29 11:17:27,448::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:17:29,629::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54347 >Detector thread::DEBUG::2014-10-29 11:17:29,630::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54347 >Detector thread::DEBUG::2014-10-29 11:17:29,631::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54347 >Detector thread::DEBUG::2014-10-29 11:17:29,631::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54347) >Thread-136344::DEBUG::2014-10-29 11:17:29,670::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136344::DEBUG::2014-10-29 11:17:29,671::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136344::DEBUG::2014-10-29 11:17:29,672::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.06', 'elapsedTime': '514082', 'displayType': 'vnc', 'cpuSys': '0.67', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '5908092', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '64146', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '35744.96'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.88', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:30,152::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:30,153::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:30,155::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:30,464::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:30,466::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136345::DEBUG::2014-10-29 11:17:30,470::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:30,472::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:30,473::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136346::DEBUG::2014-10-29 11:17:30,476::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136346::DEBUG::2014-10-29 11:17:30,479::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:17:30,723::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54349 >Detector thread::DEBUG::2014-10-29 11:17:30,724::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54349 >Detector thread::DEBUG::2014-10-29 11:17:30,724::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54349 >Detector thread::DEBUG::2014-10-29 11:17:30,725::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54349) >Thread-136347::DEBUG::2014-10-29 11:17:30,764::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136347::DEBUG::2014-10-29 11:17:30,765::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136347::DEBUG::2014-10-29 11:17:30,783::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136347::DEBUG::2014-10-29 11:17:30,831::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '58', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '58', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:17:31,130::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54350 >Detector thread::DEBUG::2014-10-29 11:17:31,131::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54350 >Detector thread::DEBUG::2014-10-29 11:17:31,131::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54350 >Detector thread::DEBUG::2014-10-29 11:17:31,132::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54350) >Thread-136348::DEBUG::2014-10-29 11:17:31,171::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d868fe6-608b-4a48-a003-0ce37de0e3c5`::moving from state init -> state preparing >Thread-136348::INFO::2014-10-29 11:17:31,172::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136348::INFO::2014-10-29 11:17:31,172::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00154482', 'lastCheck': '6.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642793', 'lastCheck': '6.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595054', 'lastCheck': '6.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000407166', 'lastCheck': '6.7', 'valid': True}} >Thread-136348::DEBUG::2014-10-29 11:17:31,173::task::1191::Storage.TaskManager.Task::(prepare) Task=`9d868fe6-608b-4a48-a003-0ce37de0e3c5`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00154482', 'lastCheck': '6.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642793', 'lastCheck': '6.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000595054', 'lastCheck': '6.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000407166', 'lastCheck': '6.7', 'valid': True}} >Thread-136348::DEBUG::2014-10-29 11:17:31,173::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d868fe6-608b-4a48-a003-0ce37de0e3c5`::moving from state preparing -> state finished >Thread-136348::DEBUG::2014-10-29 11:17:31,173::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136348::DEBUG::2014-10-29 11:17:31,173::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136348::DEBUG::2014-10-29 11:17:31,174::task::993::Storage.TaskManager.Task::(_decref) Task=`9d868fe6-608b-4a48-a003-0ce37de0e3c5`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:33,494::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:33,497::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136349::DEBUG::2014-10-29 11:17:33,500::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:33,502::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:33,504::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136350::DEBUG::2014-10-29 11:17:33,507::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136350::DEBUG::2014-10-29 11:17:33,509::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:17:33,807::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >VM Channels Listener::DEBUG::2014-10-29 11:17:33,920::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >Thread-17::DEBUG::2014-10-29 11:17:34,296::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:34,296::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:34,297::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:34,297::__init__::232::IOProcess::(_processLogs) (200957) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:34,299::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200957) Queuing response >Thread-179::DEBUG::2014-10-29 11:17:34,300::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:17:34,320::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000480688 s, 774 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:17:34,321::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:34,322::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:34,322::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:34,322::__init__::232::IOProcess::(_processLogs) (200958) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:34,324::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200958) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:34,406::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:34,409::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-178::DEBUG::2014-10-29 11:17:34,411::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:17:34,412::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:34,434::__init__::232::IOProcess::(_processLogs) (200959) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:17:34,437::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000594513 s, 854 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:17:34,438::__init__::232::IOProcess::(_processLogs) (200959) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:34,440::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:34,440::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:34,441::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:34,441::__init__::232::IOProcess::(_processLogs) (200960) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:34,443::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200960) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:34,444::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:34,444::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:34,446::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:34,447::__init__::232::IOProcess::(_processLogs) (200961) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:34,447::__init__::232::IOProcess::(_processLogs) (200961) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:34,447::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:34,448::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:34,448::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:34,448::__init__::232::IOProcess::(_processLogs) (200962) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:34,449::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200962) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:34,450::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:34,451::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:34,453::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:34,453::__init__::232::IOProcess::(_processLogs) (200963) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:34,453::__init__::232::IOProcess::(_processLogs) (200963) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:34,522::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:34,523::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:34,523::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:34,523::__init__::232::IOProcess::(_processLogs) (200964) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:34,524::__init__::232::IOProcess::(_processLogs) (200964) Queuing response >Thread-10269::DEBUG::2014-10-29 11:17:34,525::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:17:34,543::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000856028 s, 586 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:17:34,545::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:34,546::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:34,546::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:34,546::__init__::232::IOProcess::(_processLogs) (200965) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:34,548::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200965) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:34,698::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:34,699::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:34,699::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:34,699::__init__::232::IOProcess::(_processLogs) (200966) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:34,699::__init__::232::IOProcess::(_processLogs) (200966) Queuing response >Thread-33::DEBUG::2014-10-29 11:17:34,701::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:17:34,719::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000422775 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:17:34,721::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:34,721::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:34,722::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:34,722::__init__::232::IOProcess::(_processLogs) (200967) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:34,723::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200967) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:34,725::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:34,726::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:34,727::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:34,727::__init__::232::IOProcess::(_processLogs) (200968) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:34,727::__init__::232::IOProcess::(_processLogs) (200968) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:34,728::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:34,728::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:34,729::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:34,729::__init__::232::IOProcess::(_processLogs) (200969) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:34,730::__init__::232::IOProcess::(_processLogs) (200969) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:34,730::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:34,730::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:34,731::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:34,731::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200970) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:34,732::__init__::232::IOProcess::(_processLogs) (200970) Queuing response >Detector thread::DEBUG::2014-10-29 11:17:35,033::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54352 >Detector thread::DEBUG::2014-10-29 11:17:35,034::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54352 >Detector thread::DEBUG::2014-10-29 11:17:35,034::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54352 >Detector thread::DEBUG::2014-10-29 11:17:35,035::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54352) >Thread-136351::DEBUG::2014-10-29 11:17:35,075::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136351::DEBUG::2014-10-29 11:17:35,076::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7693c54-f9c4-4b4b-b4fc-300449007b86`::moving from state init -> state preparing >Thread-136351::INFO::2014-10-29 11:17:35,076::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136351::DEBUG::2014-10-29 11:17:35,079::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:17:35,080::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:35,080::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:35,081::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:35,081::__init__::232::IOProcess::(_processLogs) (200971) Got request for method 'glob' >Thread-136351::DEBUG::2014-10-29 11:17:35,082::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:17:35,082::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200971) Queuing response >Thread-136351::DEBUG::2014-10-29 11:17:35,084::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136351::INFO::2014-10-29 11:17:35,085::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136351::DEBUG::2014-10-29 11:17:35,085::task::1191::Storage.TaskManager.Task::(prepare) Task=`a7693c54-f9c4-4b4b-b4fc-300449007b86`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136351::DEBUG::2014-10-29 11:17:35,085::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7693c54-f9c4-4b4b-b4fc-300449007b86`::moving from state preparing -> state finished >Thread-136351::DEBUG::2014-10-29 11:17:35,085::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136351::DEBUG::2014-10-29 11:17:35,086::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136351::DEBUG::2014-10-29 11:17:35,086::task::993::Storage.TaskManager.Task::(_decref) Task=`a7693c54-f9c4-4b4b-b4fc-300449007b86`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:17:35,129::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54353 >Detector thread::DEBUG::2014-10-29 11:17:35,130::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54353 >Detector thread::DEBUG::2014-10-29 11:17:35,130::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54353 >Detector thread::DEBUG::2014-10-29 11:17:35,131::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54353) >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:35,163::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:35,164::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:35,167::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136352::DEBUG::2014-10-29 11:17:35,171::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136352::DEBUG::2014-10-29 11:17:35,171::task::595::Storage.TaskManager.Task::(_updateState) Task=`b91f86c6-cb53-49f1-a7e5-25ffbe8be77b`::moving from state init -> state preparing >Thread-136352::INFO::2014-10-29 11:17:35,172::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136352::DEBUG::2014-10-29 11:17:35,172::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136352::DEBUG::2014-10-29 11:17:35,172::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136352::DEBUG::2014-10-29 11:17:35,173::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136352::DEBUG::2014-10-29 11:17:35,173::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136352::DEBUG::2014-10-29 11:17:35,173::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136352::DEBUG::2014-10-29 11:17:35,174::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136352::DEBUG::2014-10-29 11:17:35,256::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136352::DEBUG::2014-10-29 11:17:35,257::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136352::DEBUG::2014-10-29 11:17:35,425::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136352::DEBUG::2014-10-29 11:17:35,426::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136352::DEBUG::2014-10-29 11:17:35,427::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136352::DEBUG::2014-10-29 11:17:35,427::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136352::DEBUG::2014-10-29 11:17:35,428::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136352::DEBUG::2014-10-29 11:17:35,428::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136352::DEBUG::2014-10-29 11:17:35,428::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136352::DEBUG::2014-10-29 11:17:35,429::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:17:35,436::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:35,438::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:35,438::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:35,439::__init__::232::IOProcess::(_processLogs) (200972) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:35,440::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200972) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:35,441::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:35,442::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:35,443::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:35,446::__init__::232::IOProcess::(_processLogs) (200973) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:35,448::__init__::232::IOProcess::(_processLogs) (200973) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:35,450::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:35,452::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-136352::DEBUG::2014-10-29 11:17:35,455::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:17:35,457::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:35,458::__init__::232::IOProcess::(_processLogs) (200974) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:35,458::__init__::232::IOProcess::(_processLogs) (200974) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:35,459::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:35,460::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:35,461::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:35,461::__init__::232::IOProcess::(_processLogs) (200975) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:35,461::__init__::232::IOProcess::(_processLogs) (200975) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:35,461::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:35,462::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:35,462::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:35,462::__init__::232::IOProcess::(_processLogs) (200976) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:17:35,463::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200976) Queuing response >Thread-136352::DEBUG::2014-10-29 11:17:35,464::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:17:35,464::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:35,465::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:35,465::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:35,465::__init__::232::IOProcess::(_processLogs) (200977) Got request for method 'readfile' >Thread-136352::DEBUG::2014-10-29 11:17:35,466::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:17:35,466::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200977) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:35,468::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:35,469::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:35,470::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:35,470::__init__::232::IOProcess::(_processLogs) (200978) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:35,470::__init__::232::IOProcess::(_processLogs) (200978) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:35,471::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:35,471::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-136352::DEBUG::2014-10-29 11:17:35,472::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:17:35,472::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-136352::INFO::2014-10-29 11:17:35,473::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:17:35,474::__init__::232::IOProcess::(_processLogs) (200979) Got request for method 'glob' >Thread-136352::INFO::2014-10-29 11:17:35,474::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:17:35,475::__init__::232::IOProcess::(_processLogs) (200979) Queuing response >Thread-136352::INFO::2014-10-29 11:17:35,476::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:17:35,477::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:35,478::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:35,478::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-136352::DEBUG::2014-10-29 11:17:35,479::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:17:35,479::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200980) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:17:35,481::__init__::232::IOProcess::(_processLogs) (200980) Queuing response >Thread-136352::DEBUG::2014-10-29 11:17:35,483::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`8709908d-c8fe-4e38-af8d-0ee3c503ae60`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136352::DEBUG::2014-10-29 11:17:35,483::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136352::DEBUG::2014-10-29 11:17:35,484::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136352::DEBUG::2014-10-29 11:17:35,484::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`8709908d-c8fe-4e38-af8d-0ee3c503ae60`::Granted request >Thread-136352::DEBUG::2014-10-29 11:17:35,485::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b91f86c6-cb53-49f1-a7e5-25ffbe8be77b`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136352::DEBUG::2014-10-29 11:17:35,485::task::993::Storage.TaskManager.Task::(_decref) Task=`b91f86c6-cb53-49f1-a7e5-25ffbe8be77b`::ref 1 aborting False >Thread-136352::INFO::2014-10-29 11:17:35,488::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136352::DEBUG::2014-10-29 11:17:35,488::task::1191::Storage.TaskManager.Task::(prepare) Task=`b91f86c6-cb53-49f1-a7e5-25ffbe8be77b`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136352::DEBUG::2014-10-29 11:17:35,488::task::595::Storage.TaskManager.Task::(_updateState) Task=`b91f86c6-cb53-49f1-a7e5-25ffbe8be77b`::moving from state preparing -> state finished >Thread-136352::DEBUG::2014-10-29 11:17:35,489::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136352::DEBUG::2014-10-29 11:17:35,489::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136352::DEBUG::2014-10-29 11:17:35,489::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136352::DEBUG::2014-10-29 11:17:35,490::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136352::DEBUG::2014-10-29 11:17:35,490::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136352::DEBUG::2014-10-29 11:17:35,490::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136352::DEBUG::2014-10-29 11:17:35,491::task::993::Storage.TaskManager.Task::(_decref) Task=`b91f86c6-cb53-49f1-a7e5-25ffbe8be77b`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:17:35,513::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54354 >Detector thread::DEBUG::2014-10-29 11:17:35,513::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54354 >Detector thread::DEBUG::2014-10-29 11:17:35,514::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54354 >Detector thread::DEBUG::2014-10-29 11:17:35,514::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54354) >Thread-136357::DEBUG::2014-10-29 11:17:35,553::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136357::DEBUG::2014-10-29 11:17:35,554::task::595::Storage.TaskManager.Task::(_updateState) Task=`34a98a02-9d10-4629-80e0-6850fc4acdb2`::moving from state init -> state preparing >Thread-136357::INFO::2014-10-29 11:17:35,555::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136357::INFO::2014-10-29 11:17:35,556::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594513', 'lastCheck': '1.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422775', 'lastCheck': '0.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480688', 'lastCheck': '1.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000856028', 'lastCheck': '1.0', 'valid': True}} >Thread-136357::DEBUG::2014-10-29 11:17:35,556::task::1191::Storage.TaskManager.Task::(prepare) Task=`34a98a02-9d10-4629-80e0-6850fc4acdb2`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594513', 'lastCheck': '1.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422775', 'lastCheck': '0.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480688', 'lastCheck': '1.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000856028', 'lastCheck': '1.0', 'valid': True}} >Thread-136357::DEBUG::2014-10-29 11:17:35,556::task::595::Storage.TaskManager.Task::(_updateState) Task=`34a98a02-9d10-4629-80e0-6850fc4acdb2`::moving from state preparing -> state finished >Thread-136357::DEBUG::2014-10-29 11:17:35,556::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136357::DEBUG::2014-10-29 11:17:35,557::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136357::DEBUG::2014-10-29 11:17:35,557::task::993::Storage.TaskManager.Task::(_decref) Task=`34a98a02-9d10-4629-80e0-6850fc4acdb2`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:36,534::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:36,537::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136358::DEBUG::2014-10-29 11:17:36,541::task::595::Storage.TaskManager.Task::(_updateState) Task=`f2e577dc-f568-4adb-b8bb-3866603650fa`::moving from state init -> state preparing >Thread-136358::INFO::2014-10-29 11:17:36,542::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136358::INFO::2014-10-29 11:17:36,542::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594513', 'lastCheck': '2.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422775', 'lastCheck': '1.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480688', 'lastCheck': '2.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000856028', 'lastCheck': '2.0', 'valid': True}} >Thread-136358::DEBUG::2014-10-29 11:17:36,543::task::1191::Storage.TaskManager.Task::(prepare) Task=`f2e577dc-f568-4adb-b8bb-3866603650fa`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594513', 'lastCheck': '2.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422775', 'lastCheck': '1.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480688', 'lastCheck': '2.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000856028', 'lastCheck': '2.0', 'valid': True}} >Thread-136358::DEBUG::2014-10-29 11:17:36,543::task::595::Storage.TaskManager.Task::(_updateState) Task=`f2e577dc-f568-4adb-b8bb-3866603650fa`::moving from state preparing -> state finished >Thread-136358::DEBUG::2014-10-29 11:17:36,543::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136358::DEBUG::2014-10-29 11:17:36,543::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136358::DEBUG::2014-10-29 11:17:36,544::task::993::Storage.TaskManager.Task::(_decref) Task=`f2e577dc-f568-4adb-b8bb-3866603650fa`::ref 0 aborting False >Thread-136358::DEBUG::2014-10-29 11:17:36,580::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:36,602::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:36,605::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136359::DEBUG::2014-10-29 11:17:36,608::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136359::DEBUG::2014-10-29 11:17:36,610::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:39,651::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:39,654::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136360::DEBUG::2014-10-29 11:17:39,659::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:39,661::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:39,663::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136361::DEBUG::2014-10-29 11:17:39,666::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136361::DEBUG::2014-10-29 11:17:39,668::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:17:39,826::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54355 >Detector thread::DEBUG::2014-10-29 11:17:39,827::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54355 >Detector thread::DEBUG::2014-10-29 11:17:39,827::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54355 >Detector thread::DEBUG::2014-10-29 11:17:39,828::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54355) >Thread-136362::DEBUG::2014-10-29 11:17:39,866::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136362::DEBUG::2014-10-29 11:17:39,867::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136362::DEBUG::2014-10-29 11:17:39,868::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.74', 'elapsedTime': '514092', 'displayType': 'vnc', 'cpuSys': '0.87', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '5908092', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '64146', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '35744.96'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.06', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:40,172::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:40,174::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:40,175::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:17:40,238::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54357 >Detector thread::DEBUG::2014-10-29 11:17:40,238::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54357 >Detector thread::DEBUG::2014-10-29 11:17:40,239::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54357 >Detector thread::DEBUG::2014-10-29 11:17:40,239::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54357) >Thread-136363::DEBUG::2014-10-29 11:17:40,279::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7324205-8da3-4277-87b7-fa01f4786ddc`::moving from state init -> state preparing >Thread-136363::INFO::2014-10-29 11:17:40,279::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136363::INFO::2014-10-29 11:17:40,280::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594513', 'lastCheck': '5.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422775', 'lastCheck': '5.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480688', 'lastCheck': '5.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000856028', 'lastCheck': '5.7', 'valid': True}} >Thread-136363::DEBUG::2014-10-29 11:17:40,280::task::1191::Storage.TaskManager.Task::(prepare) Task=`e7324205-8da3-4277-87b7-fa01f4786ddc`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594513', 'lastCheck': '5.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422775', 'lastCheck': '5.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000480688', 'lastCheck': '5.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000856028', 'lastCheck': '5.7', 'valid': True}} >Thread-136363::DEBUG::2014-10-29 11:17:40,281::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7324205-8da3-4277-87b7-fa01f4786ddc`::moving from state preparing -> state finished >Thread-136363::DEBUG::2014-10-29 11:17:40,281::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136363::DEBUG::2014-10-29 11:17:40,281::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136363::DEBUG::2014-10-29 11:17:40,281::task::993::Storage.TaskManager.Task::(_decref) Task=`e7324205-8da3-4277-87b7-fa01f4786ddc`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:17:40,880::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54358 >Detector thread::DEBUG::2014-10-29 11:17:40,880::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54358 >Detector thread::DEBUG::2014-10-29 11:17:40,881::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54358 >Detector thread::DEBUG::2014-10-29 11:17:40,881::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54358) >Thread-136364::DEBUG::2014-10-29 11:17:40,920::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136364::DEBUG::2014-10-29 11:17:40,922::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136364::DEBUG::2014-10-29 11:17:40,942::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136364::DEBUG::2014-10-29 11:17:40,989::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '42', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '42', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:42,687::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:42,689::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136365::DEBUG::2014-10-29 11:17:42,693::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:42,695::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:42,696::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136366::DEBUG::2014-10-29 11:17:42,699::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136366::DEBUG::2014-10-29 11:17:42,702::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:17:44,339::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:44,341::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:44,341::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:44,341::__init__::232::IOProcess::(_processLogs) (200981) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:44,343::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200981) Queuing response >Thread-179::DEBUG::2014-10-29 11:17:44,344::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:17:44,362::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000506659 s, 734 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:17:44,364::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:44,364::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:44,364::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:44,365::__init__::232::IOProcess::(_processLogs) (200982) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:44,365::__init__::232::IOProcess::(_processLogs) (200982) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:44,454::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:44,454::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:44,455::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:44,455::__init__::232::IOProcess::(_processLogs) (200983) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:44,455::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200983) Queuing response >Thread-178::DEBUG::2014-10-29 11:17:44,457::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:17:44,475::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00048897 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:17:44,477::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:44,478::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:44,478::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:44,478::__init__::232::IOProcess::(_processLogs) (200984) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:44,480::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200984) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:44,482::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:44,482::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:44,483::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:44,484::__init__::232::IOProcess::(_processLogs) (200985) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:44,484::__init__::232::IOProcess::(_processLogs) (200985) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:44,485::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:44,485::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:44,485::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:44,486::__init__::232::IOProcess::(_processLogs) (200986) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:44,486::__init__::232::IOProcess::(_processLogs) (200986) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:44,487::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:44,487::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:44,487::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:44,488::__init__::232::IOProcess::(_processLogs) (200987) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:44,488::__init__::232::IOProcess::(_processLogs) (200987) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:44,552::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:44,552::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:44,552::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:44,553::__init__::232::IOProcess::(_processLogs) (200988) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:44,553::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200988) Queuing response >Thread-10269::DEBUG::2014-10-29 11:17:44,556::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:17:44,583::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000513633 s, 977 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:17:44,588::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:44,589::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:44,589::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:44,589::__init__::232::IOProcess::(_processLogs) (200989) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:44,590::__init__::232::IOProcess::(_processLogs) (200989) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:44,734::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:44,734::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:44,735::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:44,735::__init__::232::IOProcess::(_processLogs) (200990) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:44,735::__init__::232::IOProcess::(_processLogs) (200990) Queuing response >Thread-33::DEBUG::2014-10-29 11:17:44,736::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:17:44,755::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000506557 s, 961 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:17:44,757::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:44,758::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:44,760::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:44,760::__init__::232::IOProcess::(_processLogs) (200991) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:44,760::__init__::232::IOProcess::(_processLogs) (200991) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:44,761::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:44,761::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:44,762::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:44,763::__init__::232::IOProcess::(_processLogs) (200992) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:44,763::__init__::232::IOProcess::(_processLogs) (200992) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:44,764::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:44,765::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:44,766::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:44,766::__init__::232::IOProcess::(_processLogs) (200993) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:44,766::__init__::232::IOProcess::(_processLogs) (200993) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:44,767::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:44,767::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:44,768::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:44,768::__init__::232::IOProcess::(_processLogs) (200994) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:44,769::__init__::232::IOProcess::(_processLogs) (200994) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:45,183::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:45,184::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:45,187::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:45,717::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:45,722::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136367::DEBUG::2014-10-29 11:17:45,726::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:45,728::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:45,731::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136368::DEBUG::2014-10-29 11:17:45,734::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136368::DEBUG::2014-10-29 11:17:45,736::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:17:46,124::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54360 >Detector thread::DEBUG::2014-10-29 11:17:46,124::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54360 >Detector thread::DEBUG::2014-10-29 11:17:46,125::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54360 >Detector thread::DEBUG::2014-10-29 11:17:46,125::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54360) >Thread-136369::DEBUG::2014-10-29 11:17:46,169::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136369::DEBUG::2014-10-29 11:17:46,172::task::595::Storage.TaskManager.Task::(_updateState) Task=`da1550f7-e2c1-4490-85cb-1e5b60e44f9e`::moving from state init -> state preparing >Thread-136369::INFO::2014-10-29 11:17:46,173::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136369::DEBUG::2014-10-29 11:17:46,200::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:17:46,202::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:46,203::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:46,203::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:46,203::__init__::232::IOProcess::(_processLogs) (200995) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:46,204::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200995) Queuing response >Thread-136369::DEBUG::2014-10-29 11:17:46,207::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136369::DEBUG::2014-10-29 11:17:46,209::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136369::INFO::2014-10-29 11:17:46,210::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136369::DEBUG::2014-10-29 11:17:46,211::task::1191::Storage.TaskManager.Task::(prepare) Task=`da1550f7-e2c1-4490-85cb-1e5b60e44f9e`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136369::DEBUG::2014-10-29 11:17:46,212::task::595::Storage.TaskManager.Task::(_updateState) Task=`da1550f7-e2c1-4490-85cb-1e5b60e44f9e`::moving from state preparing -> state finished >Thread-136369::DEBUG::2014-10-29 11:17:46,214::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136369::DEBUG::2014-10-29 11:17:46,214::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136369::DEBUG::2014-10-29 11:17:46,216::task::993::Storage.TaskManager.Task::(_decref) Task=`da1550f7-e2c1-4490-85cb-1e5b60e44f9e`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:17:46,280::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54361 >Detector thread::DEBUG::2014-10-29 11:17:46,281::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54361 >Detector thread::DEBUG::2014-10-29 11:17:46,281::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54361 >Detector thread::DEBUG::2014-10-29 11:17:46,282::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54361) >Thread-136370::DEBUG::2014-10-29 11:17:46,321::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136370::DEBUG::2014-10-29 11:17:46,323::task::595::Storage.TaskManager.Task::(_updateState) Task=`27d066fc-b0ba-4ef7-8336-34460d8295fd`::moving from state init -> state preparing >Thread-136370::INFO::2014-10-29 11:17:46,325::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136370::DEBUG::2014-10-29 11:17:46,327::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136370::DEBUG::2014-10-29 11:17:46,328::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136370::DEBUG::2014-10-29 11:17:46,329::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136370::DEBUG::2014-10-29 11:17:46,330::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136370::DEBUG::2014-10-29 11:17:46,331::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136370::DEBUG::2014-10-29 11:17:46,334::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136370::DEBUG::2014-10-29 11:17:46,422::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136370::DEBUG::2014-10-29 11:17:46,425::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136370::DEBUG::2014-10-29 11:17:46,609::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136370::DEBUG::2014-10-29 11:17:46,613::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136370::DEBUG::2014-10-29 11:17:46,616::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136370::DEBUG::2014-10-29 11:17:46,619::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136370::DEBUG::2014-10-29 11:17:46,622::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136370::DEBUG::2014-10-29 11:17:46,625::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136370::DEBUG::2014-10-29 11:17:46,629::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136370::DEBUG::2014-10-29 11:17:46,631::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:17:46,645::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:46,648::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:46,650::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:46,651::__init__::232::IOProcess::(_processLogs) (200996) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:46,654::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200996) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:46,658::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:46,659::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:46,663::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:46,666::__init__::232::IOProcess::(_processLogs) (200997) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:46,668::__init__::232::IOProcess::(_processLogs) (200997) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:46,672::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:46,674::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:46,677::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-136370::DEBUG::2014-10-29 11:17:46,681::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:17:46,684::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200998) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:46,687::__init__::232::IOProcess::(_processLogs) (200998) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:46,689::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:46,690::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:46,692::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:46,693::__init__::232::IOProcess::(_processLogs) (200999) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:46,697::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(200999) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:46,700::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:46,701::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:46,703::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:46,704::__init__::232::IOProcess::(_processLogs) (201000) Got request for method 'touch' >Thread-136370::DEBUG::2014-10-29 11:17:46,708::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:17:46,708::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201000) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:46,712::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:46,714::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:46,715::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:46,717::__init__::232::IOProcess::(_processLogs) (201001) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:17:46,720::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201001) Queuing response >Thread-136370::DEBUG::2014-10-29 11:17:46,720::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:17:46,726::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:46,728::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:46,729::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:46,731::__init__::232::IOProcess::(_processLogs) (201002) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:46,734::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201002) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:46,737::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:46,738::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:46,740::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:46,742::__init__::232::IOProcess::(_processLogs) (201003) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:46,745::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201003) Queuing response >Thread-136370::DEBUG::2014-10-29 11:17:46,745::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-136370::INFO::2014-10-29 11:17:46,747::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136370::INFO::2014-10-29 11:17:46,749::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136370::INFO::2014-10-29 11:17:46,750::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:17:46,754::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:46,755::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:46,759::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-136370::DEBUG::2014-10-29 11:17:46,759::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:17:46,761::__init__::232::IOProcess::(_processLogs) (201004) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:17:46,763::__init__::232::IOProcess::(_processLogs) (201004) Queuing response >Thread-136370::DEBUG::2014-10-29 11:17:46,769::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`5058a2ba-35bb-4b2f-9089-b088273a5db6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136370::DEBUG::2014-10-29 11:17:46,770::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136370::DEBUG::2014-10-29 11:17:46,772::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136370::DEBUG::2014-10-29 11:17:46,773::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`5058a2ba-35bb-4b2f-9089-b088273a5db6`::Granted request >Thread-136370::DEBUG::2014-10-29 11:17:46,777::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`27d066fc-b0ba-4ef7-8336-34460d8295fd`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136370::DEBUG::2014-10-29 11:17:46,778::task::993::Storage.TaskManager.Task::(_decref) Task=`27d066fc-b0ba-4ef7-8336-34460d8295fd`::ref 1 aborting False >Thread-136370::INFO::2014-10-29 11:17:46,791::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136370::DEBUG::2014-10-29 11:17:46,793::task::1191::Storage.TaskManager.Task::(prepare) Task=`27d066fc-b0ba-4ef7-8336-34460d8295fd`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136370::DEBUG::2014-10-29 11:17:46,794::task::595::Storage.TaskManager.Task::(_updateState) Task=`27d066fc-b0ba-4ef7-8336-34460d8295fd`::moving from state preparing -> state finished >Thread-136370::DEBUG::2014-10-29 11:17:46,795::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136370::DEBUG::2014-10-29 11:17:46,796::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136370::DEBUG::2014-10-29 11:17:46,799::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136370::DEBUG::2014-10-29 11:17:46,801::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136370::DEBUG::2014-10-29 11:17:46,802::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136370::DEBUG::2014-10-29 11:17:46,803::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136370::DEBUG::2014-10-29 11:17:46,806::task::993::Storage.TaskManager.Task::(_decref) Task=`27d066fc-b0ba-4ef7-8336-34460d8295fd`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:17:46,835::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54362 >Detector thread::DEBUG::2014-10-29 11:17:46,836::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54362 >Detector thread::DEBUG::2014-10-29 11:17:46,836::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54362 >Detector thread::DEBUG::2014-10-29 11:17:46,836::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54362) >Thread-136375::DEBUG::2014-10-29 11:17:46,876::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136375::DEBUG::2014-10-29 11:17:46,879::task::595::Storage.TaskManager.Task::(_updateState) Task=`5c58ff16-dcb6-4b64-93e7-b75c34a21bed`::moving from state init -> state preparing >Thread-136375::INFO::2014-10-29 11:17:46,881::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136375::INFO::2014-10-29 11:17:46,884::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048897', 'lastCheck': '2.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506557', 'lastCheck': '2.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506659', 'lastCheck': '2.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000513633', 'lastCheck': '2.3', 'valid': True}} >Thread-136375::DEBUG::2014-10-29 11:17:46,885::task::1191::Storage.TaskManager.Task::(prepare) Task=`5c58ff16-dcb6-4b64-93e7-b75c34a21bed`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048897', 'lastCheck': '2.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506557', 'lastCheck': '2.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506659', 'lastCheck': '2.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000513633', 'lastCheck': '2.3', 'valid': True}} >Thread-136375::DEBUG::2014-10-29 11:17:46,887::task::595::Storage.TaskManager.Task::(_updateState) Task=`5c58ff16-dcb6-4b64-93e7-b75c34a21bed`::moving from state preparing -> state finished >Thread-136375::DEBUG::2014-10-29 11:17:46,888::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136375::DEBUG::2014-10-29 11:17:46,889::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136375::DEBUG::2014-10-29 11:17:46,890::task::993::Storage.TaskManager.Task::(_decref) Task=`5c58ff16-dcb6-4b64-93e7-b75c34a21bed`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:48,752::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:48,754::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136376::DEBUG::2014-10-29 11:17:48,757::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:48,759::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:48,761::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136377::DEBUG::2014-10-29 11:17:48,764::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136377::DEBUG::2014-10-29 11:17:48,767::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:17:48,812::task::595::Storage.TaskManager.Task::(_updateState) Task=`05f6f7a6-608e-4aa0-9c4d-084945d0a74f`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:17:48,813::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:17:48,814::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:48,814::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:48,814::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:48,815::__init__::232::IOProcess::(_processLogs) (201005) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:17:48,815::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201005) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:48,817::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:48,818::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-22::INFO::2014-10-29 11:17:48,818::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010871808', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:17:48,820::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-22::DEBUG::2014-10-29 11:17:48,820::task::1191::Storage.TaskManager.Task::(prepare) Task=`05f6f7a6-608e-4aa0-9c4d-084945d0a74f`::finished: {'truesize': '6010871808', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:17:48,821::__init__::232::IOProcess::(_processLogs) (201006) Got request for method 'stat' >Thread-22::DEBUG::2014-10-29 11:17:48,822::task::595::Storage.TaskManager.Task::(_updateState) Task=`05f6f7a6-608e-4aa0-9c4d-084945d0a74f`::moving from state preparing -> state finished >Thread-17::DEBUG::2014-10-29 11:17:48,822::__init__::232::IOProcess::(_processLogs) (201006) Queuing response >Thread-22::DEBUG::2014-10-29 11:17:48,823::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-10-29 11:17:48,824::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2014-10-29 11:17:48,824::task::993::Storage.TaskManager.Task::(_decref) Task=`05f6f7a6-608e-4aa0-9c4d-084945d0a74f`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:17:48,894::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Detector thread::DEBUG::2014-10-29 11:17:50,019::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54363 >Detector thread::DEBUG::2014-10-29 11:17:50,020::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54363 >Detector thread::DEBUG::2014-10-29 11:17:50,020::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54363 >Detector thread::DEBUG::2014-10-29 11:17:50,021::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54363) >Thread-136378::DEBUG::2014-10-29 11:17:50,059::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136378::DEBUG::2014-10-29 11:17:50,061::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136378::DEBUG::2014-10-29 11:17:50,061::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.94', 'elapsedTime': '514102', 'displayType': 'vnc', 'cpuSys': '0.80', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '4073501', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '54810', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '37852.56'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.25', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:50,194::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:50,195::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:50,198::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:17:50,336::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54365 >Detector thread::DEBUG::2014-10-29 11:17:50,337::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54365 >Detector thread::DEBUG::2014-10-29 11:17:50,337::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54365 >Detector thread::DEBUG::2014-10-29 11:17:50,337::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54365) >Thread-136379::DEBUG::2014-10-29 11:17:50,377::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3959b8b-d55b-4b39-868e-6718f8bb3006`::moving from state init -> state preparing >Thread-136379::INFO::2014-10-29 11:17:50,378::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136379::INFO::2014-10-29 11:17:50,378::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048897', 'lastCheck': '5.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506557', 'lastCheck': '5.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506659', 'lastCheck': '6.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000513633', 'lastCheck': '5.8', 'valid': True}} >Thread-136379::DEBUG::2014-10-29 11:17:50,379::task::1191::Storage.TaskManager.Task::(prepare) Task=`d3959b8b-d55b-4b39-868e-6718f8bb3006`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048897', 'lastCheck': '5.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506557', 'lastCheck': '5.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506659', 'lastCheck': '6.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000513633', 'lastCheck': '5.8', 'valid': True}} >Thread-136379::DEBUG::2014-10-29 11:17:50,379::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3959b8b-d55b-4b39-868e-6718f8bb3006`::moving from state preparing -> state finished >Thread-136379::DEBUG::2014-10-29 11:17:50,379::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136379::DEBUG::2014-10-29 11:17:50,379::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136379::DEBUG::2014-10-29 11:17:50,380::task::993::Storage.TaskManager.Task::(_decref) Task=`d3959b8b-d55b-4b39-868e-6718f8bb3006`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:17:51,037::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54366 >Detector thread::DEBUG::2014-10-29 11:17:51,038::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54366 >Detector thread::DEBUG::2014-10-29 11:17:51,038::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54366 >Detector thread::DEBUG::2014-10-29 11:17:51,039::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54366) >Thread-136380::DEBUG::2014-10-29 11:17:51,078::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136380::DEBUG::2014-10-29 11:17:51,079::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136380::DEBUG::2014-10-29 11:17:51,098::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136380::DEBUG::2014-10-29 11:17:51,145::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '26', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '26', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:51,783::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:51,785::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136381::DEBUG::2014-10-29 11:17:51,789::task::595::Storage.TaskManager.Task::(_updateState) Task=`cedb6319-93d3-4105-8549-a8c12f264c1a`::moving from state init -> state preparing >Thread-136381::INFO::2014-10-29 11:17:51,789::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136381::INFO::2014-10-29 11:17:51,790::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048897', 'lastCheck': '7.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506557', 'lastCheck': '7.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506659', 'lastCheck': '7.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000513633', 'lastCheck': '7.2', 'valid': True}} >Thread-136381::DEBUG::2014-10-29 11:17:51,790::task::1191::Storage.TaskManager.Task::(prepare) Task=`cedb6319-93d3-4105-8549-a8c12f264c1a`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00048897', 'lastCheck': '7.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506557', 'lastCheck': '7.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506659', 'lastCheck': '7.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000513633', 'lastCheck': '7.2', 'valid': True}} >Thread-136381::DEBUG::2014-10-29 11:17:51,790::task::595::Storage.TaskManager.Task::(_updateState) Task=`cedb6319-93d3-4105-8549-a8c12f264c1a`::moving from state preparing -> state finished >Thread-136381::DEBUG::2014-10-29 11:17:51,791::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136381::DEBUG::2014-10-29 11:17:51,791::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136381::DEBUG::2014-10-29 11:17:51,791::task::993::Storage.TaskManager.Task::(_decref) Task=`cedb6319-93d3-4105-8549-a8c12f264c1a`::ref 0 aborting False >Thread-136381::DEBUG::2014-10-29 11:17:51,812::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:51,836::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:51,838::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136382::DEBUG::2014-10-29 11:17:51,841::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136382::DEBUG::2014-10-29 11:17:51,844::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:17:54,369::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:54,370::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:54,370::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:54,370::__init__::232::IOProcess::(_processLogs) (201007) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:54,373::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201007) Queuing response >Thread-179::DEBUG::2014-10-29 11:17:54,375::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:17:54,392::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000496602 s, 749 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:17:54,394::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:54,395::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:54,396::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:54,397::__init__::232::IOProcess::(_processLogs) (201008) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:54,398::__init__::232::IOProcess::(_processLogs) (201008) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:54,490::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:54,490::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:54,492::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:54,493::__init__::232::IOProcess::(_processLogs) (201009) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:17:54,493::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:17:54,495::__init__::232::IOProcess::(_processLogs) (201009) Queuing response >Thread-178::DEBUG::2014-10-29 11:17:54,512::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000603754 s, 841 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:17:54,513::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:54,514::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:54,515::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:54,517::__init__::232::IOProcess::(_processLogs) (201010) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:54,517::__init__::232::IOProcess::(_processLogs) (201010) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:54,518::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:54,518::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:54,518::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:54,518::__init__::232::IOProcess::(_processLogs) (201011) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:54,519::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201011) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:54,520::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:54,521::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:54,521::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:54,521::__init__::232::IOProcess::(_processLogs) (201012) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:54,521::__init__::232::IOProcess::(_processLogs) (201012) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:54,522::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:54,523::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:54,523::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:54,523::__init__::232::IOProcess::(_processLogs) (201013) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:54,523::__init__::232::IOProcess::(_processLogs) (201013) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:54,593::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:54,593::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:54,593::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:54,593::__init__::232::IOProcess::(_processLogs) (201014) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:54,595::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201014) Queuing response >Thread-10269::DEBUG::2014-10-29 11:17:54,596::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:17:54,614::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000498711 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:17:54,616::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:54,616::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:54,618::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:54,620::__init__::232::IOProcess::(_processLogs) (201015) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:54,620::__init__::232::IOProcess::(_processLogs) (201015) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:54,771::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:54,773::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:54,775::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-33::DEBUG::2014-10-29 11:17:54,775::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:17:54,776::__init__::232::IOProcess::(_processLogs) (201016) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:54,805::__init__::232::IOProcess::(_processLogs) (201016) Queuing response >Thread-33::DEBUG::2014-10-29 11:17:54,806::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000550262 s, 885 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:17:54,810::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:54,810::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:54,810::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:54,811::__init__::232::IOProcess::(_processLogs) (201017) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:17:54,812::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201017) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:54,814::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:54,815::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:54,815::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:54,816::__init__::232::IOProcess::(_processLogs) (201018) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:54,816::__init__::232::IOProcess::(_processLogs) (201018) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:54,816::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:54,817::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:54,817::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:54,818::__init__::232::IOProcess::(_processLogs) (201019) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:54,818::__init__::232::IOProcess::(_processLogs) (201019) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:54,819::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:54,819::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:54,819::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:54,820::__init__::232::IOProcess::(_processLogs) (201020) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:54,820::__init__::232::IOProcess::(_processLogs) (201020) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:54,884::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:54,887::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136383::DEBUG::2014-10-29 11:17:54,891::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:54,894::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:17:54,896::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136384::DEBUG::2014-10-29 11:17:54,900::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136384::DEBUG::2014-10-29 11:17:54,902::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:55,205::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:55,207::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:17:55,209::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:17:57,473::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54368 >Detector thread::DEBUG::2014-10-29 11:17:57,474::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54368 >Detector thread::DEBUG::2014-10-29 11:17:57,474::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54368 >Detector thread::DEBUG::2014-10-29 11:17:57,475::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54368) >Thread-136385::DEBUG::2014-10-29 11:17:57,515::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136385::DEBUG::2014-10-29 11:17:57,516::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6e626e6-1534-470d-a06e-20651e03ebda`::moving from state init -> state preparing >Thread-136385::INFO::2014-10-29 11:17:57,516::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136385::DEBUG::2014-10-29 11:17:57,519::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:17:57,520::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:57,520::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:57,520::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:57,520::__init__::232::IOProcess::(_processLogs) (201021) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:57,521::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201021) Queuing response >Thread-136385::DEBUG::2014-10-29 11:17:57,521::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136385::DEBUG::2014-10-29 11:17:57,523::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136385::INFO::2014-10-29 11:17:57,523::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136385::DEBUG::2014-10-29 11:17:57,523::task::1191::Storage.TaskManager.Task::(prepare) Task=`b6e626e6-1534-470d-a06e-20651e03ebda`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136385::DEBUG::2014-10-29 11:17:57,524::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6e626e6-1534-470d-a06e-20651e03ebda`::moving from state preparing -> state finished >Thread-136385::DEBUG::2014-10-29 11:17:57,524::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136385::DEBUG::2014-10-29 11:17:57,524::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136385::DEBUG::2014-10-29 11:17:57,524::task::993::Storage.TaskManager.Task::(_decref) Task=`b6e626e6-1534-470d-a06e-20651e03ebda`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:17:57,568::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54369 >Detector thread::DEBUG::2014-10-29 11:17:57,569::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54369 >Detector thread::DEBUG::2014-10-29 11:17:57,569::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54369 >Detector thread::DEBUG::2014-10-29 11:17:57,569::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54369) >Thread-136386::DEBUG::2014-10-29 11:17:57,608::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136386::DEBUG::2014-10-29 11:17:57,608::task::595::Storage.TaskManager.Task::(_updateState) Task=`04225fab-7e0a-48ad-ae57-8621f7383e96`::moving from state init -> state preparing >Thread-136386::INFO::2014-10-29 11:17:57,609::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136386::DEBUG::2014-10-29 11:17:57,609::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136386::DEBUG::2014-10-29 11:17:57,609::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136386::DEBUG::2014-10-29 11:17:57,610::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136386::DEBUG::2014-10-29 11:17:57,610::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136386::DEBUG::2014-10-29 11:17:57,610::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136386::DEBUG::2014-10-29 11:17:57,611::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136386::DEBUG::2014-10-29 11:17:57,701::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136386::DEBUG::2014-10-29 11:17:57,702::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136386::DEBUG::2014-10-29 11:17:57,875::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136386::DEBUG::2014-10-29 11:17:57,876::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136386::DEBUG::2014-10-29 11:17:57,876::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136386::DEBUG::2014-10-29 11:17:57,876::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136386::DEBUG::2014-10-29 11:17:57,877::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136386::DEBUG::2014-10-29 11:17:57,877::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136386::DEBUG::2014-10-29 11:17:57,878::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136386::DEBUG::2014-10-29 11:17:57,878::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:17:57,884::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:57,887::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:57,888::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:57,888::__init__::232::IOProcess::(_processLogs) (201022) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:57,889::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201022) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:57,890::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:57,891::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:57,893::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:57,895::__init__::232::IOProcess::(_processLogs) (201023) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:57,897::__init__::232::IOProcess::(_processLogs) (201023) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:57,899::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:57,904::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-136386::DEBUG::2014-10-29 11:17:57,904::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:17:57,905::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:57,907::__init__::232::IOProcess::(_processLogs) (201024) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:57,907::__init__::232::IOProcess::(_processLogs) (201024) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:57,908::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:57,908::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:57,909::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:57,909::__init__::232::IOProcess::(_processLogs) (201025) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:57,910::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201025) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:57,911::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:57,911::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:57,911::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:57,911::__init__::232::IOProcess::(_processLogs) (201026) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:17:57,912::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201026) Queuing response >Thread-136386::DEBUG::2014-10-29 11:17:57,913::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:17:57,915::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:57,915::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:57,915::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:57,916::__init__::232::IOProcess::(_processLogs) (201027) Got request for method 'readfile' >Thread-136386::DEBUG::2014-10-29 11:17:57,917::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:17:57,917::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201027) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:57,920::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:57,920::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:57,920::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:57,921::__init__::232::IOProcess::(_processLogs) (201028) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:17:57,921::__init__::232::IOProcess::(_processLogs) (201028) Queuing response >Thread-17::DEBUG::2014-10-29 11:17:57,922::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:57,922::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:57,922::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:57,923::__init__::232::IOProcess::(_processLogs) (201029) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:17:57,923::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201029) Queuing response >Thread-136386::DEBUG::2014-10-29 11:17:57,924::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:57,925::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-136386::INFO::2014-10-29 11:17:57,926::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136386::INFO::2014-10-29 11:17:57,929::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136386::INFO::2014-10-29 11:17:57,932::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >JsonRpcServer::DEBUG::2014-10-29 11:17:57,932::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:17:57,938::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:17:57,939::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:17:57,940::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:17:57,940::__init__::232::IOProcess::(_processLogs) (201030) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:17:57,940::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201030) Queuing response >Thread-136386::DEBUG::2014-10-29 11:17:57,941::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136386::DEBUG::2014-10-29 11:17:57,942::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`82900f1f-1a6e-4b0a-9377-10dbedf10f9b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136386::DEBUG::2014-10-29 11:17:57,943::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136386::DEBUG::2014-10-29 11:17:57,943::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136386::DEBUG::2014-10-29 11:17:57,943::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`82900f1f-1a6e-4b0a-9377-10dbedf10f9b`::Granted request >Thread-136386::DEBUG::2014-10-29 11:17:57,944::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`04225fab-7e0a-48ad-ae57-8621f7383e96`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136386::DEBUG::2014-10-29 11:17:57,944::task::993::Storage.TaskManager.Task::(_decref) Task=`04225fab-7e0a-48ad-ae57-8621f7383e96`::ref 1 aborting False >Thread-136386::INFO::2014-10-29 11:17:57,947::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136386::DEBUG::2014-10-29 11:17:57,948::task::1191::Storage.TaskManager.Task::(prepare) Task=`04225fab-7e0a-48ad-ae57-8621f7383e96`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136391::DEBUG::2014-10-29 11:17:57,950::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-136386::DEBUG::2014-10-29 11:17:57,950::task::595::Storage.TaskManager.Task::(_updateState) Task=`04225fab-7e0a-48ad-ae57-8621f7383e96`::moving from state preparing -> state finished >Thread-136386::DEBUG::2014-10-29 11:17:57,952::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136386::DEBUG::2014-10-29 11:17:57,953::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136386::DEBUG::2014-10-29 11:17:57,955::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:17:57,956::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-136386::DEBUG::2014-10-29 11:17:57,956::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136386::DEBUG::2014-10-29 11:17:57,958::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136386::DEBUG::2014-10-29 11:17:57,960::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >JsonRpcServer::DEBUG::2014-10-29 11:17:57,961::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136386::DEBUG::2014-10-29 11:17:57,964::task::993::Storage.TaskManager.Task::(_decref) Task=`04225fab-7e0a-48ad-ae57-8621f7383e96`::ref 0 aborting False >Thread-136392::DEBUG::2014-10-29 11:17:57,972::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136392::DEBUG::2014-10-29 11:17:57,975::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:17:57,994::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54370 >Detector thread::DEBUG::2014-10-29 11:17:57,995::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54370 >Detector thread::DEBUG::2014-10-29 11:17:57,995::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54370 >Detector thread::DEBUG::2014-10-29 11:17:57,995::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54370) >Thread-136393::DEBUG::2014-10-29 11:17:58,034::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136393::DEBUG::2014-10-29 11:17:58,034::task::595::Storage.TaskManager.Task::(_updateState) Task=`924cea76-005c-413e-9133-d5b93eb9df31`::moving from state init -> state preparing >Thread-136393::INFO::2014-10-29 11:17:58,035::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136393::INFO::2014-10-29 11:17:58,035::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000603754', 'lastCheck': '3.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000550262', 'lastCheck': '3.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496602', 'lastCheck': '3.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000498711', 'lastCheck': '3.4', 'valid': True}} >Thread-136393::DEBUG::2014-10-29 11:17:58,036::task::1191::Storage.TaskManager.Task::(prepare) Task=`924cea76-005c-413e-9133-d5b93eb9df31`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000603754', 'lastCheck': '3.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000550262', 'lastCheck': '3.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496602', 'lastCheck': '3.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000498711', 'lastCheck': '3.4', 'valid': True}} >Thread-136393::DEBUG::2014-10-29 11:17:58,036::task::595::Storage.TaskManager.Task::(_updateState) Task=`924cea76-005c-413e-9133-d5b93eb9df31`::moving from state preparing -> state finished >Thread-136393::DEBUG::2014-10-29 11:17:58,036::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136393::DEBUG::2014-10-29 11:17:58,036::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136393::DEBUG::2014-10-29 11:17:58,037::task::993::Storage.TaskManager.Task::(_decref) Task=`924cea76-005c-413e-9133-d5b93eb9df31`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:00,218::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:00,219::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:00,222::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:18:00,237::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54371 >Detector thread::DEBUG::2014-10-29 11:18:00,238::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54371 >Detector thread::DEBUG::2014-10-29 11:18:00,238::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54371 >Detector thread::DEBUG::2014-10-29 11:18:00,239::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54371) >Thread-136394::DEBUG::2014-10-29 11:18:00,277::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136394::DEBUG::2014-10-29 11:18:00,278::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136394::DEBUG::2014-10-29 11:18:00,279::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.94', 'elapsedTime': '514112', 'displayType': 'vnc', 'cpuSys': '0.80', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '4073501', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '54810', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '37852.56'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.38', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:18:00,444::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54373 >Detector thread::DEBUG::2014-10-29 11:18:00,444::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54373 >Detector thread::DEBUG::2014-10-29 11:18:00,445::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54373 >Detector thread::DEBUG::2014-10-29 11:18:00,445::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54373) >Thread-136395::DEBUG::2014-10-29 11:18:00,485::task::595::Storage.TaskManager.Task::(_updateState) Task=`43466f77-3c10-4573-8742-2e92a11ae623`::moving from state init -> state preparing >Thread-136395::INFO::2014-10-29 11:18:00,485::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136395::INFO::2014-10-29 11:18:00,486::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000603754', 'lastCheck': '6.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000550262', 'lastCheck': '5.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496602', 'lastCheck': '6.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000498711', 'lastCheck': '5.9', 'valid': True}} >Thread-136395::DEBUG::2014-10-29 11:18:00,486::task::1191::Storage.TaskManager.Task::(prepare) Task=`43466f77-3c10-4573-8742-2e92a11ae623`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000603754', 'lastCheck': '6.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000550262', 'lastCheck': '5.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496602', 'lastCheck': '6.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000498711', 'lastCheck': '5.9', 'valid': True}} >Thread-136395::DEBUG::2014-10-29 11:18:00,487::task::595::Storage.TaskManager.Task::(_updateState) Task=`43466f77-3c10-4573-8742-2e92a11ae623`::moving from state preparing -> state finished >Thread-136395::DEBUG::2014-10-29 11:18:00,487::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136395::DEBUG::2014-10-29 11:18:00,487::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136395::DEBUG::2014-10-29 11:18:00,488::task::993::Storage.TaskManager.Task::(_decref) Task=`43466f77-3c10-4573-8742-2e92a11ae623`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:00,992::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:00,995::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136396::DEBUG::2014-10-29 11:18:00,998::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:01,000::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:01,002::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136397::DEBUG::2014-10-29 11:18:01,005::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136397::DEBUG::2014-10-29 11:18:01,007::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:18:01,194::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54374 >Detector thread::DEBUG::2014-10-29 11:18:01,194::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54374 >Detector thread::DEBUG::2014-10-29 11:18:01,195::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54374 >Detector thread::DEBUG::2014-10-29 11:18:01,195::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54374) >Thread-136398::DEBUG::2014-10-29 11:18:01,234::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136398::DEBUG::2014-10-29 11:18:01,236::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136398::DEBUG::2014-10-29 11:18:01,254::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136398::DEBUG::2014-10-29 11:18:01,302::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '11', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '11', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-22::DEBUG::2014-10-29 11:18:03,918::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >VM Channels Listener::DEBUG::2014-10-29 11:18:03,966::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:04,027::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:04,030::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136399::DEBUG::2014-10-29 11:18:04,033::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:04,036::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:04,038::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136400::DEBUG::2014-10-29 11:18:04,041::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136400::DEBUG::2014-10-29 11:18:04,043::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:18:04,400::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:04,401::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:04,401::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:04,401::__init__::232::IOProcess::(_processLogs) (201031) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:04,402::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201031) Queuing response >Thread-179::DEBUG::2014-10-29 11:18:04,404::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:18:04,425::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000425534 s, 874 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:18:04,427::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:04,427::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:04,427::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:04,427::__init__::232::IOProcess::(_processLogs) (201032) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:04,429::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201032) Queuing response >Thread-178::DEBUG::2014-10-29 11:18:04,525::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 9b5dff8d-f9a0-4e5c-8800-3a988fc12016 >Thread-17::DEBUG::2014-10-29 11:18:04,531::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:04,533::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:04,533::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:04,534::__init__::232::IOProcess::(_processLogs) (201033) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:04,535::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201033) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:04,537::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:04,539::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:04,541::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:04,542::__init__::232::IOProcess::(_processLogs) (201034) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:04,543::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201034) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:04,547::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:04,549::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:04,550::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-178::DEBUG::2014-10-29 11:18:04,552::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016 >Thread-17::DEBUG::2014-10-29 11:18:04,553::__init__::232::IOProcess::(_processLogs) (201035) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:04,555::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201035) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:04,556::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:04,556::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:04,557::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:04,557::__init__::232::IOProcess::(_processLogs) (201036) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:04,557::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:04,557::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:04,558::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:04,558::__init__::232::IOProcess::(_processLogs) (201037) Got request for method 'touch' >Thread-178::DEBUG::2014-10-29 11:18:04,563::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:18:04,565::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201037) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:04,567::__init__::232::IOProcess::(_processLogs) (201036) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:04,567::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:04,567::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:04,568::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:04,568::__init__::232::IOProcess::(_processLogs) (201038) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:18:04,569::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201038) Queuing response >Thread-178::DEBUG::2014-10-29 11:18:04,569::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nsednev_ovirt_3_5_HE_for_disks', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=Default', 'POOL_DOMAINS=9b5dff8d-f9a0-4e5c-8800-3a988fc12016:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=00000002-0002-0002-0002-000000000321', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_ovirt_3_5_HE_for_disks', 'ROLE=Master', 'SDUUID=9b5dff8d-f9a0-4e5c-8800-3a988fc12016', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=08256ef27d308c4f5bfe4a0974fd548f7d749489'] >Thread-17::DEBUG::2014-10-29 11:18:04,571::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:04,572::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:04,573::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:04,573::__init__::232::IOProcess::(_processLogs) (201039) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:04,574::__init__::232::IOProcess::(_processLogs) (201039) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:04,574::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:04,574::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:04,575::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:04,575::__init__::232::IOProcess::(_processLogs) (201040) Got request for method 'glob' >Thread-178::DEBUG::2014-10-29 11:18:04,576::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:18:04,576::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201040) Queuing response >Thread-178::INFO::2014-10-29 11:18:04,577::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9b5dff8d-f9a0-4e5c-8800-3a988fc12016_imageNS already registered >Thread-178::INFO::2014-10-29 11:18:04,578::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9b5dff8d-f9a0-4e5c-8800-3a988fc12016_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:18:04,578::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:04,579::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:04,580::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:04,581::__init__::232::IOProcess::(_processLogs) (201041) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:18:04,581::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:18:04,583::__init__::232::IOProcess::(_processLogs) (201041) Queuing response >Thread-178::DEBUG::2014-10-29 11:18:04,599::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000485274 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:18:04,600::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:04,600::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:04,601::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:04,601::__init__::232::IOProcess::(_processLogs) (201042) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:04,602::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201042) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:04,604::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:04,605::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:04,606::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:04,606::__init__::232::IOProcess::(_processLogs) (201043) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:04,606::__init__::232::IOProcess::(_processLogs) (201043) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:04,607::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:04,607::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:04,608::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:04,609::__init__::232::IOProcess::(_processLogs) (201044) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:04,609::__init__::232::IOProcess::(_processLogs) (201044) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:04,610::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:04,610::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:04,611::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:04,611::__init__::232::IOProcess::(_processLogs) (201045) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:04,612::__init__::232::IOProcess::(_processLogs) (201045) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:04,621::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:04,621::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:04,622::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-10269::DEBUG::2014-10-29 11:18:04,624::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:18:04,624::__init__::232::IOProcess::(_processLogs) (201046) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:04,639::__init__::232::IOProcess::(_processLogs) (201046) Queuing response >Thread-10269::DEBUG::2014-10-29 11:18:04,641::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000489579 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:18:04,642::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:04,643::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:04,645::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:04,646::__init__::232::IOProcess::(_processLogs) (201047) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:04,646::__init__::232::IOProcess::(_processLogs) (201047) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:04,822::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:04,822::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:04,822::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:04,823::__init__::232::IOProcess::(_processLogs) (201048) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:04,824::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201048) Queuing response >Thread-33::DEBUG::2014-10-29 11:18:04,825::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:18:04,843::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000528258 s, 922 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:18:04,845::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:04,845::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:04,845::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:04,845::__init__::232::IOProcess::(_processLogs) (201049) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:04,847::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201049) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:04,849::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:04,849::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:04,850::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:04,850::__init__::232::IOProcess::(_processLogs) (201050) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:04,851::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201050) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:04,852::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:04,852::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:04,852::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:04,852::__init__::232::IOProcess::(_processLogs) (201051) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:04,853::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201051) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:04,854::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:04,854::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:04,854::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:04,855::__init__::232::IOProcess::(_processLogs) (201052) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:04,855::__init__::232::IOProcess::(_processLogs) (201052) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:05,230::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:05,231::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:05,233::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:07,058::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:07,061::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136405::DEBUG::2014-10-29 11:18:07,065::task::595::Storage.TaskManager.Task::(_updateState) Task=`5def4b8a-a5bb-4e05-8df5-9eac29401bb8`::moving from state init -> state preparing >Thread-136405::INFO::2014-10-29 11:18:07,065::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136405::INFO::2014-10-29 11:18:07,066::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485274', 'lastCheck': '2.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528258', 'lastCheck': '2.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425534', 'lastCheck': '2.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000489579', 'lastCheck': '2.4', 'valid': True}} >Thread-136405::DEBUG::2014-10-29 11:18:07,066::task::1191::Storage.TaskManager.Task::(prepare) Task=`5def4b8a-a5bb-4e05-8df5-9eac29401bb8`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485274', 'lastCheck': '2.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528258', 'lastCheck': '2.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425534', 'lastCheck': '2.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000489579', 'lastCheck': '2.4', 'valid': True}} >Thread-136405::DEBUG::2014-10-29 11:18:07,067::task::595::Storage.TaskManager.Task::(_updateState) Task=`5def4b8a-a5bb-4e05-8df5-9eac29401bb8`::moving from state preparing -> state finished >Thread-136405::DEBUG::2014-10-29 11:18:07,067::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136405::DEBUG::2014-10-29 11:18:07,067::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136405::DEBUG::2014-10-29 11:18:07,068::task::993::Storage.TaskManager.Task::(_decref) Task=`5def4b8a-a5bb-4e05-8df5-9eac29401bb8`::ref 0 aborting False >Thread-136405::DEBUG::2014-10-29 11:18:07,098::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:07,120::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:07,121::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136406::DEBUG::2014-10-29 11:18:07,125::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136406::DEBUG::2014-10-29 11:18:07,127::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:18:08,606::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54376 >Detector thread::DEBUG::2014-10-29 11:18:08,609::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54376 >Detector thread::DEBUG::2014-10-29 11:18:08,610::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54376 >Detector thread::DEBUG::2014-10-29 11:18:08,610::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54376) >Thread-136407::DEBUG::2014-10-29 11:18:08,650::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136407::DEBUG::2014-10-29 11:18:08,651::task::595::Storage.TaskManager.Task::(_updateState) Task=`92d9ee06-c984-4cd3-a8f1-c19be4fe5ce8`::moving from state init -> state preparing >Thread-136407::INFO::2014-10-29 11:18:08,651::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136407::DEBUG::2014-10-29 11:18:08,669::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:18:08,670::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:08,670::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:08,670::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:08,671::__init__::232::IOProcess::(_processLogs) (201053) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:08,671::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201053) Queuing response >Thread-136407::DEBUG::2014-10-29 11:18:08,672::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136407::DEBUG::2014-10-29 11:18:08,672::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136407::INFO::2014-10-29 11:18:08,673::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136407::DEBUG::2014-10-29 11:18:08,673::task::1191::Storage.TaskManager.Task::(prepare) Task=`92d9ee06-c984-4cd3-a8f1-c19be4fe5ce8`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136407::DEBUG::2014-10-29 11:18:08,673::task::595::Storage.TaskManager.Task::(_updateState) Task=`92d9ee06-c984-4cd3-a8f1-c19be4fe5ce8`::moving from state preparing -> state finished >Thread-136407::DEBUG::2014-10-29 11:18:08,673::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136407::DEBUG::2014-10-29 11:18:08,674::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136407::DEBUG::2014-10-29 11:18:08,674::task::993::Storage.TaskManager.Task::(_decref) Task=`92d9ee06-c984-4cd3-a8f1-c19be4fe5ce8`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:18:08,718::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54377 >Detector thread::DEBUG::2014-10-29 11:18:08,721::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54377 >Detector thread::DEBUG::2014-10-29 11:18:08,721::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54377 >Detector thread::DEBUG::2014-10-29 11:18:08,722::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54377) >Thread-136408::DEBUG::2014-10-29 11:18:08,761::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136408::DEBUG::2014-10-29 11:18:08,762::task::595::Storage.TaskManager.Task::(_updateState) Task=`925ed088-27e0-4e39-a025-d19d4e56a176`::moving from state init -> state preparing >Thread-136408::INFO::2014-10-29 11:18:08,762::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136408::DEBUG::2014-10-29 11:18:08,762::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136408::DEBUG::2014-10-29 11:18:08,763::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136408::DEBUG::2014-10-29 11:18:08,763::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136408::DEBUG::2014-10-29 11:18:08,763::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136408::DEBUG::2014-10-29 11:18:08,763::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136408::DEBUG::2014-10-29 11:18:08,764::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136408::DEBUG::2014-10-29 11:18:08,853::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136408::DEBUG::2014-10-29 11:18:08,854::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136408::DEBUG::2014-10-29 11:18:09,035::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136408::DEBUG::2014-10-29 11:18:09,036::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136408::DEBUG::2014-10-29 11:18:09,036::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136408::DEBUG::2014-10-29 11:18:09,037::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136408::DEBUG::2014-10-29 11:18:09,037::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136408::DEBUG::2014-10-29 11:18:09,037::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136408::DEBUG::2014-10-29 11:18:09,038::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136408::DEBUG::2014-10-29 11:18:09,038::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:18:09,046::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:09,049::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:09,050::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:09,050::__init__::232::IOProcess::(_processLogs) (201054) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:09,051::__init__::232::IOProcess::(_processLogs) (201054) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:09,053::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:09,053::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:09,053::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:09,054::__init__::232::IOProcess::(_processLogs) (201055) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:09,055::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201055) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:09,056::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:09,057::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:09,060::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:09,062::__init__::232::IOProcess::(_processLogs) (201056) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:09,066::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201056) Queuing response >Thread-136408::DEBUG::2014-10-29 11:18:09,069::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:18:09,070::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:09,071::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:09,072::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:09,073::__init__::232::IOProcess::(_processLogs) (201057) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:09,073::__init__::232::IOProcess::(_processLogs) (201057) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:09,073::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:09,074::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:09,074::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:09,074::__init__::232::IOProcess::(_processLogs) (201058) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:18:09,075::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201058) Queuing response >Thread-136408::DEBUG::2014-10-29 11:18:09,075::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:18:09,077::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:09,078::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:09,078::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:09,078::__init__::232::IOProcess::(_processLogs) (201059) Got request for method 'readfile' >Thread-136408::DEBUG::2014-10-29 11:18:09,079::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:18:09,079::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201059) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:09,082::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:09,083::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:09,083::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:09,084::__init__::232::IOProcess::(_processLogs) (201060) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:09,084::__init__::232::IOProcess::(_processLogs) (201060) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:09,085::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:09,085::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:09,085::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:09,085::__init__::232::IOProcess::(_processLogs) (201061) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:09,086::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201061) Queuing response >Thread-136408::DEBUG::2014-10-29 11:18:09,086::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-136408::INFO::2014-10-29 11:18:09,087::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136408::INFO::2014-10-29 11:18:09,088::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136408::INFO::2014-10-29 11:18:09,088::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:18:09,089::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:09,089::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:09,089::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:09,090::__init__::232::IOProcess::(_processLogs) (201062) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:18:09,090::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201062) Queuing response >Thread-136408::DEBUG::2014-10-29 11:18:09,091::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136408::DEBUG::2014-10-29 11:18:09,093::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`584dd351-45f1-4cdc-baf9-c82dc1ae9f07`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136408::DEBUG::2014-10-29 11:18:09,093::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136408::DEBUG::2014-10-29 11:18:09,094::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136408::DEBUG::2014-10-29 11:18:09,094::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`584dd351-45f1-4cdc-baf9-c82dc1ae9f07`::Granted request >Thread-136408::DEBUG::2014-10-29 11:18:09,095::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`925ed088-27e0-4e39-a025-d19d4e56a176`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136408::DEBUG::2014-10-29 11:18:09,095::task::993::Storage.TaskManager.Task::(_decref) Task=`925ed088-27e0-4e39-a025-d19d4e56a176`::ref 1 aborting False >Thread-136408::INFO::2014-10-29 11:18:09,098::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136408::DEBUG::2014-10-29 11:18:09,098::task::1191::Storage.TaskManager.Task::(prepare) Task=`925ed088-27e0-4e39-a025-d19d4e56a176`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136408::DEBUG::2014-10-29 11:18:09,098::task::595::Storage.TaskManager.Task::(_updateState) Task=`925ed088-27e0-4e39-a025-d19d4e56a176`::moving from state preparing -> state finished >Thread-136408::DEBUG::2014-10-29 11:18:09,099::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136408::DEBUG::2014-10-29 11:18:09,099::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136408::DEBUG::2014-10-29 11:18:09,099::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136408::DEBUG::2014-10-29 11:18:09,100::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136408::DEBUG::2014-10-29 11:18:09,100::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136408::DEBUG::2014-10-29 11:18:09,100::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136408::DEBUG::2014-10-29 11:18:09,100::task::993::Storage.TaskManager.Task::(_decref) Task=`925ed088-27e0-4e39-a025-d19d4e56a176`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:18:09,123::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54378 >Detector thread::DEBUG::2014-10-29 11:18:09,123::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54378 >Detector thread::DEBUG::2014-10-29 11:18:09,123::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54378 >Detector thread::DEBUG::2014-10-29 11:18:09,124::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54378) >Thread-136413::DEBUG::2014-10-29 11:18:09,163::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136413::DEBUG::2014-10-29 11:18:09,164::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ba253b6-3ad7-420b-b270-063550871750`::moving from state init -> state preparing >Thread-136413::INFO::2014-10-29 11:18:09,164::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136413::INFO::2014-10-29 11:18:09,165::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485274', 'lastCheck': '4.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528258', 'lastCheck': '4.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425534', 'lastCheck': '4.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000489579', 'lastCheck': '4.5', 'valid': True}} >Thread-136413::DEBUG::2014-10-29 11:18:09,165::task::1191::Storage.TaskManager.Task::(prepare) Task=`6ba253b6-3ad7-420b-b270-063550871750`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485274', 'lastCheck': '4.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528258', 'lastCheck': '4.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425534', 'lastCheck': '4.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000489579', 'lastCheck': '4.5', 'valid': True}} >Thread-136413::DEBUG::2014-10-29 11:18:09,165::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ba253b6-3ad7-420b-b270-063550871750`::moving from state preparing -> state finished >Thread-136413::DEBUG::2014-10-29 11:18:09,166::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136413::DEBUG::2014-10-29 11:18:09,166::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136413::DEBUG::2014-10-29 11:18:09,166::task::993::Storage.TaskManager.Task::(_decref) Task=`6ba253b6-3ad7-420b-b270-063550871750`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:10,189::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:10,191::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136414::DEBUG::2014-10-29 11:18:10,195::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:10,198::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:10,200::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136415::DEBUG::2014-10-29 11:18:10,203::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136415::DEBUG::2014-10-29 11:18:10,205::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:10,240::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:10,241::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:10,244::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:18:10,351::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54379 >Detector thread::DEBUG::2014-10-29 11:18:10,352::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54379 >Detector thread::DEBUG::2014-10-29 11:18:10,352::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54379 >Detector thread::DEBUG::2014-10-29 11:18:10,352::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54379) >Thread-136416::DEBUG::2014-10-29 11:18:10,391::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136416::DEBUG::2014-10-29 11:18:10,393::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136416::DEBUG::2014-10-29 11:18:10,412::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Detector thread::DEBUG::2014-10-29 11:18:10,424::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54380 >Detector thread::DEBUG::2014-10-29 11:18:10,427::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54380 >Detector thread::DEBUG::2014-10-29 11:18:10,428::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54380 >Detector thread::DEBUG::2014-10-29 11:18:10,430::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54380) >Thread-136417::DEBUG::2014-10-29 11:18:10,470::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136417::DEBUG::2014-10-29 11:18:10,476::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136416::DEBUG::2014-10-29 11:18:10,479::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '93', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '93', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-136417::DEBUG::2014-10-29 11:18:10,480::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.84', 'elapsedTime': '514122', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '4073501', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '54810', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '37852.56'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.55', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:18:10,558::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54381 >Detector thread::DEBUG::2014-10-29 11:18:10,559::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54381 >Detector thread::DEBUG::2014-10-29 11:18:10,559::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54381 >Detector thread::DEBUG::2014-10-29 11:18:10,560::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54381) >Thread-136418::DEBUG::2014-10-29 11:18:10,600::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9a71e30-d2a0-438b-98c8-7a36f94c6f07`::moving from state init -> state preparing >Thread-136418::INFO::2014-10-29 11:18:10,601::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136418::INFO::2014-10-29 11:18:10,601::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485274', 'lastCheck': '6.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528258', 'lastCheck': '5.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425534', 'lastCheck': '6.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000489579', 'lastCheck': '6.0', 'valid': True}} >Thread-136418::DEBUG::2014-10-29 11:18:10,601::task::1191::Storage.TaskManager.Task::(prepare) Task=`d9a71e30-d2a0-438b-98c8-7a36f94c6f07`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000485274', 'lastCheck': '6.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528258', 'lastCheck': '5.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425534', 'lastCheck': '6.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000489579', 'lastCheck': '6.0', 'valid': True}} >Thread-136418::DEBUG::2014-10-29 11:18:10,602::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9a71e30-d2a0-438b-98c8-7a36f94c6f07`::moving from state preparing -> state finished >Thread-136418::DEBUG::2014-10-29 11:18:10,602::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136418::DEBUG::2014-10-29 11:18:10,602::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136418::DEBUG::2014-10-29 11:18:10,603::task::993::Storage.TaskManager.Task::(_decref) Task=`d9a71e30-d2a0-438b-98c8-7a36f94c6f07`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:13,226::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:13,229::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136419::DEBUG::2014-10-29 11:18:13,232::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:13,234::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:13,236::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136420::DEBUG::2014-10-29 11:18:13,239::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136420::DEBUG::2014-10-29 11:18:13,241::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:18:14,432::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:14,433::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:14,433::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:14,434::__init__::232::IOProcess::(_processLogs) (201063) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:14,436::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201063) Queuing response >Thread-179::DEBUG::2014-10-29 11:18:14,437::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:18:14,454::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000521254 s, 714 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:18:14,456::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:14,457::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:14,457::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:14,457::__init__::232::IOProcess::(_processLogs) (201064) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:14,459::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201064) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:14,613::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:14,614::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:14,614::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:14,615::__init__::232::IOProcess::(_processLogs) (201065) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:14,615::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201065) Queuing response >Thread-178::DEBUG::2014-10-29 11:18:14,616::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:18:14,635::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000423238 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:18:14,637::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:14,637::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:14,638::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:14,638::__init__::232::IOProcess::(_processLogs) (201066) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:14,640::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201066) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:14,641::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:14,642::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:14,642::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:14,642::__init__::232::IOProcess::(_processLogs) (201067) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:14,643::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201067) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:14,644::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:14,644::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:14,645::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:14,645::__init__::232::IOProcess::(_processLogs) (201068) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:14,647::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:14,648::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201068) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:14,649::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:14,649::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:14,649::__init__::232::IOProcess::(_processLogs) (201069) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:14,650::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:14,650::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:14,650::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:14,650::__init__::232::IOProcess::(_processLogs) (201070) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:14,652::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201069) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:14,653::__init__::232::IOProcess::(_processLogs) (201070) Queuing response >Thread-10269::DEBUG::2014-10-29 11:18:14,653::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:18:14,673::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000531754 s, 944 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:18:14,676::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:14,676::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:14,678::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:14,680::__init__::232::IOProcess::(_processLogs) (201071) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:14,680::__init__::232::IOProcess::(_processLogs) (201071) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:14,857::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:14,858::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-33::DEBUG::2014-10-29 11:18:14,860::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:18:14,877::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:14,877::__init__::232::IOProcess::(_processLogs) (201072) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:14,878::__init__::232::IOProcess::(_processLogs) (201072) Queuing response >Thread-33::DEBUG::2014-10-29 11:18:14,879::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000520633 s, 935 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:18:14,880::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:14,881::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:14,881::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:14,881::__init__::232::IOProcess::(_processLogs) (201073) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:14,883::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201073) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:14,885::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:14,885::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:14,885::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:14,886::__init__::232::IOProcess::(_processLogs) (201074) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:14,886::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201074) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:14,888::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:14,888::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:14,888::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:14,888::__init__::232::IOProcess::(_processLogs) (201075) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:14,889::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201075) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:14,890::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:14,890::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:14,891::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:14,891::__init__::232::IOProcess::(_processLogs) (201076) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:14,892::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201076) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:15,251::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:15,253::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:15,254::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:16,257::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:16,264::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136421::DEBUG::2014-10-29 11:18:16,273::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:16,279::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:16,283::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136422::DEBUG::2014-10-29 11:18:16,291::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136422::DEBUG::2014-10-29 11:18:16,308::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:18:18,942::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:19,326::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:19,328::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136423::DEBUG::2014-10-29 11:18:19,331::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:19,333::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:19,335::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136424::DEBUG::2014-10-29 11:18:19,338::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136424::DEBUG::2014-10-29 11:18:19,340::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:18:19,755::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54384 >Detector thread::DEBUG::2014-10-29 11:18:19,756::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54384 >Detector thread::DEBUG::2014-10-29 11:18:19,756::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54384 >Detector thread::DEBUG::2014-10-29 11:18:19,757::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54384) >Thread-136425::DEBUG::2014-10-29 11:18:19,797::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136425::DEBUG::2014-10-29 11:18:19,797::task::595::Storage.TaskManager.Task::(_updateState) Task=`472ca6e0-c709-4543-bcf2-a9db895f6cc2`::moving from state init -> state preparing >Thread-136425::INFO::2014-10-29 11:18:19,798::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136425::DEBUG::2014-10-29 11:18:19,801::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:18:19,802::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:19,802::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:19,802::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:19,803::__init__::232::IOProcess::(_processLogs) (201077) Got request for method 'glob' >Thread-136425::DEBUG::2014-10-29 11:18:19,803::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:18:19,804::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201077) Queuing response >Thread-136425::DEBUG::2014-10-29 11:18:19,805::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136425::INFO::2014-10-29 11:18:19,806::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136425::DEBUG::2014-10-29 11:18:19,806::task::1191::Storage.TaskManager.Task::(prepare) Task=`472ca6e0-c709-4543-bcf2-a9db895f6cc2`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136425::DEBUG::2014-10-29 11:18:19,806::task::595::Storage.TaskManager.Task::(_updateState) Task=`472ca6e0-c709-4543-bcf2-a9db895f6cc2`::moving from state preparing -> state finished >Thread-136425::DEBUG::2014-10-29 11:18:19,806::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136425::DEBUG::2014-10-29 11:18:19,807::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136425::DEBUG::2014-10-29 11:18:19,807::task::993::Storage.TaskManager.Task::(_decref) Task=`472ca6e0-c709-4543-bcf2-a9db895f6cc2`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:18:19,850::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54385 >Detector thread::DEBUG::2014-10-29 11:18:19,851::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54385 >Detector thread::DEBUG::2014-10-29 11:18:19,851::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54385 >Detector thread::DEBUG::2014-10-29 11:18:19,851::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54385) >Thread-136426::DEBUG::2014-10-29 11:18:19,890::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136426::DEBUG::2014-10-29 11:18:19,890::task::595::Storage.TaskManager.Task::(_updateState) Task=`90bf1cd9-247b-48dd-8648-4c1ba6d4dc43`::moving from state init -> state preparing >Thread-136426::INFO::2014-10-29 11:18:19,891::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136426::DEBUG::2014-10-29 11:18:19,891::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136426::DEBUG::2014-10-29 11:18:19,891::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136426::DEBUG::2014-10-29 11:18:19,892::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136426::DEBUG::2014-10-29 11:18:19,892::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136426::DEBUG::2014-10-29 11:18:19,892::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136426::DEBUG::2014-10-29 11:18:19,893::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136426::DEBUG::2014-10-29 11:18:19,985::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136426::DEBUG::2014-10-29 11:18:19,986::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136426::DEBUG::2014-10-29 11:18:20,158::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136426::DEBUG::2014-10-29 11:18:20,159::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136426::DEBUG::2014-10-29 11:18:20,160::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136426::DEBUG::2014-10-29 11:18:20,160::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136426::DEBUG::2014-10-29 11:18:20,160::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136426::DEBUG::2014-10-29 11:18:20,161::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136426::DEBUG::2014-10-29 11:18:20,161::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136426::DEBUG::2014-10-29 11:18:20,161::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:18:20,172::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:20,173::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:20,173::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:20,173::__init__::232::IOProcess::(_processLogs) (201078) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:20,174::__init__::232::IOProcess::(_processLogs) (201078) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:20,175::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:20,175::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:20,175::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:20,176::__init__::232::IOProcess::(_processLogs) (201079) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:20,176::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:20,176::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:20,176::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:20,176::__init__::232::IOProcess::(_processLogs) (201080) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:20,177::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:20,178::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:20,179::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:20,181::__init__::232::IOProcess::(_processLogs) (201081) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:20,182::__init__::232::IOProcess::(_processLogs) (201079) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:20,185::__init__::232::IOProcess::(_processLogs) (201080) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:20,187::__init__::232::IOProcess::(_processLogs) (201081) Queuing response >Thread-136426::DEBUG::2014-10-29 11:18:20,190::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:18:20,195::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:20,195::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:20,195::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:20,195::__init__::232::IOProcess::(_processLogs) (201082) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:18:20,196::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201082) Queuing response >Thread-136426::DEBUG::2014-10-29 11:18:20,197::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:18:20,208::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:20,211::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:20,211::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:20,211::__init__::232::IOProcess::(_processLogs) (201083) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:18:20,214::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201083) Queuing response >Thread-136426::DEBUG::2014-10-29 11:18:20,215::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:18:20,218::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:20,218::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:20,219::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:20,219::__init__::232::IOProcess::(_processLogs) (201084) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:20,219::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201084) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:20,221::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:20,221::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:20,222::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-136426::DEBUG::2014-10-29 11:18:20,222::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-136426::INFO::2014-10-29 11:18:20,224::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:18:20,224::__init__::232::IOProcess::(_processLogs) (201085) Got request for method 'glob' >Thread-136426::INFO::2014-10-29 11:18:20,225::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:18:20,226::__init__::232::IOProcess::(_processLogs) (201085) Queuing response >Thread-136426::INFO::2014-10-29 11:18:20,227::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:18:20,228::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:20,228::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:20,229::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:20,229::__init__::232::IOProcess::(_processLogs) (201086) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:18:20,230::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201086) Queuing response >Thread-136426::DEBUG::2014-10-29 11:18:20,230::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136426::DEBUG::2014-10-29 11:18:20,233::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`3a2c9766-965d-418f-a5df-42630ec757d2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136426::DEBUG::2014-10-29 11:18:20,233::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136426::DEBUG::2014-10-29 11:18:20,233::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136426::DEBUG::2014-10-29 11:18:20,234::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`3a2c9766-965d-418f-a5df-42630ec757d2`::Granted request >Thread-136426::DEBUG::2014-10-29 11:18:20,234::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`90bf1cd9-247b-48dd-8648-4c1ba6d4dc43`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136426::DEBUG::2014-10-29 11:18:20,236::task::993::Storage.TaskManager.Task::(_decref) Task=`90bf1cd9-247b-48dd-8648-4c1ba6d4dc43`::ref 1 aborting False >Thread-136426::INFO::2014-10-29 11:18:20,239::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136426::DEBUG::2014-10-29 11:18:20,239::task::1191::Storage.TaskManager.Task::(prepare) Task=`90bf1cd9-247b-48dd-8648-4c1ba6d4dc43`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136426::DEBUG::2014-10-29 11:18:20,240::task::595::Storage.TaskManager.Task::(_updateState) Task=`90bf1cd9-247b-48dd-8648-4c1ba6d4dc43`::moving from state preparing -> state finished >Thread-136426::DEBUG::2014-10-29 11:18:20,240::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136426::DEBUG::2014-10-29 11:18:20,240::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136426::DEBUG::2014-10-29 11:18:20,241::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136426::DEBUG::2014-10-29 11:18:20,241::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136426::DEBUG::2014-10-29 11:18:20,241::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136426::DEBUG::2014-10-29 11:18:20,241::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136426::DEBUG::2014-10-29 11:18:20,242::task::993::Storage.TaskManager.Task::(_decref) Task=`90bf1cd9-247b-48dd-8648-4c1ba6d4dc43`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:20,261::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:20,275::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:20,280::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:18:20,288::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54386 >Detector thread::DEBUG::2014-10-29 11:18:20,289::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54386 >Detector thread::DEBUG::2014-10-29 11:18:20,290::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54386 >Detector thread::DEBUG::2014-10-29 11:18:20,290::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54386) >Thread-136431::DEBUG::2014-10-29 11:18:20,329::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136431::DEBUG::2014-10-29 11:18:20,330::task::595::Storage.TaskManager.Task::(_updateState) Task=`ed55c9af-1be4-4415-b171-27445f70fa2a`::moving from state init -> state preparing >Thread-136431::INFO::2014-10-29 11:18:20,330::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136431::INFO::2014-10-29 11:18:20,331::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000423238', 'lastCheck': '5.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520633', 'lastCheck': '5.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521254', 'lastCheck': '5.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000531754', 'lastCheck': '5.7', 'valid': True}} >Thread-136431::DEBUG::2014-10-29 11:18:20,331::task::1191::Storage.TaskManager.Task::(prepare) Task=`ed55c9af-1be4-4415-b171-27445f70fa2a`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000423238', 'lastCheck': '5.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520633', 'lastCheck': '5.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521254', 'lastCheck': '5.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000531754', 'lastCheck': '5.7', 'valid': True}} >Thread-136431::DEBUG::2014-10-29 11:18:20,332::task::595::Storage.TaskManager.Task::(_updateState) Task=`ed55c9af-1be4-4415-b171-27445f70fa2a`::moving from state preparing -> state finished >Thread-136431::DEBUG::2014-10-29 11:18:20,332::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136431::DEBUG::2014-10-29 11:18:20,332::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136431::DEBUG::2014-10-29 11:18:20,332::task::993::Storage.TaskManager.Task::(_decref) Task=`ed55c9af-1be4-4415-b171-27445f70fa2a`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:18:20,558::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54387 >Detector thread::DEBUG::2014-10-29 11:18:20,560::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54387 >Detector thread::DEBUG::2014-10-29 11:18:20,560::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54387 >Detector thread::DEBUG::2014-10-29 11:18:20,561::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54387) >Thread-136432::DEBUG::2014-10-29 11:18:20,599::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136432::DEBUG::2014-10-29 11:18:20,603::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136432::DEBUG::2014-10-29 11:18:20,623::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136432::DEBUG::2014-10-29 11:18:20,672::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '74', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '74', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:18:20,674::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54388 >Detector thread::DEBUG::2014-10-29 11:18:20,677::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54388 >Detector thread::DEBUG::2014-10-29 11:18:20,679::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54388 >Detector thread::DEBUG::2014-10-29 11:18:20,681::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54388) >Detector thread::DEBUG::2014-10-29 11:18:20,700::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54389 >Detector thread::DEBUG::2014-10-29 11:18:20,706::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54389 >Detector thread::DEBUG::2014-10-29 11:18:20,706::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54389 >Detector thread::DEBUG::2014-10-29 11:18:20,706::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54389) >Thread-136433::DEBUG::2014-10-29 11:18:20,713::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136433::DEBUG::2014-10-29 11:18:20,714::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136433::DEBUG::2014-10-29 11:18:20,715::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.55', 'elapsedTime': '514133', 'displayType': 'vnc', 'cpuSys': '0.67', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '4073501', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '54810', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '37852.56'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.79', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-136434::DEBUG::2014-10-29 11:18:20,747::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a75177e-ec9a-4155-b564-95956a1baaa7`::moving from state init -> state preparing >Thread-136434::INFO::2014-10-29 11:18:20,748::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136434::INFO::2014-10-29 11:18:20,748::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000423238', 'lastCheck': '6.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520633', 'lastCheck': '5.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521254', 'lastCheck': '6.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000531754', 'lastCheck': '6.1', 'valid': True}} >Thread-136434::DEBUG::2014-10-29 11:18:20,749::task::1191::Storage.TaskManager.Task::(prepare) Task=`0a75177e-ec9a-4155-b564-95956a1baaa7`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000423238', 'lastCheck': '6.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520633', 'lastCheck': '5.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521254', 'lastCheck': '6.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000531754', 'lastCheck': '6.1', 'valid': True}} >Thread-136434::DEBUG::2014-10-29 11:18:20,749::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a75177e-ec9a-4155-b564-95956a1baaa7`::moving from state preparing -> state finished >Thread-136434::DEBUG::2014-10-29 11:18:20,749::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136434::DEBUG::2014-10-29 11:18:20,749::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136434::DEBUG::2014-10-29 11:18:20,750::task::993::Storage.TaskManager.Task::(_decref) Task=`0a75177e-ec9a-4155-b564-95956a1baaa7`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:22,354::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:22,357::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136435::DEBUG::2014-10-29 11:18:22,360::task::595::Storage.TaskManager.Task::(_updateState) Task=`b7ea854f-ad21-44b4-80c3-addabc27b7ac`::moving from state init -> state preparing >Thread-136435::INFO::2014-10-29 11:18:22,360::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136435::INFO::2014-10-29 11:18:22,361::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000423238', 'lastCheck': '7.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520633', 'lastCheck': '7.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521254', 'lastCheck': '7.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000531754', 'lastCheck': '7.7', 'valid': True}} >Thread-136435::DEBUG::2014-10-29 11:18:22,361::task::1191::Storage.TaskManager.Task::(prepare) Task=`b7ea854f-ad21-44b4-80c3-addabc27b7ac`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000423238', 'lastCheck': '7.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520633', 'lastCheck': '7.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521254', 'lastCheck': '7.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000531754', 'lastCheck': '7.7', 'valid': True}} >Thread-136435::DEBUG::2014-10-29 11:18:22,362::task::595::Storage.TaskManager.Task::(_updateState) Task=`b7ea854f-ad21-44b4-80c3-addabc27b7ac`::moving from state preparing -> state finished >Thread-136435::DEBUG::2014-10-29 11:18:22,362::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136435::DEBUG::2014-10-29 11:18:22,362::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136435::DEBUG::2014-10-29 11:18:22,362::task::993::Storage.TaskManager.Task::(_decref) Task=`b7ea854f-ad21-44b4-80c3-addabc27b7ac`::ref 0 aborting False >Thread-136435::DEBUG::2014-10-29 11:18:22,382::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:22,405::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:22,407::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136436::DEBUG::2014-10-29 11:18:22,410::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136436::DEBUG::2014-10-29 11:18:22,412::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:18:24,463::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:24,465::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:24,465::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:24,465::__init__::232::IOProcess::(_processLogs) (201087) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:24,467::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201087) Queuing response >Thread-179::DEBUG::2014-10-29 11:18:24,468::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:18:24,485::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000497377 s, 748 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:18:24,487::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:24,488::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:24,489::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:24,490::__init__::232::IOProcess::(_processLogs) (201088) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:24,491::__init__::232::IOProcess::(_processLogs) (201088) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:24,676::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:24,676::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:24,678::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-178::DEBUG::2014-10-29 11:18:24,680::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:18:24,680::__init__::232::IOProcess::(_processLogs) (201089) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:24,698::__init__::232::IOProcess::(_processLogs) (201089) Queuing response >Thread-178::DEBUG::2014-10-29 11:18:24,700::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000511764 s, 993 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:18:24,702::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:24,702::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:24,703::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:24,703::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:24,705::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-10269::DEBUG::2014-10-29 11:18:24,706::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:18:24,707::__init__::232::IOProcess::(_processLogs) (201090) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:24,723::__init__::232::IOProcess::(_processLogs) (201090) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:24,723::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:24,724::__init__::232::IOProcess::(_processLogs) (201091) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:24,724::__init__::232::IOProcess::(_processLogs) (201091) Queuing response >Thread-10269::DEBUG::2014-10-29 11:18:24,729::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000411151 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:18:24,730::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:24,731::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:24,732::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:24,732::__init__::232::IOProcess::(_processLogs) (201092) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:24,733::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201092) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:24,734::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:24,734::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:24,735::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:24,735::__init__::232::IOProcess::(_processLogs) (201093) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:24,737::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201093) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:24,737::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:24,737::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:24,738::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:24,739::__init__::232::IOProcess::(_processLogs) (201094) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:24,739::__init__::232::IOProcess::(_processLogs) (201094) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:24,740::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:24,740::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:24,740::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:24,740::__init__::232::IOProcess::(_processLogs) (201095) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:24,741::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201095) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:24,893::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:24,894::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:24,894::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:24,894::__init__::232::IOProcess::(_processLogs) (201096) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:24,895::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201096) Queuing response >Thread-33::DEBUG::2014-10-29 11:18:24,897::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:18:24,914::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000589291 s, 826 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:18:24,917::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:24,917::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:24,918::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:24,918::__init__::232::IOProcess::(_processLogs) (201097) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:24,920::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201097) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:24,921::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:24,922::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:24,923::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:24,923::__init__::232::IOProcess::(_processLogs) (201098) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:24,923::__init__::232::IOProcess::(_processLogs) (201098) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:24,924::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:24,924::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:24,925::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:24,926::__init__::232::IOProcess::(_processLogs) (201099) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:24,926::__init__::232::IOProcess::(_processLogs) (201099) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:24,926::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:24,927::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:24,927::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:24,927::__init__::232::IOProcess::(_processLogs) (201100) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:24,928::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201100) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:25,287::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:25,289::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:25,290::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:25,454::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:25,456::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136437::DEBUG::2014-10-29 11:18:25,461::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:25,463::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:25,465::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136438::DEBUG::2014-10-29 11:18:25,476::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136438::DEBUG::2014-10-29 11:18:25,489::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:28,510::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:28,512::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136439::DEBUG::2014-10-29 11:18:28,515::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:28,517::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:28,519::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136440::DEBUG::2014-10-29 11:18:28,522::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136440::DEBUG::2014-10-29 11:18:28,524::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:30,298::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:30,299::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:30,301::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:18:30,747::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54391 >Detector thread::DEBUG::2014-10-29 11:18:30,749::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54391 >Detector thread::DEBUG::2014-10-29 11:18:30,750::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54391 >Detector thread::DEBUG::2014-10-29 11:18:30,750::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54391) >Thread-136441::DEBUG::2014-10-29 11:18:30,788::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136441::DEBUG::2014-10-29 11:18:30,790::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136441::DEBUG::2014-10-29 11:18:30,808::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136441::DEBUG::2014-10-29 11:18:30,855::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '55', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '55', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:18:30,872::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54392 >Detector thread::DEBUG::2014-10-29 11:18:30,889::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54394 >Detector thread::DEBUG::2014-10-29 11:18:30,892::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54394 >Detector thread::DEBUG::2014-10-29 11:18:30,894::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54394 >Detector thread::DEBUG::2014-10-29 11:18:30,895::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54394) >Detector thread::DEBUG::2014-10-29 11:18:30,900::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54392 >Detector thread::DEBUG::2014-10-29 11:18:30,902::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54392 >Detector thread::DEBUG::2014-10-29 11:18:30,904::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54392) >Detector thread::DEBUG::2014-10-29 11:18:30,978::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54395 >Detector thread::DEBUG::2014-10-29 11:18:30,985::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54395 >Detector thread::DEBUG::2014-10-29 11:18:30,988::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54395 >Detector thread::DEBUG::2014-10-29 11:18:30,992::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54395) >Thread-136442::DEBUG::2014-10-29 11:18:30,994::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136443::DEBUG::2014-10-29 11:18:30,999::task::595::Storage.TaskManager.Task::(_updateState) Task=`594dbe9f-fd9a-48b9-9d91-d24f69a0f676`::moving from state init -> state preparing >Thread-136442::DEBUG::2014-10-29 11:18:31,003::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd3477a2-517e-4d09-bd65-b6aef72118bd`::moving from state init -> state preparing >Thread-136443::INFO::2014-10-29 11:18:31,003::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136444::DEBUG::2014-10-29 11:18:31,006::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136442::INFO::2014-10-29 11:18:31,008::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136443::INFO::2014-10-29 11:18:31,015::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511764', 'lastCheck': '6.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589291', 'lastCheck': '6.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000497377', 'lastCheck': '6.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000411151', 'lastCheck': '6.3', 'valid': True}} >Thread-136444::DEBUG::2014-10-29 11:18:31,016::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136443::DEBUG::2014-10-29 11:18:31,020::task::1191::Storage.TaskManager.Task::(prepare) Task=`594dbe9f-fd9a-48b9-9d91-d24f69a0f676`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511764', 'lastCheck': '6.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589291', 'lastCheck': '6.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000497377', 'lastCheck': '6.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000411151', 'lastCheck': '6.3', 'valid': True}} >Thread-136443::DEBUG::2014-10-29 11:18:31,023::task::595::Storage.TaskManager.Task::(_updateState) Task=`594dbe9f-fd9a-48b9-9d91-d24f69a0f676`::moving from state preparing -> state finished >Thread-136444::DEBUG::2014-10-29 11:18:31,026::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.55', 'elapsedTime': '514143', 'displayType': 'vnc', 'cpuSys': '0.67', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '4073501', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '54810', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '37852.56'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.03', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-136443::DEBUG::2014-10-29 11:18:31,026::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136443::DEBUG::2014-10-29 11:18:31,030::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136443::DEBUG::2014-10-29 11:18:31,035::task::993::Storage.TaskManager.Task::(_decref) Task=`594dbe9f-fd9a-48b9-9d91-d24f69a0f676`::ref 0 aborting False >Thread-136442::DEBUG::2014-10-29 11:18:31,042::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:18:31,051::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:31,055::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:31,059::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:31,062::__init__::232::IOProcess::(_processLogs) (201101) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:31,069::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201101) Queuing response >Thread-136442::DEBUG::2014-10-29 11:18:31,069::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136442::DEBUG::2014-10-29 11:18:31,072::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136442::INFO::2014-10-29 11:18:31,074::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136442::DEBUG::2014-10-29 11:18:31,076::task::1191::Storage.TaskManager.Task::(prepare) Task=`cd3477a2-517e-4d09-bd65-b6aef72118bd`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136442::DEBUG::2014-10-29 11:18:31,077::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd3477a2-517e-4d09-bd65-b6aef72118bd`::moving from state preparing -> state finished >Thread-136442::DEBUG::2014-10-29 11:18:31,079::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136442::DEBUG::2014-10-29 11:18:31,080::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136442::DEBUG::2014-10-29 11:18:31,082::task::993::Storage.TaskManager.Task::(_decref) Task=`cd3477a2-517e-4d09-bd65-b6aef72118bd`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:18:31,150::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54396 >Detector thread::DEBUG::2014-10-29 11:18:31,150::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54396 >Detector thread::DEBUG::2014-10-29 11:18:31,151::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54396 >Detector thread::DEBUG::2014-10-29 11:18:31,151::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54396) >Thread-136445::DEBUG::2014-10-29 11:18:31,190::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136445::DEBUG::2014-10-29 11:18:31,191::task::595::Storage.TaskManager.Task::(_updateState) Task=`74bbd31f-19cc-4f1a-8824-17ac27ccb583`::moving from state init -> state preparing >Thread-136445::INFO::2014-10-29 11:18:31,191::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136445::DEBUG::2014-10-29 11:18:31,191::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136445::DEBUG::2014-10-29 11:18:31,192::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136445::DEBUG::2014-10-29 11:18:31,192::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136445::DEBUG::2014-10-29 11:18:31,192::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136445::DEBUG::2014-10-29 11:18:31,192::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136445::DEBUG::2014-10-29 11:18:31,193::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136445::DEBUG::2014-10-29 11:18:31,284::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136445::DEBUG::2014-10-29 11:18:31,285::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136445::DEBUG::2014-10-29 11:18:31,464::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136445::DEBUG::2014-10-29 11:18:31,465::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136445::DEBUG::2014-10-29 11:18:31,466::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136445::DEBUG::2014-10-29 11:18:31,466::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136445::DEBUG::2014-10-29 11:18:31,466::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136445::DEBUG::2014-10-29 11:18:31,467::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136445::DEBUG::2014-10-29 11:18:31,467::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136445::DEBUG::2014-10-29 11:18:31,467::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:18:31,472::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:31,474::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:31,477::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:31,477::__init__::232::IOProcess::(_processLogs) (201102) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:31,479::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201102) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:31,480::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:31,480::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:31,480::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:31,481::__init__::232::IOProcess::(_processLogs) (201103) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:31,482::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201103) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:31,483::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:31,485::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:31,487::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:31,489::__init__::232::IOProcess::(_processLogs) (201104) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:31,494::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201104) Queuing response >Thread-136445::DEBUG::2014-10-29 11:18:31,495::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:18:31,497::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:31,498::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:31,498::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:31,498::__init__::232::IOProcess::(_processLogs) (201105) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:31,499::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201105) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:31,500::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:31,500::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:31,500::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:31,501::__init__::232::IOProcess::(_processLogs) (201106) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:18:31,501::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201106) Queuing response >Thread-136445::DEBUG::2014-10-29 11:18:31,502::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:18:31,504::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:31,505::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:31,505::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:31,505::__init__::232::IOProcess::(_processLogs) (201107) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:18:31,506::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201107) Queuing response >Thread-136445::DEBUG::2014-10-29 11:18:31,506::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:18:31,508::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:31,509::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:31,510::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:31,511::__init__::232::IOProcess::(_processLogs) (201108) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:31,515::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201108) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:31,520::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:31,521::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:31,522::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:31,523::__init__::232::IOProcess::(_processLogs) (201109) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:31,525::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201109) Queuing response >Thread-136445::DEBUG::2014-10-29 11:18:31,526::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-136445::INFO::2014-10-29 11:18:31,528::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136445::INFO::2014-10-29 11:18:31,529::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136445::INFO::2014-10-29 11:18:31,529::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:18:31,530::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:31,531::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:31,531::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:31,533::__init__::232::IOProcess::(_processLogs) (201110) Got request for method 'readfile' >Thread-136445::DEBUG::2014-10-29 11:18:31,532::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:18:31,533::__init__::232::IOProcess::(_processLogs) (201110) Queuing response >Thread-136445::DEBUG::2014-10-29 11:18:31,536::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`ac647c17-0367-4a0d-a71b-9709aaf33cab`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136445::DEBUG::2014-10-29 11:18:31,536::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136445::DEBUG::2014-10-29 11:18:31,536::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136445::DEBUG::2014-10-29 11:18:31,537::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`ac647c17-0367-4a0d-a71b-9709aaf33cab`::Granted request >Thread-136445::DEBUG::2014-10-29 11:18:31,537::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`74bbd31f-19cc-4f1a-8824-17ac27ccb583`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136445::DEBUG::2014-10-29 11:18:31,538::task::993::Storage.TaskManager.Task::(_decref) Task=`74bbd31f-19cc-4f1a-8824-17ac27ccb583`::ref 1 aborting False >Thread-136445::INFO::2014-10-29 11:18:31,540::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136445::DEBUG::2014-10-29 11:18:31,541::task::1191::Storage.TaskManager.Task::(prepare) Task=`74bbd31f-19cc-4f1a-8824-17ac27ccb583`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136445::DEBUG::2014-10-29 11:18:31,541::task::595::Storage.TaskManager.Task::(_updateState) Task=`74bbd31f-19cc-4f1a-8824-17ac27ccb583`::moving from state preparing -> state finished >Thread-136445::DEBUG::2014-10-29 11:18:31,541::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136445::DEBUG::2014-10-29 11:18:31,541::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136445::DEBUG::2014-10-29 11:18:31,542::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136445::DEBUG::2014-10-29 11:18:31,542::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136445::DEBUG::2014-10-29 11:18:31,542::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136445::DEBUG::2014-10-29 11:18:31,543::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136445::DEBUG::2014-10-29 11:18:31,543::task::993::Storage.TaskManager.Task::(_decref) Task=`74bbd31f-19cc-4f1a-8824-17ac27ccb583`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:31,559::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:31,562::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Detector thread::DEBUG::2014-10-29 11:18:31,565::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54398 >Thread-136450::DEBUG::2014-10-29 11:18:31,566::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:18:31,568::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54398 >Detector thread::DEBUG::2014-10-29 11:18:31,570::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54398 >Detector thread::DEBUG::2014-10-29 11:18:31,570::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54398) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:31,573::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:31,577::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136452::DEBUG::2014-10-29 11:18:31,580::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136452::DEBUG::2014-10-29 11:18:31,582::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-136451::DEBUG::2014-10-29 11:18:31,606::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136451::DEBUG::2014-10-29 11:18:31,607::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e6e0d27-5db6-45ae-a215-d0784e8ba201`::moving from state init -> state preparing >Thread-136451::INFO::2014-10-29 11:18:31,607::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136451::INFO::2014-10-29 11:18:31,608::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511764', 'lastCheck': '6.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589291', 'lastCheck': '6.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000497377', 'lastCheck': '7.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000411151', 'lastCheck': '6.9', 'valid': True}} >Thread-136451::DEBUG::2014-10-29 11:18:31,608::task::1191::Storage.TaskManager.Task::(prepare) Task=`3e6e0d27-5db6-45ae-a215-d0784e8ba201`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511764', 'lastCheck': '6.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589291', 'lastCheck': '6.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000497377', 'lastCheck': '7.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000411151', 'lastCheck': '6.9', 'valid': True}} >Thread-136451::DEBUG::2014-10-29 11:18:31,608::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e6e0d27-5db6-45ae-a215-d0784e8ba201`::moving from state preparing -> state finished >Thread-136451::DEBUG::2014-10-29 11:18:31,609::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136451::DEBUG::2014-10-29 11:18:31,609::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136451::DEBUG::2014-10-29 11:18:31,609::task::993::Storage.TaskManager.Task::(_decref) Task=`3e6e0d27-5db6-45ae-a215-d0784e8ba201`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-10-29 11:18:34,000::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >Thread-22::DEBUG::2014-10-29 11:18:34,001::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-17::DEBUG::2014-10-29 11:18:34,493::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:34,493::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:34,493::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:34,494::__init__::232::IOProcess::(_processLogs) (201111) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:34,495::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201111) Queuing response >Thread-179::DEBUG::2014-10-29 11:18:34,496::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:18:34,514::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000425433 s, 874 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:18:34,516::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:34,516::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:34,516::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:34,517::__init__::232::IOProcess::(_processLogs) (201112) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:34,517::__init__::232::IOProcess::(_processLogs) (201112) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:34,596::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:34,599::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136453::DEBUG::2014-10-29 11:18:34,603::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:34,605::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:34,606::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136454::DEBUG::2014-10-29 11:18:34,610::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136454::DEBUG::2014-10-29 11:18:34,612::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:18:34,738::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:34,739::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-10269::DEBUG::2014-10-29 11:18:34,741::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:18:34,741::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:34,760::__init__::232::IOProcess::(_processLogs) (201113) Got request for method 'statvfs' >Thread-10269::DEBUG::2014-10-29 11:18:34,762::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000532416 s, 943 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:18:34,762::__init__::232::IOProcess::(_processLogs) (201113) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:34,765::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:34,765::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:34,766::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:34,766::__init__::232::IOProcess::(_processLogs) (201114) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:34,766::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:34,766::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:34,768::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:34,770::__init__::232::IOProcess::(_processLogs) (201115) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:18:34,770::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:18:34,772::__init__::232::IOProcess::(_processLogs) (201114) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:34,789::__init__::232::IOProcess::(_processLogs) (201115) Queuing response >Thread-178::DEBUG::2014-10-29 11:18:34,790::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000545029 s, 932 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:18:34,797::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:34,797::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:34,799::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:34,801::__init__::232::IOProcess::(_processLogs) (201116) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:34,801::__init__::232::IOProcess::(_processLogs) (201116) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:34,802::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:34,802::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:34,803::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:34,804::__init__::232::IOProcess::(_processLogs) (201117) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:34,804::__init__::232::IOProcess::(_processLogs) (201117) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:34,804::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:34,805::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:34,805::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:34,805::__init__::232::IOProcess::(_processLogs) (201118) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:34,806::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201118) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:34,807::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:34,807::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:34,808::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:34,809::__init__::232::IOProcess::(_processLogs) (201119) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:34,810::__init__::232::IOProcess::(_processLogs) (201119) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:34,930::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:34,930::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:34,931::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:34,931::__init__::232::IOProcess::(_processLogs) (201120) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:34,932::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201120) Queuing response >Thread-33::DEBUG::2014-10-29 11:18:34,934::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:18:34,951::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000580835 s, 838 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:18:34,953::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:34,953::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:34,955::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:34,957::__init__::232::IOProcess::(_processLogs) (201121) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:34,957::__init__::232::IOProcess::(_processLogs) (201121) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:34,957::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:34,958::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:34,958::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:34,958::__init__::232::IOProcess::(_processLogs) (201122) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:34,958::__init__::232::IOProcess::(_processLogs) (201122) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:34,960::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:34,960::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:34,961::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:34,962::__init__::232::IOProcess::(_processLogs) (201123) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:34,962::__init__::232::IOProcess::(_processLogs) (201123) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:34,962::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:34,963::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:34,963::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:34,963::__init__::232::IOProcess::(_processLogs) (201124) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:34,963::__init__::232::IOProcess::(_processLogs) (201124) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:35,308::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:35,309::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:35,313::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:37,625::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:37,629::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136455::DEBUG::2014-10-29 11:18:37,632::task::595::Storage.TaskManager.Task::(_updateState) Task=`7b0e235d-998b-4a73-a469-2874fc140ea3`::moving from state init -> state preparing >Thread-136455::INFO::2014-10-29 11:18:37,633::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136455::INFO::2014-10-29 11:18:37,634::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000545029', 'lastCheck': '2.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580835', 'lastCheck': '2.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425433', 'lastCheck': '3.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000532416', 'lastCheck': '2.8', 'valid': True}} >Thread-136455::DEBUG::2014-10-29 11:18:37,634::task::1191::Storage.TaskManager.Task::(prepare) Task=`7b0e235d-998b-4a73-a469-2874fc140ea3`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000545029', 'lastCheck': '2.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580835', 'lastCheck': '2.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425433', 'lastCheck': '3.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000532416', 'lastCheck': '2.8', 'valid': True}} >Thread-136455::DEBUG::2014-10-29 11:18:37,634::task::595::Storage.TaskManager.Task::(_updateState) Task=`7b0e235d-998b-4a73-a469-2874fc140ea3`::moving from state preparing -> state finished >Thread-136455::DEBUG::2014-10-29 11:18:37,635::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136455::DEBUG::2014-10-29 11:18:37,635::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136455::DEBUG::2014-10-29 11:18:37,635::task::993::Storage.TaskManager.Task::(_decref) Task=`7b0e235d-998b-4a73-a469-2874fc140ea3`::ref 0 aborting False >Thread-136455::DEBUG::2014-10-29 11:18:37,658::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:37,681::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:37,684::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136456::DEBUG::2014-10-29 11:18:37,687::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136456::DEBUG::2014-10-29 11:18:37,689::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:18:40,239::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54399 >Detector thread::DEBUG::2014-10-29 11:18:40,240::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54399 >Detector thread::DEBUG::2014-10-29 11:18:40,240::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54399 >Detector thread::DEBUG::2014-10-29 11:18:40,240::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54399) >Thread-136457::DEBUG::2014-10-29 11:18:40,279::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136457::DEBUG::2014-10-29 11:18:40,280::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136457::DEBUG::2014-10-29 11:18:40,281::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.35', 'elapsedTime': '514152', 'displayType': 'vnc', 'cpuSys': '0.60', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '4073501', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '54810', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '37852.56'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.28', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:40,317::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:40,319::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:40,320::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:40,734::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:40,737::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136458::DEBUG::2014-10-29 11:18:40,741::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:40,743::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:40,745::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136459::DEBUG::2014-10-29 11:18:40,748::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136459::DEBUG::2014-10-29 11:18:40,751::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:18:40,907::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54401 >Detector thread::DEBUG::2014-10-29 11:18:40,907::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54401 >Detector thread::DEBUG::2014-10-29 11:18:40,908::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54401 >Detector thread::DEBUG::2014-10-29 11:18:40,908::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54401) >Thread-136460::DEBUG::2014-10-29 11:18:40,947::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136460::DEBUG::2014-10-29 11:18:40,949::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136460::DEBUG::2014-10-29 11:18:40,966::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136460::DEBUG::2014-10-29 11:18:41,015::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '39', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '39', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:18:41,173::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54402 >Detector thread::DEBUG::2014-10-29 11:18:41,176::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54402 >Detector thread::DEBUG::2014-10-29 11:18:41,178::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54402 >Detector thread::DEBUG::2014-10-29 11:18:41,179::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54402) >Thread-136461::DEBUG::2014-10-29 11:18:41,219::task::595::Storage.TaskManager.Task::(_updateState) Task=`2472b82c-b977-496d-84eb-e3299ee9f34c`::moving from state init -> state preparing >Thread-136461::INFO::2014-10-29 11:18:41,220::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136461::INFO::2014-10-29 11:18:41,220::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000545029', 'lastCheck': '6.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580835', 'lastCheck': '6.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425433', 'lastCheck': '6.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000532416', 'lastCheck': '6.4', 'valid': True}} >Thread-136461::DEBUG::2014-10-29 11:18:41,221::task::1191::Storage.TaskManager.Task::(prepare) Task=`2472b82c-b977-496d-84eb-e3299ee9f34c`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000545029', 'lastCheck': '6.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580835', 'lastCheck': '6.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425433', 'lastCheck': '6.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000532416', 'lastCheck': '6.4', 'valid': True}} >Thread-136461::DEBUG::2014-10-29 11:18:41,221::task::595::Storage.TaskManager.Task::(_updateState) Task=`2472b82c-b977-496d-84eb-e3299ee9f34c`::moving from state preparing -> state finished >Thread-136461::DEBUG::2014-10-29 11:18:41,221::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136461::DEBUG::2014-10-29 11:18:41,221::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136461::DEBUG::2014-10-29 11:18:41,222::task::993::Storage.TaskManager.Task::(_decref) Task=`2472b82c-b977-496d-84eb-e3299ee9f34c`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:18:42,175::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54404 >Detector thread::DEBUG::2014-10-29 11:18:42,176::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54404 >Detector thread::DEBUG::2014-10-29 11:18:42,176::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54404 >Detector thread::DEBUG::2014-10-29 11:18:42,177::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54404) >Thread-136462::DEBUG::2014-10-29 11:18:42,216::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136462::DEBUG::2014-10-29 11:18:42,216::task::595::Storage.TaskManager.Task::(_updateState) Task=`17dbebe9-232f-4f5a-ac90-d641abf29673`::moving from state init -> state preparing >Thread-136462::INFO::2014-10-29 11:18:42,217::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136462::DEBUG::2014-10-29 11:18:42,219::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:18:42,220::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:42,221::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:42,221::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:42,221::__init__::232::IOProcess::(_processLogs) (201125) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:42,223::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201125) Queuing response >Thread-136462::DEBUG::2014-10-29 11:18:42,223::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136462::DEBUG::2014-10-29 11:18:42,224::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136462::INFO::2014-10-29 11:18:42,224::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136462::DEBUG::2014-10-29 11:18:42,224::task::1191::Storage.TaskManager.Task::(prepare) Task=`17dbebe9-232f-4f5a-ac90-d641abf29673`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136462::DEBUG::2014-10-29 11:18:42,225::task::595::Storage.TaskManager.Task::(_updateState) Task=`17dbebe9-232f-4f5a-ac90-d641abf29673`::moving from state preparing -> state finished >Thread-136462::DEBUG::2014-10-29 11:18:42,225::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136462::DEBUG::2014-10-29 11:18:42,225::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136462::DEBUG::2014-10-29 11:18:42,225::task::993::Storage.TaskManager.Task::(_decref) Task=`17dbebe9-232f-4f5a-ac90-d641abf29673`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:18:42,269::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54405 >Detector thread::DEBUG::2014-10-29 11:18:42,269::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54405 >Detector thread::DEBUG::2014-10-29 11:18:42,269::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54405 >Detector thread::DEBUG::2014-10-29 11:18:42,270::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54405) >Thread-136463::DEBUG::2014-10-29 11:18:42,309::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136463::DEBUG::2014-10-29 11:18:42,309::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c29ef0b-d7ec-4910-9803-9f18da8305b8`::moving from state init -> state preparing >Thread-136463::INFO::2014-10-29 11:18:42,310::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136463::DEBUG::2014-10-29 11:18:42,310::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136463::DEBUG::2014-10-29 11:18:42,310::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136463::DEBUG::2014-10-29 11:18:42,311::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136463::DEBUG::2014-10-29 11:18:42,311::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136463::DEBUG::2014-10-29 11:18:42,311::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136463::DEBUG::2014-10-29 11:18:42,312::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136463::DEBUG::2014-10-29 11:18:42,402::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136463::DEBUG::2014-10-29 11:18:42,403::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136463::DEBUG::2014-10-29 11:18:42,576::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136463::DEBUG::2014-10-29 11:18:42,577::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136463::DEBUG::2014-10-29 11:18:42,577::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136463::DEBUG::2014-10-29 11:18:42,578::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136463::DEBUG::2014-10-29 11:18:42,578::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136463::DEBUG::2014-10-29 11:18:42,579::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136463::DEBUG::2014-10-29 11:18:42,579::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136463::DEBUG::2014-10-29 11:18:42,579::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:18:42,585::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:42,588::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:42,590::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:42,591::__init__::232::IOProcess::(_processLogs) (201126) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:42,591::__init__::232::IOProcess::(_processLogs) (201126) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:42,592::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:42,593::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:42,593::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:42,593::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:42,593::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:42,594::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:42,594::__init__::232::IOProcess::(_processLogs) (201127) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:42,594::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:42,594::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:42,595::__init__::232::IOProcess::(_processLogs) (201128) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:42,595::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:42,595::__init__::232::IOProcess::(_processLogs) (201129) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:42,596::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201127) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:42,598::__init__::232::IOProcess::(_processLogs) (201129) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:42,599::__init__::232::IOProcess::(_processLogs) (201128) Queuing response >Thread-136463::DEBUG::2014-10-29 11:18:42,606::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:18:42,607::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:42,607::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:42,608::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:42,608::__init__::232::IOProcess::(_processLogs) (201130) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:18:42,610::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201130) Queuing response >Thread-136463::DEBUG::2014-10-29 11:18:42,611::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:18:42,612::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:42,612::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:42,612::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:42,613::__init__::232::IOProcess::(_processLogs) (201131) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:18:42,613::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201131) Queuing response >Thread-136463::DEBUG::2014-10-29 11:18:42,614::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:18:42,615::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:42,615::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:42,616::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:42,617::__init__::232::IOProcess::(_processLogs) (201132) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:42,617::__init__::232::IOProcess::(_processLogs) (201132) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:42,618::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:42,618::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:42,618::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:42,618::__init__::232::IOProcess::(_processLogs) (201133) Got request for method 'glob' >Thread-136463::DEBUG::2014-10-29 11:18:42,619::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:18:42,619::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201133) Queuing response >Thread-136463::INFO::2014-10-29 11:18:42,620::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136463::INFO::2014-10-29 11:18:42,621::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136463::INFO::2014-10-29 11:18:42,622::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:18:42,622::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:42,623::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:42,623::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:42,623::__init__::232::IOProcess::(_processLogs) (201134) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:18:42,624::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201134) Queuing response >Thread-136463::DEBUG::2014-10-29 11:18:42,624::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136463::DEBUG::2014-10-29 11:18:42,626::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`3320597d-cd97-4663-b444-2c3efcd8bee0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136463::DEBUG::2014-10-29 11:18:42,627::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136463::DEBUG::2014-10-29 11:18:42,627::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136463::DEBUG::2014-10-29 11:18:42,628::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`3320597d-cd97-4663-b444-2c3efcd8bee0`::Granted request >Thread-136463::DEBUG::2014-10-29 11:18:42,628::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7c29ef0b-d7ec-4910-9803-9f18da8305b8`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136463::DEBUG::2014-10-29 11:18:42,629::task::993::Storage.TaskManager.Task::(_decref) Task=`7c29ef0b-d7ec-4910-9803-9f18da8305b8`::ref 1 aborting False >Thread-136463::INFO::2014-10-29 11:18:42,631::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136463::DEBUG::2014-10-29 11:18:42,632::task::1191::Storage.TaskManager.Task::(prepare) Task=`7c29ef0b-d7ec-4910-9803-9f18da8305b8`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136463::DEBUG::2014-10-29 11:18:42,632::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c29ef0b-d7ec-4910-9803-9f18da8305b8`::moving from state preparing -> state finished >Thread-136463::DEBUG::2014-10-29 11:18:42,632::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136463::DEBUG::2014-10-29 11:18:42,632::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136463::DEBUG::2014-10-29 11:18:42,633::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136463::DEBUG::2014-10-29 11:18:42,633::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136463::DEBUG::2014-10-29 11:18:42,633::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136463::DEBUG::2014-10-29 11:18:42,634::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136463::DEBUG::2014-10-29 11:18:42,634::task::993::Storage.TaskManager.Task::(_decref) Task=`7c29ef0b-d7ec-4910-9803-9f18da8305b8`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:18:42,656::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54406 >Detector thread::DEBUG::2014-10-29 11:18:42,657::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54406 >Detector thread::DEBUG::2014-10-29 11:18:42,657::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54406 >Detector thread::DEBUG::2014-10-29 11:18:42,658::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54406) >Thread-136468::DEBUG::2014-10-29 11:18:42,696::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136468::DEBUG::2014-10-29 11:18:42,696::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ffcbe50-71ac-4ff1-a1c2-57d647bf6f4c`::moving from state init -> state preparing >Thread-136468::INFO::2014-10-29 11:18:42,697::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136468::INFO::2014-10-29 11:18:42,697::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000545029', 'lastCheck': '7.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580835', 'lastCheck': '7.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425433', 'lastCheck': '8.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000532416', 'lastCheck': '7.9', 'valid': True}} >Thread-136468::DEBUG::2014-10-29 11:18:42,698::task::1191::Storage.TaskManager.Task::(prepare) Task=`9ffcbe50-71ac-4ff1-a1c2-57d647bf6f4c`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000545029', 'lastCheck': '7.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580835', 'lastCheck': '7.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425433', 'lastCheck': '8.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000532416', 'lastCheck': '7.9', 'valid': True}} >Thread-136468::DEBUG::2014-10-29 11:18:42,698::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ffcbe50-71ac-4ff1-a1c2-57d647bf6f4c`::moving from state preparing -> state finished >Thread-136468::DEBUG::2014-10-29 11:18:42,698::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136468::DEBUG::2014-10-29 11:18:42,698::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136468::DEBUG::2014-10-29 11:18:42,699::task::993::Storage.TaskManager.Task::(_decref) Task=`9ffcbe50-71ac-4ff1-a1c2-57d647bf6f4c`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:43,785::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:43,788::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136469::DEBUG::2014-10-29 11:18:43,791::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:43,794::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:43,795::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136470::DEBUG::2014-10-29 11:18:43,799::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136470::DEBUG::2014-10-29 11:18:43,801::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:18:44,522::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:44,523::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:44,525::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-179::DEBUG::2014-10-29 11:18:44,525::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:18:44,526::__init__::232::IOProcess::(_processLogs) (201135) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:44,542::__init__::232::IOProcess::(_processLogs) (201135) Queuing response >Thread-179::DEBUG::2014-10-29 11:18:44,545::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000624398 s, 596 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:18:44,547::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:44,547::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:44,547::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:44,548::__init__::232::IOProcess::(_processLogs) (201136) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:44,550::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201136) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:44,799::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:44,800::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:44,800::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:44,800::__init__::232::IOProcess::(_processLogs) (201137) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:44,802::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201137) Queuing response >Thread-10269::DEBUG::2014-10-29 11:18:44,803::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:18:44,823::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000468841 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:18:44,823::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:44,826::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:44,826::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:44,828::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201138) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:18:44,829::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:18:44,829::__init__::232::IOProcess::(_processLogs) (201138) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:44,850::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-178::DEBUG::2014-10-29 11:18:44,851::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000482307 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:18:44,852::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:44,854::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:44,855::__init__::232::IOProcess::(_processLogs) (201139) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:44,855::__init__::232::IOProcess::(_processLogs) (201139) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:44,859::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:44,859::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:44,859::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:44,860::__init__::232::IOProcess::(_processLogs) (201140) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:44,861::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201140) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:44,863::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:44,863::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:44,864::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:44,865::__init__::232::IOProcess::(_processLogs) (201141) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:44,865::__init__::232::IOProcess::(_processLogs) (201141) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:44,866::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:44,866::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:44,867::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:44,868::__init__::232::IOProcess::(_processLogs) (201142) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:44,868::__init__::232::IOProcess::(_processLogs) (201142) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:44,868::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:44,869::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:44,870::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:44,870::__init__::232::IOProcess::(_processLogs) (201143) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:44,871::__init__::232::IOProcess::(_processLogs) (201143) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:44,966::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:44,966::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:44,967::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-33::DEBUG::2014-10-29 11:18:44,969::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:18:44,969::__init__::232::IOProcess::(_processLogs) (201144) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:44,987::__init__::232::IOProcess::(_processLogs) (201144) Queuing response >Thread-33::DEBUG::2014-10-29 11:18:44,989::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00052387 s, 930 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:18:44,991::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:44,991::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:44,991::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:44,992::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201145) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:44,993::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201145) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:44,995::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:44,996::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:44,997::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:44,997::__init__::232::IOProcess::(_processLogs) (201146) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:44,997::__init__::232::IOProcess::(_processLogs) (201146) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:44,998::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:44,998::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:44,998::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:44,999::__init__::232::IOProcess::(_processLogs) (201147) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:45,000::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201147) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:45,001::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:45,001::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:45,001::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:45,001::__init__::232::IOProcess::(_processLogs) (201148) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:45,002::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201148) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:45,328::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:45,329::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:45,330::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:46,817::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:46,823::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136471::DEBUG::2014-10-29 11:18:46,833::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:46,838::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:46,843::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136472::DEBUG::2014-10-29 11:18:46,853::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136472::DEBUG::2014-10-29 11:18:46,871::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:18:49,015::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba611a5e-2aef-4688-bcd1-d6098607d659`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:18:49,016::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:18:49,017::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:49,018::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:49,018::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:49,018::__init__::232::IOProcess::(_processLogs) (201149) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:18:49,019::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201149) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:49,021::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:49,023::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:49,024::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-22::INFO::2014-10-29 11:18:49,023::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010871808', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:18:49,025::task::1191::Storage.TaskManager.Task::(prepare) Task=`ba611a5e-2aef-4688-bcd1-d6098607d659`::finished: {'truesize': '6010871808', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:18:49,025::__init__::232::IOProcess::(_processLogs) (201150) Got request for method 'stat' >Thread-22::DEBUG::2014-10-29 11:18:49,026::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba611a5e-2aef-4688-bcd1-d6098607d659`::moving from state preparing -> state finished >Thread-22::DEBUG::2014-10-29 11:18:49,027::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17::DEBUG::2014-10-29 11:18:49,027::__init__::232::IOProcess::(_processLogs) (201150) Queuing response >Thread-22::DEBUG::2014-10-29 11:18:49,028::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2014-10-29 11:18:49,029::task::993::Storage.TaskManager.Task::(_decref) Task=`ba611a5e-2aef-4688-bcd1-d6098607d659`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:18:49,099::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:49,902::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:49,904::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136473::DEBUG::2014-10-29 11:18:49,907::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:49,909::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:49,911::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136474::DEBUG::2014-10-29 11:18:49,915::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136474::DEBUG::2014-10-29 11:18:49,918::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:18:50,274::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54407 >Detector thread::DEBUG::2014-10-29 11:18:50,274::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54407 >Detector thread::DEBUG::2014-10-29 11:18:50,275::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54407 >Detector thread::DEBUG::2014-10-29 11:18:50,275::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54407) >Thread-136475::DEBUG::2014-10-29 11:18:50,315::task::595::Storage.TaskManager.Task::(_updateState) Task=`357db762-c4ce-416b-8f7f-cdeef57e72b0`::moving from state init -> state preparing >Thread-136475::INFO::2014-10-29 11:18:50,315::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136475::INFO::2014-10-29 11:18:50,316::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482307', 'lastCheck': '5.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052387', 'lastCheck': '5.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000624398', 'lastCheck': '5.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000468841', 'lastCheck': '5.5', 'valid': True}} >Thread-136475::DEBUG::2014-10-29 11:18:50,316::task::1191::Storage.TaskManager.Task::(prepare) Task=`357db762-c4ce-416b-8f7f-cdeef57e72b0`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482307', 'lastCheck': '5.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052387', 'lastCheck': '5.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000624398', 'lastCheck': '5.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000468841', 'lastCheck': '5.5', 'valid': True}} >Thread-136475::DEBUG::2014-10-29 11:18:50,316::task::595::Storage.TaskManager.Task::(_updateState) Task=`357db762-c4ce-416b-8f7f-cdeef57e72b0`::moving from state preparing -> state finished >Thread-136475::DEBUG::2014-10-29 11:18:50,316::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136475::DEBUG::2014-10-29 11:18:50,317::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136475::DEBUG::2014-10-29 11:18:50,317::task::993::Storage.TaskManager.Task::(_decref) Task=`357db762-c4ce-416b-8f7f-cdeef57e72b0`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:50,337::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:50,339::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:50,340::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:18:50,436::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54408 >Detector thread::DEBUG::2014-10-29 11:18:50,437::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54408 >Detector thread::DEBUG::2014-10-29 11:18:50,437::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54408 >Detector thread::DEBUG::2014-10-29 11:18:50,438::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54408) >Thread-136476::DEBUG::2014-10-29 11:18:50,477::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136476::DEBUG::2014-10-29 11:18:50,478::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136476::DEBUG::2014-10-29 11:18:50,478::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.47', 'elapsedTime': '514162', 'displayType': 'vnc', 'cpuSys': '1.13', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '4241397', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '69188', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '33745.03'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.46', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:18:51,057::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54410 >Detector thread::DEBUG::2014-10-29 11:18:51,057::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54410 >Detector thread::DEBUG::2014-10-29 11:18:51,059::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54410 >Detector thread::DEBUG::2014-10-29 11:18:51,059::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54410) >Thread-136477::DEBUG::2014-10-29 11:18:51,097::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136477::DEBUG::2014-10-29 11:18:51,099::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136477::DEBUG::2014-10-29 11:18:51,120::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136477::DEBUG::2014-10-29 11:18:51,166::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '24', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '24', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:52,937::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:52,944::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136478::DEBUG::2014-10-29 11:18:52,948::task::595::Storage.TaskManager.Task::(_updateState) Task=`7271c0c6-6870-44bf-ad18-0dc264f98036`::moving from state init -> state preparing >Thread-136478::INFO::2014-10-29 11:18:52,948::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136478::INFO::2014-10-29 11:18:52,949::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482307', 'lastCheck': '8.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052387', 'lastCheck': '7.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000624398', 'lastCheck': '8.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000468841', 'lastCheck': '8.1', 'valid': True}} >Thread-136478::DEBUG::2014-10-29 11:18:52,949::task::1191::Storage.TaskManager.Task::(prepare) Task=`7271c0c6-6870-44bf-ad18-0dc264f98036`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482307', 'lastCheck': '8.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052387', 'lastCheck': '7.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000624398', 'lastCheck': '8.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000468841', 'lastCheck': '8.1', 'valid': True}} >Thread-136478::DEBUG::2014-10-29 11:18:52,950::task::595::Storage.TaskManager.Task::(_updateState) Task=`7271c0c6-6870-44bf-ad18-0dc264f98036`::moving from state preparing -> state finished >Thread-136478::DEBUG::2014-10-29 11:18:52,950::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136478::DEBUG::2014-10-29 11:18:52,950::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136478::DEBUG::2014-10-29 11:18:52,950::task::993::Storage.TaskManager.Task::(_decref) Task=`7271c0c6-6870-44bf-ad18-0dc264f98036`::ref 0 aborting False >Thread-136478::DEBUG::2014-10-29 11:18:52,985::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:53,009::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:53,012::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136479::DEBUG::2014-10-29 11:18:53,015::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136479::DEBUG::2014-10-29 11:18:53,017::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:18:53,281::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54412 >Detector thread::DEBUG::2014-10-29 11:18:53,281::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54412 >Detector thread::DEBUG::2014-10-29 11:18:53,282::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54412 >Detector thread::DEBUG::2014-10-29 11:18:53,282::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54412) >Thread-136480::DEBUG::2014-10-29 11:18:53,322::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136480::DEBUG::2014-10-29 11:18:53,323::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6128531-864a-486b-ad4b-6568987aa4ea`::moving from state init -> state preparing >Thread-136480::INFO::2014-10-29 11:18:53,323::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136480::DEBUG::2014-10-29 11:18:53,343::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:18:53,344::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:53,344::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:53,344::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:53,344::__init__::232::IOProcess::(_processLogs) (201151) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:53,345::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201151) Queuing response >Thread-136480::DEBUG::2014-10-29 11:18:53,346::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136480::DEBUG::2014-10-29 11:18:53,347::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136480::INFO::2014-10-29 11:18:53,347::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136480::DEBUG::2014-10-29 11:18:53,347::task::1191::Storage.TaskManager.Task::(prepare) Task=`a6128531-864a-486b-ad4b-6568987aa4ea`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136480::DEBUG::2014-10-29 11:18:53,347::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6128531-864a-486b-ad4b-6568987aa4ea`::moving from state preparing -> state finished >Thread-136480::DEBUG::2014-10-29 11:18:53,348::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136480::DEBUG::2014-10-29 11:18:53,348::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136480::DEBUG::2014-10-29 11:18:53,348::task::993::Storage.TaskManager.Task::(_decref) Task=`a6128531-864a-486b-ad4b-6568987aa4ea`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:18:53,392::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54413 >Detector thread::DEBUG::2014-10-29 11:18:53,393::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54413 >Detector thread::DEBUG::2014-10-29 11:18:53,393::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54413 >Detector thread::DEBUG::2014-10-29 11:18:53,393::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54413) >Thread-136481::DEBUG::2014-10-29 11:18:53,432::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136481::DEBUG::2014-10-29 11:18:53,432::task::595::Storage.TaskManager.Task::(_updateState) Task=`31c783f9-4874-4daf-ba30-1cc2722732c9`::moving from state init -> state preparing >Thread-136481::INFO::2014-10-29 11:18:53,433::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136481::DEBUG::2014-10-29 11:18:53,433::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136481::DEBUG::2014-10-29 11:18:53,433::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136481::DEBUG::2014-10-29 11:18:53,434::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136481::DEBUG::2014-10-29 11:18:53,434::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136481::DEBUG::2014-10-29 11:18:53,434::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136481::DEBUG::2014-10-29 11:18:53,435::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136481::DEBUG::2014-10-29 11:18:53,522::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136481::DEBUG::2014-10-29 11:18:53,523::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136481::DEBUG::2014-10-29 11:18:53,709::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136481::DEBUG::2014-10-29 11:18:53,710::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136481::DEBUG::2014-10-29 11:18:53,711::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136481::DEBUG::2014-10-29 11:18:53,711::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136481::DEBUG::2014-10-29 11:18:53,711::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136481::DEBUG::2014-10-29 11:18:53,712::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136481::DEBUG::2014-10-29 11:18:53,712::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136481::DEBUG::2014-10-29 11:18:53,712::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:18:53,719::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:53,721::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:53,723::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:53,723::__init__::232::IOProcess::(_processLogs) (201152) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:53,724::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201152) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:53,725::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:53,726::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:53,726::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:53,726::__init__::232::IOProcess::(_processLogs) (201153) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:53,727::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201153) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:53,729::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:53,731::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:53,733::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:53,735::__init__::232::IOProcess::(_processLogs) (201154) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:53,739::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201154) Queuing response >Thread-136481::DEBUG::2014-10-29 11:18:53,740::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:18:53,743::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:53,744::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:53,745::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:53,745::__init__::232::IOProcess::(_processLogs) (201155) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:18:53,745::__init__::232::IOProcess::(_processLogs) (201155) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:53,746::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:53,746::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:53,746::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:53,747::__init__::232::IOProcess::(_processLogs) (201156) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:18:53,747::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201156) Queuing response >Thread-136481::DEBUG::2014-10-29 11:18:53,748::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:18:53,749::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:53,749::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:53,750::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:53,750::__init__::232::IOProcess::(_processLogs) (201157) Got request for method 'readfile' >Thread-136481::DEBUG::2014-10-29 11:18:53,751::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:18:53,751::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201157) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:53,754::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:53,755::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:53,755::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:53,755::__init__::232::IOProcess::(_processLogs) (201158) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:53,755::__init__::232::IOProcess::(_processLogs) (201158) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:53,756::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:53,756::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:53,757::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:53,757::__init__::232::IOProcess::(_processLogs) (201159) Got request for method 'glob' >Thread-136481::DEBUG::2014-10-29 11:18:53,758::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:18:53,758::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201159) Queuing response >Thread-136481::INFO::2014-10-29 11:18:53,759::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136481::INFO::2014-10-29 11:18:53,759::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136481::INFO::2014-10-29 11:18:53,760::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:18:53,760::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:53,761::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:53,761::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:53,761::__init__::232::IOProcess::(_processLogs) (201160) Got request for method 'readfile' >Thread-136481::DEBUG::2014-10-29 11:18:53,762::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:18:53,762::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201160) Queuing response >Thread-136481::DEBUG::2014-10-29 11:18:53,765::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`3f206740-7915-47f3-87ee-a704aa30fbd6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136481::DEBUG::2014-10-29 11:18:53,765::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136481::DEBUG::2014-10-29 11:18:53,766::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136481::DEBUG::2014-10-29 11:18:53,766::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`3f206740-7915-47f3-87ee-a704aa30fbd6`::Granted request >Thread-136481::DEBUG::2014-10-29 11:18:53,767::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`31c783f9-4874-4daf-ba30-1cc2722732c9`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136481::DEBUG::2014-10-29 11:18:53,767::task::993::Storage.TaskManager.Task::(_decref) Task=`31c783f9-4874-4daf-ba30-1cc2722732c9`::ref 1 aborting False >Thread-136481::INFO::2014-10-29 11:18:53,769::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136481::DEBUG::2014-10-29 11:18:53,770::task::1191::Storage.TaskManager.Task::(prepare) Task=`31c783f9-4874-4daf-ba30-1cc2722732c9`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136481::DEBUG::2014-10-29 11:18:53,770::task::595::Storage.TaskManager.Task::(_updateState) Task=`31c783f9-4874-4daf-ba30-1cc2722732c9`::moving from state preparing -> state finished >Thread-136481::DEBUG::2014-10-29 11:18:53,770::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136481::DEBUG::2014-10-29 11:18:53,771::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136481::DEBUG::2014-10-29 11:18:53,771::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136481::DEBUG::2014-10-29 11:18:53,771::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136481::DEBUG::2014-10-29 11:18:53,771::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136481::DEBUG::2014-10-29 11:18:53,772::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136481::DEBUG::2014-10-29 11:18:53,772::task::993::Storage.TaskManager.Task::(_decref) Task=`31c783f9-4874-4daf-ba30-1cc2722732c9`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:18:53,795::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54414 >Detector thread::DEBUG::2014-10-29 11:18:53,795::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54414 >Detector thread::DEBUG::2014-10-29 11:18:53,796::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54414 >Detector thread::DEBUG::2014-10-29 11:18:53,796::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54414) >Thread-136486::DEBUG::2014-10-29 11:18:53,835::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136486::DEBUG::2014-10-29 11:18:53,835::task::595::Storage.TaskManager.Task::(_updateState) Task=`a206ca01-a0f3-4bc2-9795-fe0374a49e9b`::moving from state init -> state preparing >Thread-136486::INFO::2014-10-29 11:18:53,836::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136486::INFO::2014-10-29 11:18:53,836::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482307', 'lastCheck': '9.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052387', 'lastCheck': '8.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000624398', 'lastCheck': '9.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000468841', 'lastCheck': '9.0', 'valid': True}} >Thread-136486::DEBUG::2014-10-29 11:18:53,837::task::1191::Storage.TaskManager.Task::(prepare) Task=`a206ca01-a0f3-4bc2-9795-fe0374a49e9b`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000482307', 'lastCheck': '9.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052387', 'lastCheck': '8.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000624398', 'lastCheck': '9.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000468841', 'lastCheck': '9.0', 'valid': True}} >Thread-136486::DEBUG::2014-10-29 11:18:53,837::task::595::Storage.TaskManager.Task::(_updateState) Task=`a206ca01-a0f3-4bc2-9795-fe0374a49e9b`::moving from state preparing -> state finished >Thread-136486::DEBUG::2014-10-29 11:18:53,837::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136486::DEBUG::2014-10-29 11:18:53,837::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136486::DEBUG::2014-10-29 11:18:53,838::task::993::Storage.TaskManager.Task::(_decref) Task=`a206ca01-a0f3-4bc2-9795-fe0374a49e9b`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:18:54,553::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:54,553::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:54,554::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:54,554::__init__::232::IOProcess::(_processLogs) (201161) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:54,555::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201161) Queuing response >Thread-179::DEBUG::2014-10-29 11:18:54,557::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:18:54,577::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000542262 s, 686 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:18:54,579::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:54,579::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:54,581::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:54,582::__init__::232::IOProcess::(_processLogs) (201162) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:54,582::__init__::232::IOProcess::(_processLogs) (201162) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:54,860::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:54,860::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:54,860::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:54,861::__init__::232::IOProcess::(_processLogs) (201163) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:54,861::__init__::232::IOProcess::(_processLogs) (201163) Queuing response >Thread-10269::DEBUG::2014-10-29 11:18:54,862::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:18:54,881::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000529919 s, 947 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:18:54,882::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:54,884::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:54,885::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:54,885::__init__::232::IOProcess::(_processLogs) (201164) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:54,886::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201164) Queuing response >Thread-178::DEBUG::2014-10-29 11:18:54,888::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:18:54,889::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:54,906::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:54,907::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:54,908::__init__::232::IOProcess::(_processLogs) (201165) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:18:54,910::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000592975 s, 857 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:18:54,915::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201165) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:54,917::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:54,917::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:54,917::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:54,918::__init__::232::IOProcess::(_processLogs) (201166) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:54,919::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201166) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:54,921::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:54,921::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:54,922::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:54,922::__init__::232::IOProcess::(_processLogs) (201167) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:54,923::__init__::232::IOProcess::(_processLogs) (201167) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:54,923::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:54,924::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:54,925::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:54,925::__init__::232::IOProcess::(_processLogs) (201168) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:54,925::__init__::232::IOProcess::(_processLogs) (201168) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:54,926::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:54,926::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:54,927::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:54,929::__init__::232::IOProcess::(_processLogs) (201169) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:54,929::__init__::232::IOProcess::(_processLogs) (201169) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:55,004::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:55,004::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:55,005::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:55,007::__init__::232::IOProcess::(_processLogs) (201170) Got request for method 'statvfs' >Thread-33::DEBUG::2014-10-29 11:18:55,007::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:18:55,008::__init__::232::IOProcess::(_processLogs) (201170) Queuing response >Thread-33::DEBUG::2014-10-29 11:18:55,026::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000531473 s, 916 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:18:55,027::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:55,028::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:55,028::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:55,030::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201171) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:18:55,031::__init__::232::IOProcess::(_processLogs) (201171) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:55,032::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:55,032::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:55,032::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:55,033::__init__::232::IOProcess::(_processLogs) (201172) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:55,034::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201172) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:55,035::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:55,035::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:55,035::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:55,035::__init__::232::IOProcess::(_processLogs) (201173) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:55,036::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201173) Queuing response >Thread-17::DEBUG::2014-10-29 11:18:55,037::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:18:55,037::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:18:55,038::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:18:55,038::__init__::232::IOProcess::(_processLogs) (201174) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:18:55,038::__init__::232::IOProcess::(_processLogs) (201174) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:55,343::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:55,344::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:18:55,345::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:56,083::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:56,086::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136487::DEBUG::2014-10-29 11:18:56,090::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:56,092::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:56,094::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136488::DEBUG::2014-10-29 11:18:56,097::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136488::DEBUG::2014-10-29 11:18:56,100::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:59,127::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:59,129::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136489::DEBUG::2014-10-29 11:18:59,132::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:18:59,139::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:18:59,141::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136490::DEBUG::2014-10-29 11:18:59,144::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136490::DEBUG::2014-10-29 11:18:59,146::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:00,352::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:00,353::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:00,354::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:19:00,383::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54415 >Detector thread::DEBUG::2014-10-29 11:19:00,384::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54415 >Detector thread::DEBUG::2014-10-29 11:19:00,384::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54415 >Detector thread::DEBUG::2014-10-29 11:19:00,385::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54415) >Thread-136491::DEBUG::2014-10-29 11:19:00,424::task::595::Storage.TaskManager.Task::(_updateState) Task=`432ae4f6-0e48-4732-a9a5-a6c98f06628e`::moving from state init -> state preparing >Thread-136491::INFO::2014-10-29 11:19:00,424::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136491::INFO::2014-10-29 11:19:00,425::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000592975', 'lastCheck': '5.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531473', 'lastCheck': '5.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000542262', 'lastCheck': '5.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000529919', 'lastCheck': '5.5', 'valid': True}} >Thread-136491::DEBUG::2014-10-29 11:19:00,425::task::1191::Storage.TaskManager.Task::(prepare) Task=`432ae4f6-0e48-4732-a9a5-a6c98f06628e`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000592975', 'lastCheck': '5.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531473', 'lastCheck': '5.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000542262', 'lastCheck': '5.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000529919', 'lastCheck': '5.5', 'valid': True}} >Thread-136491::DEBUG::2014-10-29 11:19:00,425::task::595::Storage.TaskManager.Task::(_updateState) Task=`432ae4f6-0e48-4732-a9a5-a6c98f06628e`::moving from state preparing -> state finished >Thread-136491::DEBUG::2014-10-29 11:19:00,426::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136491::DEBUG::2014-10-29 11:19:00,426::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136491::DEBUG::2014-10-29 11:19:00,426::task::993::Storage.TaskManager.Task::(_decref) Task=`432ae4f6-0e48-4732-a9a5-a6c98f06628e`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:19:00,631::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54416 >Detector thread::DEBUG::2014-10-29 11:19:00,631::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54416 >Detector thread::DEBUG::2014-10-29 11:19:00,632::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54416 >Detector thread::DEBUG::2014-10-29 11:19:00,632::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54416) >Thread-136492::DEBUG::2014-10-29 11:19:00,671::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136492::DEBUG::2014-10-29 11:19:00,672::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136492::DEBUG::2014-10-29 11:19:00,672::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.47', 'elapsedTime': '514173', 'displayType': 'vnc', 'cpuSys': '1.13', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '4241397', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '69188', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '33745.03'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.55', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:19:01,215::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54418 >Detector thread::DEBUG::2014-10-29 11:19:01,216::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54418 >Detector thread::DEBUG::2014-10-29 11:19:01,217::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54418 >Detector thread::DEBUG::2014-10-29 11:19:01,218::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54418) >Thread-136493::DEBUG::2014-10-29 11:19:01,255::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136493::DEBUG::2014-10-29 11:19:01,257::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136493::DEBUG::2014-10-29 11:19:01,274::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136493::DEBUG::2014-10-29 11:19:01,328::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '9', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '9', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:02,161::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:02,164::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136494::DEBUG::2014-10-29 11:19:02,168::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:02,170::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:02,172::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136495::DEBUG::2014-10-29 11:19:02,176::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136495::DEBUG::2014-10-29 11:19:02,178::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:19:04,039::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >Thread-22::DEBUG::2014-10-29 11:19:04,161::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Detector thread::DEBUG::2014-10-29 11:19:04,436::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54420 >Detector thread::DEBUG::2014-10-29 11:19:04,437::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54420 >Detector thread::DEBUG::2014-10-29 11:19:04,437::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54420 >Detector thread::DEBUG::2014-10-29 11:19:04,437::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54420) >Thread-136496::DEBUG::2014-10-29 11:19:04,477::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136496::DEBUG::2014-10-29 11:19:04,478::task::595::Storage.TaskManager.Task::(_updateState) Task=`09fbff11-1555-41a7-a6aa-9b1e042b52b3`::moving from state init -> state preparing >Thread-136496::INFO::2014-10-29 11:19:04,478::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136496::DEBUG::2014-10-29 11:19:04,481::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:19:04,482::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:04,482::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:04,482::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:04,483::__init__::232::IOProcess::(_processLogs) (201175) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:19:04,484::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201175) Queuing response >Thread-136496::DEBUG::2014-10-29 11:19:04,485::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136496::DEBUG::2014-10-29 11:19:04,485::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136496::INFO::2014-10-29 11:19:04,485::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136496::DEBUG::2014-10-29 11:19:04,486::task::1191::Storage.TaskManager.Task::(prepare) Task=`09fbff11-1555-41a7-a6aa-9b1e042b52b3`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136496::DEBUG::2014-10-29 11:19:04,486::task::595::Storage.TaskManager.Task::(_updateState) Task=`09fbff11-1555-41a7-a6aa-9b1e042b52b3`::moving from state preparing -> state finished >Thread-136496::DEBUG::2014-10-29 11:19:04,486::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136496::DEBUG::2014-10-29 11:19:04,487::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136496::DEBUG::2014-10-29 11:19:04,487::task::993::Storage.TaskManager.Task::(_decref) Task=`09fbff11-1555-41a7-a6aa-9b1e042b52b3`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:19:04,530::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54421 >Detector thread::DEBUG::2014-10-29 11:19:04,531::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54421 >Detector thread::DEBUG::2014-10-29 11:19:04,531::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54421 >Detector thread::DEBUG::2014-10-29 11:19:04,532::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54421) >Thread-136497::DEBUG::2014-10-29 11:19:04,571::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136497::DEBUG::2014-10-29 11:19:04,572::task::595::Storage.TaskManager.Task::(_updateState) Task=`b371a68f-8f85-4fc9-870a-099d8b02c6e9`::moving from state init -> state preparing >Thread-136497::INFO::2014-10-29 11:19:04,572::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136497::DEBUG::2014-10-29 11:19:04,572::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136497::DEBUG::2014-10-29 11:19:04,573::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136497::DEBUG::2014-10-29 11:19:04,573::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136497::DEBUG::2014-10-29 11:19:04,573::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136497::DEBUG::2014-10-29 11:19:04,573::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136497::DEBUG::2014-10-29 11:19:04,574::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-17::DEBUG::2014-10-29 11:19:04,593::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:04,594::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:04,595::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:04,595::__init__::232::IOProcess::(_processLogs) (201176) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:04,597::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201176) Queuing response >Thread-179::DEBUG::2014-10-29 11:19:04,598::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:19:04,626::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00686983 s, 54.1 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:19:04,628::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:04,628::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:04,629::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:04,629::__init__::232::IOProcess::(_processLogs) (201177) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:04,630::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201177) Queuing response >Thread-136497::DEBUG::2014-10-29 11:19:04,657::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136497::DEBUG::2014-10-29 11:19:04,658::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136497::DEBUG::2014-10-29 11:19:04,836::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136497::DEBUG::2014-10-29 11:19:04,837::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136497::DEBUG::2014-10-29 11:19:04,837::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136497::DEBUG::2014-10-29 11:19:04,838::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136497::DEBUG::2014-10-29 11:19:04,838::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136497::DEBUG::2014-10-29 11:19:04,838::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136497::DEBUG::2014-10-29 11:19:04,839::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136497::DEBUG::2014-10-29 11:19:04,839::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:19:04,845::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:04,848::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:04,849::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:04,849::__init__::232::IOProcess::(_processLogs) (201178) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:19:04,850::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201178) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:04,852::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:04,852::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:04,852::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:04,852::__init__::232::IOProcess::(_processLogs) (201179) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:19:04,854::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201179) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:04,855::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:04,857::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:04,860::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:04,861::__init__::232::IOProcess::(_processLogs) (201180) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:19:04,866::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201180) Queuing response >Thread-136497::DEBUG::2014-10-29 11:19:04,866::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:19:04,869::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:04,870::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:04,870::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:04,870::__init__::232::IOProcess::(_processLogs) (201181) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:19:04,871::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:04,871::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:04,871::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:04,871::__init__::232::IOProcess::(_processLogs) (201182) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:19:04,872::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201181) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:04,873::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201182) Queuing response >Thread-136497::DEBUG::2014-10-29 11:19:04,874::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:19:04,875::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:04,875::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:04,875::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:04,876::__init__::232::IOProcess::(_processLogs) (201183) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:19:04,877::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201183) Queuing response >Thread-136497::DEBUG::2014-10-29 11:19:04,877::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:19:04,878::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:04,879::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:04,880::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:04,880::__init__::232::IOProcess::(_processLogs) (201184) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:04,881::__init__::232::IOProcess::(_processLogs) (201184) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:04,881::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:04,881::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:04,882::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:04,882::__init__::232::IOProcess::(_processLogs) (201185) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:19:04,883::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201185) Queuing response >Thread-136497::DEBUG::2014-10-29 11:19:04,883::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-136497::INFO::2014-10-29 11:19:04,884::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136497::INFO::2014-10-29 11:19:04,884::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136497::INFO::2014-10-29 11:19:04,885::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:19:04,886::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:04,886::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:04,886::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:04,886::__init__::232::IOProcess::(_processLogs) (201186) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:19:04,887::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201186) Queuing response >Thread-136497::DEBUG::2014-10-29 11:19:04,888::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136497::DEBUG::2014-10-29 11:19:04,889::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`9f230905-36d7-439b-bb43-7be903a76abe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136497::DEBUG::2014-10-29 11:19:04,890::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136497::DEBUG::2014-10-29 11:19:04,890::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136497::DEBUG::2014-10-29 11:19:04,890::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`9f230905-36d7-439b-bb43-7be903a76abe`::Granted request >Thread-136497::DEBUG::2014-10-29 11:19:04,891::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b371a68f-8f85-4fc9-870a-099d8b02c6e9`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136497::DEBUG::2014-10-29 11:19:04,891::task::993::Storage.TaskManager.Task::(_decref) Task=`b371a68f-8f85-4fc9-870a-099d8b02c6e9`::ref 1 aborting False >Thread-136497::INFO::2014-10-29 11:19:04,894::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136497::DEBUG::2014-10-29 11:19:04,894::task::1191::Storage.TaskManager.Task::(prepare) Task=`b371a68f-8f85-4fc9-870a-099d8b02c6e9`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136497::DEBUG::2014-10-29 11:19:04,895::task::595::Storage.TaskManager.Task::(_updateState) Task=`b371a68f-8f85-4fc9-870a-099d8b02c6e9`::moving from state preparing -> state finished >Thread-136497::DEBUG::2014-10-29 11:19:04,895::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136497::DEBUG::2014-10-29 11:19:04,895::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136497::DEBUG::2014-10-29 11:19:04,896::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136497::DEBUG::2014-10-29 11:19:04,896::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136497::DEBUG::2014-10-29 11:19:04,896::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136497::DEBUG::2014-10-29 11:19:04,896::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136497::DEBUG::2014-10-29 11:19:04,897::task::993::Storage.TaskManager.Task::(_decref) Task=`b371a68f-8f85-4fc9-870a-099d8b02c6e9`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:19:04,917::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:04,919::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:04,921::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-10269::DEBUG::2014-10-29 11:19:04,922::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:19:04,922::__init__::232::IOProcess::(_processLogs) (201187) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:04,942::__init__::232::IOProcess::(_processLogs) (201187) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:04,944::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:04,944::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:04,944::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:04,945::__init__::232::IOProcess::(_processLogs) (201188) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:04,945::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201188) Queuing response >Detector thread::DEBUG::2014-10-29 11:19:04,946::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54422 >Detector thread::DEBUG::2014-10-29 11:19:04,949::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54422 >Detector thread::DEBUG::2014-10-29 11:19:04,952::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54422 >Thread-10269::DEBUG::2014-10-29 11:19:04,953::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00113255 s, 443 kB/s\n'; <rc> = 0 >Thread-178::DEBUG::2014-10-29 11:19:04,956::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Detector thread::DEBUG::2014-10-29 11:19:04,957::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54422) >Thread-17::DEBUG::2014-10-29 11:19:04,981::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-178::DEBUG::2014-10-29 11:19:04,983::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000702927 s, 723 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:19:04,984::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:04,986::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-136502::DEBUG::2014-10-29 11:19:04,987::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-17::DEBUG::2014-10-29 11:19:04,988::__init__::232::IOProcess::(_processLogs) (201189) Got request for method 'statvfs' >Thread-136502::DEBUG::2014-10-29 11:19:04,991::task::595::Storage.TaskManager.Task::(_updateState) Task=`7270771f-4c9c-4f4d-8178-f9a25e5ea8b1`::moving from state init -> state preparing >Thread-136502::INFO::2014-10-29 11:19:04,993::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-17::DEBUG::2014-10-29 11:19:04,996::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201189) Queuing response >Thread-136502::INFO::2014-10-29 11:19:05,000::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000592975', 'lastCheck': '10.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531473', 'lastCheck': '10.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00686983', 'lastCheck': '0.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00113255', 'lastCheck': '-0.0', 'valid': True}} >Thread-17::DEBUG::2014-10-29 11:19:05,001::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-136502::DEBUG::2014-10-29 11:19:05,002::task::1191::Storage.TaskManager.Task::(prepare) Task=`7270771f-4c9c-4f4d-8178-f9a25e5ea8b1`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000592975', 'lastCheck': '10.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531473', 'lastCheck': '10.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00686983', 'lastCheck': '0.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00113255', 'lastCheck': '-0.0', 'valid': True}} >Thread-17::DEBUG::2014-10-29 11:19:05,003::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-136502::DEBUG::2014-10-29 11:19:05,004::task::595::Storage.TaskManager.Task::(_updateState) Task=`7270771f-4c9c-4f4d-8178-f9a25e5ea8b1`::moving from state preparing -> state finished >Thread-17::DEBUG::2014-10-29 11:19:05,004::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-136502::DEBUG::2014-10-29 11:19:05,005::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17::DEBUG::2014-10-29 11:19:05,006::__init__::232::IOProcess::(_processLogs) (201190) Got request for method 'statvfs' >Thread-136502::DEBUG::2014-10-29 11:19:05,006::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136502::DEBUG::2014-10-29 11:19:05,008::task::993::Storage.TaskManager.Task::(_decref) Task=`7270771f-4c9c-4f4d-8178-f9a25e5ea8b1`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:19:05,014::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201190) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:05,018::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:05,019::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:05,021::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:05,021::__init__::232::IOProcess::(_processLogs) (201191) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:05,021::__init__::232::IOProcess::(_processLogs) (201191) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:05,023::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:05,023::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:05,024::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:05,025::__init__::232::IOProcess::(_processLogs) (201192) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:05,025::__init__::232::IOProcess::(_processLogs) (201192) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:05,025::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:05,026::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:05,026::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:05,027::__init__::232::IOProcess::(_processLogs) (201193) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:05,027::__init__::232::IOProcess::(_processLogs) (201193) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:05,041::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:05,042::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:05,042::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:05,042::__init__::232::IOProcess::(_processLogs) (201194) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:05,043::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201194) Queuing response >Thread-33::DEBUG::2014-10-29 11:19:05,045::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:19:05,063::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00137563 s, 354 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:19:05,065::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:05,066::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:05,066::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:05,066::__init__::232::IOProcess::(_processLogs) (201195) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:05,066::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201195) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:05,069::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:05,069::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:05,070::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:05,070::__init__::232::IOProcess::(_processLogs) (201196) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:05,071::__init__::232::IOProcess::(_processLogs) (201196) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:05,071::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:05,072::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:05,073::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:05,073::__init__::232::IOProcess::(_processLogs) (201197) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:05,073::__init__::232::IOProcess::(_processLogs) (201197) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:05,074::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:05,074::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:05,075::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:05,076::__init__::232::IOProcess::(_processLogs) (201198) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:05,077::__init__::232::IOProcess::(_processLogs) (201198) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:05,193::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:05,195::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136503::DEBUG::2014-10-29 11:19:05,200::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:05,202::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:05,204::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136504::DEBUG::2014-10-29 11:19:05,208::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136504::DEBUG::2014-10-29 11:19:05,210::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:05,362::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:05,363::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:05,364::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:08,224::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:08,227::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136505::DEBUG::2014-10-29 11:19:08,231::task::595::Storage.TaskManager.Task::(_updateState) Task=`d29abba7-8837-4021-b4c4-3c14e4119187`::moving from state init -> state preparing >Thread-136505::INFO::2014-10-29 11:19:08,232::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136505::INFO::2014-10-29 11:19:08,232::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702927', 'lastCheck': '3.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00137563', 'lastCheck': '3.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00686983', 'lastCheck': '3.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00113255', 'lastCheck': '3.2', 'valid': True}} >Thread-136505::DEBUG::2014-10-29 11:19:08,233::task::1191::Storage.TaskManager.Task::(prepare) Task=`d29abba7-8837-4021-b4c4-3c14e4119187`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702927', 'lastCheck': '3.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00137563', 'lastCheck': '3.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00686983', 'lastCheck': '3.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00113255', 'lastCheck': '3.2', 'valid': True}} >Thread-136505::DEBUG::2014-10-29 11:19:08,233::task::595::Storage.TaskManager.Task::(_updateState) Task=`d29abba7-8837-4021-b4c4-3c14e4119187`::moving from state preparing -> state finished >Thread-136505::DEBUG::2014-10-29 11:19:08,233::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136505::DEBUG::2014-10-29 11:19:08,233::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136505::DEBUG::2014-10-29 11:19:08,234::task::993::Storage.TaskManager.Task::(_decref) Task=`d29abba7-8837-4021-b4c4-3c14e4119187`::ref 0 aborting False >Thread-136505::DEBUG::2014-10-29 11:19:08,269::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:08,293::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:08,295::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136506::DEBUG::2014-10-29 11:19:08,299::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136506::DEBUG::2014-10-29 11:19:08,301::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:10,371::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:10,372::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:10,373::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:19:10,401::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54423 >Detector thread::DEBUG::2014-10-29 11:19:10,402::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54423 >Detector thread::DEBUG::2014-10-29 11:19:10,402::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54423 >Detector thread::DEBUG::2014-10-29 11:19:10,403::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54423) >Thread-136507::DEBUG::2014-10-29 11:19:10,441::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136507::DEBUG::2014-10-29 11:19:10,443::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136507::DEBUG::2014-10-29 11:19:10,464::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Detector thread::DEBUG::2014-10-29 11:19:10,486::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54424 >Detector thread::DEBUG::2014-10-29 11:19:10,488::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54424 >Detector thread::DEBUG::2014-10-29 11:19:10,490::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54424 >Detector thread::DEBUG::2014-10-29 11:19:10,492::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54424) >Thread-136507::DEBUG::2014-10-29 11:19:10,523::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '88', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '88', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-136508::DEBUG::2014-10-29 11:19:10,534::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1dbefc2-d63e-443b-914d-ec2907994f78`::moving from state init -> state preparing >Thread-136508::INFO::2014-10-29 11:19:10,536::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136508::INFO::2014-10-29 11:19:10,540::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702927', 'lastCheck': '5.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00137563', 'lastCheck': '5.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00686983', 'lastCheck': '5.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00113255', 'lastCheck': '5.5', 'valid': True}} >Thread-136508::DEBUG::2014-10-29 11:19:10,542::task::1191::Storage.TaskManager.Task::(prepare) Task=`e1dbefc2-d63e-443b-914d-ec2907994f78`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702927', 'lastCheck': '5.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00137563', 'lastCheck': '5.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00686983', 'lastCheck': '5.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00113255', 'lastCheck': '5.5', 'valid': True}} >Thread-136508::DEBUG::2014-10-29 11:19:10,543::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1dbefc2-d63e-443b-914d-ec2907994f78`::moving from state preparing -> state finished >Thread-136508::DEBUG::2014-10-29 11:19:10,545::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136508::DEBUG::2014-10-29 11:19:10,547::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136508::DEBUG::2014-10-29 11:19:10,550::task::993::Storage.TaskManager.Task::(_decref) Task=`e1dbefc2-d63e-443b-914d-ec2907994f78`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:19:10,829::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54425 >Detector thread::DEBUG::2014-10-29 11:19:10,830::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54425 >Detector thread::DEBUG::2014-10-29 11:19:10,830::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54425 >Detector thread::DEBUG::2014-10-29 11:19:10,831::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54425) >Thread-136509::DEBUG::2014-10-29 11:19:10,870::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136509::DEBUG::2014-10-29 11:19:10,871::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136509::DEBUG::2014-10-29 11:19:10,872::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.12', 'elapsedTime': '514183', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '4241397', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '69188', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '33745.03'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.71', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:11,347::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:11,350::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136510::DEBUG::2014-10-29 11:19:11,354::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:11,356::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:11,359::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136511::DEBUG::2014-10-29 11:19:11,362::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136511::DEBUG::2014-10-29 11:19:11,364::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:14,382::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:14,384::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136512::DEBUG::2014-10-29 11:19:14,387::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:14,390::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:14,391::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136513::DEBUG::2014-10-29 11:19:14,394::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136513::DEBUG::2014-10-29 11:19:14,397::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:19:14,634::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:14,634::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:14,634::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:14,635::__init__::232::IOProcess::(_processLogs) (201199) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:14,635::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201199) Queuing response >Thread-179::DEBUG::2014-10-29 11:19:14,637::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:19:14,657::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000530713 s, 701 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:19:14,659::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:14,659::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:14,660::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:14,662::__init__::232::IOProcess::(_processLogs) (201200) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:14,662::__init__::232::IOProcess::(_processLogs) (201200) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:15,000::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:15,004::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:15,006::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-10269::DEBUG::2014-10-29 11:19:15,006::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:19:15,007::__init__::232::IOProcess::(_processLogs) (201201) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:15,026::__init__::232::IOProcess::(_processLogs) (201201) Queuing response >Thread-10269::DEBUG::2014-10-29 11:19:15,028::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00053392 s, 940 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:19:15,031::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:15,032::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:15,034::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:15,036::__init__::232::IOProcess::(_processLogs) (201202) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:15,036::__init__::232::IOProcess::(_processLogs) (201202) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:15,036::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:15,037::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:15,037::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:15,037::__init__::232::IOProcess::(_processLogs) (201203) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:15,037::__init__::232::IOProcess::(_processLogs) (201203) Queuing response >Thread-178::DEBUG::2014-10-29 11:19:15,039::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:19:15,058::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000790041 s, 643 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:19:15,060::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:15,060::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:15,061::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:15,061::__init__::232::IOProcess::(_processLogs) (201204) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:15,063::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201204) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:15,065::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:15,065::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:15,066::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:15,066::__init__::232::IOProcess::(_processLogs) (201205) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:15,067::__init__::232::IOProcess::(_processLogs) (201205) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:15,067::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:15,068::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:15,068::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:15,069::__init__::232::IOProcess::(_processLogs) (201206) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:15,069::__init__::232::IOProcess::(_processLogs) (201206) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:15,070::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:15,070::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:15,071::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:15,072::__init__::232::IOProcess::(_processLogs) (201207) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:15,073::__init__::232::IOProcess::(_processLogs) (201207) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:15,077::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:15,079::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-33::DEBUG::2014-10-29 11:19:15,080::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:19:15,098::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:15,100::__init__::232::IOProcess::(_processLogs) (201208) Got request for method 'statvfs' >Thread-33::DEBUG::2014-10-29 11:19:15,101::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000542221 s, 898 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:19:15,102::__init__::232::IOProcess::(_processLogs) (201208) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:15,105::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:15,105::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:15,106::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:15,106::__init__::232::IOProcess::(_processLogs) (201209) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:15,108::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201209) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:15,110::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:15,110::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:15,111::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:15,112::__init__::232::IOProcess::(_processLogs) (201210) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:15,112::__init__::232::IOProcess::(_processLogs) (201210) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:15,113::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:15,114::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:15,115::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:15,115::__init__::232::IOProcess::(_processLogs) (201211) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:15,115::__init__::232::IOProcess::(_processLogs) (201211) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:15,116::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:15,116::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:15,116::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:15,117::__init__::232::IOProcess::(_processLogs) (201212) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:15,117::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201212) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:15,380::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:15,382::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:15,383::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:19:15,593::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54428 >Detector thread::DEBUG::2014-10-29 11:19:15,594::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54428 >Detector thread::DEBUG::2014-10-29 11:19:15,594::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54428 >Detector thread::DEBUG::2014-10-29 11:19:15,595::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54428) >Thread-136514::DEBUG::2014-10-29 11:19:15,634::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136514::DEBUG::2014-10-29 11:19:15,635::task::595::Storage.TaskManager.Task::(_updateState) Task=`97f6335c-386f-4e5f-99b1-ee68a865c584`::moving from state init -> state preparing >Thread-136514::INFO::2014-10-29 11:19:15,635::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136514::DEBUG::2014-10-29 11:19:15,653::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:19:15,654::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:15,654::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:15,655::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:15,655::__init__::232::IOProcess::(_processLogs) (201213) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:19:15,656::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201213) Queuing response >Thread-136514::DEBUG::2014-10-29 11:19:15,656::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136514::DEBUG::2014-10-29 11:19:15,657::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136514::INFO::2014-10-29 11:19:15,658::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136514::DEBUG::2014-10-29 11:19:15,658::task::1191::Storage.TaskManager.Task::(prepare) Task=`97f6335c-386f-4e5f-99b1-ee68a865c584`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136514::DEBUG::2014-10-29 11:19:15,658::task::595::Storage.TaskManager.Task::(_updateState) Task=`97f6335c-386f-4e5f-99b1-ee68a865c584`::moving from state preparing -> state finished >Thread-136514::DEBUG::2014-10-29 11:19:15,659::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136514::DEBUG::2014-10-29 11:19:15,659::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136514::DEBUG::2014-10-29 11:19:15,659::task::993::Storage.TaskManager.Task::(_decref) Task=`97f6335c-386f-4e5f-99b1-ee68a865c584`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:19:15,704::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54429 >Detector thread::DEBUG::2014-10-29 11:19:15,704::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54429 >Detector thread::DEBUG::2014-10-29 11:19:15,705::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54429 >Detector thread::DEBUG::2014-10-29 11:19:15,705::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54429) >Thread-136515::DEBUG::2014-10-29 11:19:15,744::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136515::DEBUG::2014-10-29 11:19:15,745::task::595::Storage.TaskManager.Task::(_updateState) Task=`28b3b4fc-3bd7-462a-aa0f-0fd63173dde1`::moving from state init -> state preparing >Thread-136515::INFO::2014-10-29 11:19:15,745::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136515::DEBUG::2014-10-29 11:19:15,745::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136515::DEBUG::2014-10-29 11:19:15,746::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136515::DEBUG::2014-10-29 11:19:15,746::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136515::DEBUG::2014-10-29 11:19:15,746::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136515::DEBUG::2014-10-29 11:19:15,746::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136515::DEBUG::2014-10-29 11:19:15,747::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136515::DEBUG::2014-10-29 11:19:15,833::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136515::DEBUG::2014-10-29 11:19:15,834::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136515::DEBUG::2014-10-29 11:19:16,012::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136515::DEBUG::2014-10-29 11:19:16,013::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136515::DEBUG::2014-10-29 11:19:16,013::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136515::DEBUG::2014-10-29 11:19:16,014::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136515::DEBUG::2014-10-29 11:19:16,014::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136515::DEBUG::2014-10-29 11:19:16,015::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136515::DEBUG::2014-10-29 11:19:16,015::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136515::DEBUG::2014-10-29 11:19:16,015::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:19:16,023::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:16,025::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:16,026::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:16,026::__init__::232::IOProcess::(_processLogs) (201214) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:19:16,027::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201214) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:16,028::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:16,029::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:16,029::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:16,029::__init__::232::IOProcess::(_processLogs) (201215) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:19:16,030::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201215) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:16,034::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:16,036::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:16,038::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:16,040::__init__::232::IOProcess::(_processLogs) (201216) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:19:16,042::__init__::232::IOProcess::(_processLogs) (201216) Queuing response >Thread-136515::DEBUG::2014-10-29 11:19:16,045::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:19:16,045::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:16,048::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:16,052::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:16,054::__init__::232::IOProcess::(_processLogs) (201217) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:19:16,055::__init__::232::IOProcess::(_processLogs) (201217) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:16,058::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:16,060::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:16,062::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:16,063::__init__::232::IOProcess::(_processLogs) (201218) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:19:16,067::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201218) Queuing response >Thread-136515::DEBUG::2014-10-29 11:19:16,067::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:19:16,072::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:16,073::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:16,075::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:16,076::__init__::232::IOProcess::(_processLogs) (201219) Got request for method 'readfile' >Thread-136515::DEBUG::2014-10-29 11:19:16,079::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:19:16,079::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201219) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:16,084::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:16,086::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:16,087::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:16,088::__init__::232::IOProcess::(_processLogs) (201220) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:16,089::__init__::232::IOProcess::(_processLogs) (201220) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:16,099::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:16,101::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:16,102::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:16,104::__init__::232::IOProcess::(_processLogs) (201221) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:19:16,107::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201221) Queuing response >Thread-136515::DEBUG::2014-10-29 11:19:16,107::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-136515::INFO::2014-10-29 11:19:16,109::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136515::INFO::2014-10-29 11:19:16,110::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136515::INFO::2014-10-29 11:19:16,112::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:19:16,115::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:16,117::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:16,118::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:16,120::__init__::232::IOProcess::(_processLogs) (201222) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:19:16,123::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201222) Queuing response >Thread-136515::DEBUG::2014-10-29 11:19:16,124::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136515::DEBUG::2014-10-29 11:19:16,132::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`8123da65-e371-4198-83df-e3f7f13161d1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136515::DEBUG::2014-10-29 11:19:16,133::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136515::DEBUG::2014-10-29 11:19:16,135::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136515::DEBUG::2014-10-29 11:19:16,137::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`8123da65-e371-4198-83df-e3f7f13161d1`::Granted request >Thread-136515::DEBUG::2014-10-29 11:19:16,140::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`28b3b4fc-3bd7-462a-aa0f-0fd63173dde1`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136515::DEBUG::2014-10-29 11:19:16,141::task::993::Storage.TaskManager.Task::(_decref) Task=`28b3b4fc-3bd7-462a-aa0f-0fd63173dde1`::ref 1 aborting False >Thread-136515::INFO::2014-10-29 11:19:16,154::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136515::DEBUG::2014-10-29 11:19:16,156::task::1191::Storage.TaskManager.Task::(prepare) Task=`28b3b4fc-3bd7-462a-aa0f-0fd63173dde1`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136515::DEBUG::2014-10-29 11:19:16,157::task::595::Storage.TaskManager.Task::(_updateState) Task=`28b3b4fc-3bd7-462a-aa0f-0fd63173dde1`::moving from state preparing -> state finished >Thread-136515::DEBUG::2014-10-29 11:19:16,158::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136515::DEBUG::2014-10-29 11:19:16,160::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136515::DEBUG::2014-10-29 11:19:16,162::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136515::DEBUG::2014-10-29 11:19:16,164::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136515::DEBUG::2014-10-29 11:19:16,165::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136515::DEBUG::2014-10-29 11:19:16,166::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136515::DEBUG::2014-10-29 11:19:16,168::task::993::Storage.TaskManager.Task::(_decref) Task=`28b3b4fc-3bd7-462a-aa0f-0fd63173dde1`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:19:16,233::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54430 >Detector thread::DEBUG::2014-10-29 11:19:16,234::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54430 >Detector thread::DEBUG::2014-10-29 11:19:16,234::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54430 >Detector thread::DEBUG::2014-10-29 11:19:16,235::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54430) >Thread-136520::DEBUG::2014-10-29 11:19:16,274::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136520::DEBUG::2014-10-29 11:19:16,278::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f56f864-45d2-49f9-b5f2-ced3d313a941`::moving from state init -> state preparing >Thread-136520::INFO::2014-10-29 11:19:16,280::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136520::INFO::2014-10-29 11:19:16,285::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000790041', 'lastCheck': '1.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000542221', 'lastCheck': '1.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000530713', 'lastCheck': '1.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00053392', 'lastCheck': '1.2', 'valid': True}} >Thread-136520::DEBUG::2014-10-29 11:19:16,287::task::1191::Storage.TaskManager.Task::(prepare) Task=`6f56f864-45d2-49f9-b5f2-ced3d313a941`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000790041', 'lastCheck': '1.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000542221', 'lastCheck': '1.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000530713', 'lastCheck': '1.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00053392', 'lastCheck': '1.2', 'valid': True}} >Thread-136520::DEBUG::2014-10-29 11:19:16,288::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f56f864-45d2-49f9-b5f2-ced3d313a941`::moving from state preparing -> state finished >Thread-136520::DEBUG::2014-10-29 11:19:16,289::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136520::DEBUG::2014-10-29 11:19:16,290::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136520::DEBUG::2014-10-29 11:19:16,291::task::993::Storage.TaskManager.Task::(_decref) Task=`6f56f864-45d2-49f9-b5f2-ced3d313a941`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:17,412::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:17,415::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136521::DEBUG::2014-10-29 11:19:17,419::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:17,421::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:17,423::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136522::DEBUG::2014-10-29 11:19:17,426::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136522::DEBUG::2014-10-29 11:19:17,428::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:19:19,185::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:20,387::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:20,389::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:20,390::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:20,442::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:20,444::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136523::DEBUG::2014-10-29 11:19:20,447::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:20,449::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:20,451::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136524::DEBUG::2014-10-29 11:19:20,454::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136524::DEBUG::2014-10-29 11:19:20,456::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:19:20,598::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54431 >Detector thread::DEBUG::2014-10-29 11:19:20,598::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54431 >Detector thread::DEBUG::2014-10-29 11:19:20,599::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54431 >Detector thread::DEBUG::2014-10-29 11:19:20,599::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54431) >Detector thread::DEBUG::2014-10-29 11:19:20,626::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54432 >Detector thread::DEBUG::2014-10-29 11:19:20,627::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54432 >Detector thread::DEBUG::2014-10-29 11:19:20,627::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54432 >Detector thread::DEBUG::2014-10-29 11:19:20,628::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54432) >Thread-136525::DEBUG::2014-10-29 11:19:20,638::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136525::DEBUG::2014-10-29 11:19:20,639::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136525::DEBUG::2014-10-29 11:19:20,657::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136526::DEBUG::2014-10-29 11:19:20,673::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7694db7-4762-474e-9d79-8b08681c817e`::moving from state init -> state preparing >Thread-136526::INFO::2014-10-29 11:19:20,675::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136526::INFO::2014-10-29 11:19:20,679::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000790041', 'lastCheck': '5.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000542221', 'lastCheck': '5.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000530713', 'lastCheck': '6.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00053392', 'lastCheck': '5.6', 'valid': True}} >Thread-136526::DEBUG::2014-10-29 11:19:20,681::task::1191::Storage.TaskManager.Task::(prepare) Task=`a7694db7-4762-474e-9d79-8b08681c817e`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000790041', 'lastCheck': '5.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000542221', 'lastCheck': '5.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000530713', 'lastCheck': '6.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00053392', 'lastCheck': '5.6', 'valid': True}} >Thread-136526::DEBUG::2014-10-29 11:19:20,682::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7694db7-4762-474e-9d79-8b08681c817e`::moving from state preparing -> state finished >Thread-136526::DEBUG::2014-10-29 11:19:20,682::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136526::DEBUG::2014-10-29 11:19:20,683::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136526::DEBUG::2014-10-29 11:19:20,685::task::993::Storage.TaskManager.Task::(_decref) Task=`a7694db7-4762-474e-9d79-8b08681c817e`::ref 0 aborting False >Thread-136525::DEBUG::2014-10-29 11:19:20,735::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '68', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '68', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:19:21,021::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54433 >Detector thread::DEBUG::2014-10-29 11:19:21,022::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54433 >Detector thread::DEBUG::2014-10-29 11:19:21,022::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54433 >Detector thread::DEBUG::2014-10-29 11:19:21,023::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54433) >Thread-136527::DEBUG::2014-10-29 11:19:21,062::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136527::DEBUG::2014-10-29 11:19:21,063::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136527::DEBUG::2014-10-29 11:19:21,064::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.33', 'elapsedTime': '514193', 'displayType': 'vnc', 'cpuSys': '0.80', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '4241397', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '69188', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '33745.03'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.90', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:23,470::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:23,473::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136528::DEBUG::2014-10-29 11:19:23,477::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f7dcd85-3feb-4624-8e36-2c1e814e4da6`::moving from state init -> state preparing >Thread-136528::INFO::2014-10-29 11:19:23,477::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136528::INFO::2014-10-29 11:19:23,478::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000790041', 'lastCheck': '8.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000542221', 'lastCheck': '8.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000530713', 'lastCheck': '8.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00053392', 'lastCheck': '8.4', 'valid': True}} >Thread-136528::DEBUG::2014-10-29 11:19:23,478::task::1191::Storage.TaskManager.Task::(prepare) Task=`7f7dcd85-3feb-4624-8e36-2c1e814e4da6`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000790041', 'lastCheck': '8.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000542221', 'lastCheck': '8.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000530713', 'lastCheck': '8.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00053392', 'lastCheck': '8.4', 'valid': True}} >Thread-136528::DEBUG::2014-10-29 11:19:23,478::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f7dcd85-3feb-4624-8e36-2c1e814e4da6`::moving from state preparing -> state finished >Thread-136528::DEBUG::2014-10-29 11:19:23,479::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136528::DEBUG::2014-10-29 11:19:23,479::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136528::DEBUG::2014-10-29 11:19:23,479::task::993::Storage.TaskManager.Task::(_decref) Task=`7f7dcd85-3feb-4624-8e36-2c1e814e4da6`::ref 0 aborting False >Thread-136528::DEBUG::2014-10-29 11:19:23,500::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:23,525::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:23,527::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136529::DEBUG::2014-10-29 11:19:23,530::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136529::DEBUG::2014-10-29 11:19:23,533::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:19:24,664::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:24,665::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:24,665::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:24,666::__init__::232::IOProcess::(_processLogs) (201223) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:24,666::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201223) Queuing response >Thread-179::DEBUG::2014-10-29 11:19:24,668::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:19:24,686::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000558414 s, 666 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:19:24,688::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:24,688::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:24,688::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:24,688::__init__::232::IOProcess::(_processLogs) (201224) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:24,690::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201224) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:25,037::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:25,038::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:25,039::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-10269::DEBUG::2014-10-29 11:19:25,041::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:19:25,041::__init__::232::IOProcess::(_processLogs) (201225) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:25,057::__init__::232::IOProcess::(_processLogs) (201225) Queuing response >Thread-10269::DEBUG::2014-10-29 11:19:25,060::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000551861 s, 910 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:19:25,062::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:25,062::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:25,062::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:25,063::__init__::232::IOProcess::(_processLogs) (201226) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:25,063::__init__::232::IOProcess::(_processLogs) (201226) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:25,074::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:25,074::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:25,076::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:25,077::__init__::232::IOProcess::(_processLogs) (201227) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:19:25,077::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:19:25,078::__init__::232::IOProcess::(_processLogs) (201227) Queuing response >Thread-178::DEBUG::2014-10-29 11:19:25,096::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000525491 s, 967 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:19:25,097::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:25,098::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:25,098::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:25,098::__init__::232::IOProcess::(_processLogs) (201228) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:25,100::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201228) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:25,101::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:25,102::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:25,102::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:25,103::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201229) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:25,103::__init__::232::IOProcess::(_processLogs) (201229) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:25,104::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:25,104::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:25,104::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:25,105::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201230) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:25,106::__init__::232::IOProcess::(_processLogs) (201230) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:25,106::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:25,106::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:25,107::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:25,108::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201231) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:25,108::__init__::232::IOProcess::(_processLogs) (201231) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:25,120::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:25,120::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:25,120::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:25,121::__init__::232::IOProcess::(_processLogs) (201232) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:25,121::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201232) Queuing response >Thread-33::DEBUG::2014-10-29 11:19:25,122::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:19:25,139::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000529821 s, 919 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:19:25,141::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:25,141::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:25,141::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:25,142::__init__::232::IOProcess::(_processLogs) (201233) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:25,142::__init__::232::IOProcess::(_processLogs) (201233) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:25,144::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:25,144::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:25,145::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:25,145::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201234) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:25,146::__init__::232::IOProcess::(_processLogs) (201234) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:25,147::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:25,147::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:25,147::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:25,148::__init__::232::IOProcess::(_processLogs) (201235) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:25,148::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201235) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:25,149::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:25,150::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:25,150::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:25,150::__init__::232::IOProcess::(_processLogs) (201236) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:25,151::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201236) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:25,397::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:25,398::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:25,401::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:26,638::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:26,640::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136530::DEBUG::2014-10-29 11:19:26,646::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:26,653::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:26,655::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136531::DEBUG::2014-10-29 11:19:26,658::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136531::DEBUG::2014-10-29 11:19:26,661::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:19:26,887::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54436 >Detector thread::DEBUG::2014-10-29 11:19:26,888::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54436 >Detector thread::DEBUG::2014-10-29 11:19:26,888::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54436 >Detector thread::DEBUG::2014-10-29 11:19:26,889::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54436) >Thread-136532::DEBUG::2014-10-29 11:19:26,928::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136532::DEBUG::2014-10-29 11:19:26,929::task::595::Storage.TaskManager.Task::(_updateState) Task=`b28b90b7-8595-476c-85fa-61362dd84e56`::moving from state init -> state preparing >Thread-136532::INFO::2014-10-29 11:19:26,929::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136532::DEBUG::2014-10-29 11:19:26,932::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:19:26,933::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:26,933::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:26,933::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:26,934::__init__::232::IOProcess::(_processLogs) (201237) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:19:26,935::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201237) Queuing response >Thread-136532::DEBUG::2014-10-29 11:19:26,935::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136532::DEBUG::2014-10-29 11:19:26,936::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136532::INFO::2014-10-29 11:19:26,936::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136532::DEBUG::2014-10-29 11:19:26,937::task::1191::Storage.TaskManager.Task::(prepare) Task=`b28b90b7-8595-476c-85fa-61362dd84e56`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136532::DEBUG::2014-10-29 11:19:26,937::task::595::Storage.TaskManager.Task::(_updateState) Task=`b28b90b7-8595-476c-85fa-61362dd84e56`::moving from state preparing -> state finished >Thread-136532::DEBUG::2014-10-29 11:19:26,937::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136532::DEBUG::2014-10-29 11:19:26,938::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136532::DEBUG::2014-10-29 11:19:26,938::task::993::Storage.TaskManager.Task::(_decref) Task=`b28b90b7-8595-476c-85fa-61362dd84e56`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:19:26,981::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54437 >Detector thread::DEBUG::2014-10-29 11:19:26,982::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54437 >Detector thread::DEBUG::2014-10-29 11:19:26,982::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54437 >Detector thread::DEBUG::2014-10-29 11:19:26,982::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54437) >Thread-136533::DEBUG::2014-10-29 11:19:27,021::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136533::DEBUG::2014-10-29 11:19:27,021::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a19348e-9a2c-4e15-95ec-d14316ca036a`::moving from state init -> state preparing >Thread-136533::INFO::2014-10-29 11:19:27,022::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136533::DEBUG::2014-10-29 11:19:27,022::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136533::DEBUG::2014-10-29 11:19:27,022::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136533::DEBUG::2014-10-29 11:19:27,023::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136533::DEBUG::2014-10-29 11:19:27,023::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136533::DEBUG::2014-10-29 11:19:27,023::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136533::DEBUG::2014-10-29 11:19:27,024::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136533::DEBUG::2014-10-29 11:19:27,113::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136533::DEBUG::2014-10-29 11:19:27,115::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136533::DEBUG::2014-10-29 11:19:27,286::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136533::DEBUG::2014-10-29 11:19:27,287::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136533::DEBUG::2014-10-29 11:19:27,288::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136533::DEBUG::2014-10-29 11:19:27,288::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136533::DEBUG::2014-10-29 11:19:27,289::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136533::DEBUG::2014-10-29 11:19:27,289::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136533::DEBUG::2014-10-29 11:19:27,289::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136533::DEBUG::2014-10-29 11:19:27,290::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:19:27,296::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:27,298::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:27,299::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:27,299::__init__::232::IOProcess::(_processLogs) (201238) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:19:27,300::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201238) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:27,301::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:27,302::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:27,302::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:27,302::__init__::232::IOProcess::(_processLogs) (201239) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:19:27,303::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201239) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:27,305::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:27,307::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:27,309::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:27,311::__init__::232::IOProcess::(_processLogs) (201240) Got request for method 'glob' >Thread-136533::DEBUG::2014-10-29 11:19:27,315::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:19:27,317::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201240) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:27,318::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:27,319::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:27,319::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:27,319::__init__::232::IOProcess::(_processLogs) (201241) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:19:27,320::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201241) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:27,321::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:27,321::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:27,321::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:27,322::__init__::232::IOProcess::(_processLogs) (201242) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:19:27,326::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201242) Queuing response >Thread-136533::DEBUG::2014-10-29 11:19:27,327::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:19:27,328::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:27,328::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:27,329::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:27,329::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201243) Got request for method 'readfile' >Thread-136533::DEBUG::2014-10-29 11:19:27,330::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:19:27,331::__init__::232::IOProcess::(_processLogs) (201243) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:27,333::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:27,333::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:27,334::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:27,335::__init__::232::IOProcess::(_processLogs) (201244) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:27,335::__init__::232::IOProcess::(_processLogs) (201244) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:27,335::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:27,336::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:27,336::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:27,336::__init__::232::IOProcess::(_processLogs) (201245) Got request for method 'glob' >Thread-136533::DEBUG::2014-10-29 11:19:27,337::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:19:27,337::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201245) Queuing response >Thread-136533::INFO::2014-10-29 11:19:27,338::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136533::INFO::2014-10-29 11:19:27,339::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136533::INFO::2014-10-29 11:19:27,339::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:19:27,340::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:27,340::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:27,340::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:27,341::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201246) Got request for method 'readfile' >Thread-136533::DEBUG::2014-10-29 11:19:27,342::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:19:27,343::__init__::232::IOProcess::(_processLogs) (201246) Queuing response >Thread-136533::DEBUG::2014-10-29 11:19:27,345::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`a417e82a-32fe-47ae-baeb-e45c3565778b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136533::DEBUG::2014-10-29 11:19:27,345::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136533::DEBUG::2014-10-29 11:19:27,346::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136533::DEBUG::2014-10-29 11:19:27,346::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`a417e82a-32fe-47ae-baeb-e45c3565778b`::Granted request >Thread-136533::DEBUG::2014-10-29 11:19:27,347::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5a19348e-9a2c-4e15-95ec-d14316ca036a`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136533::DEBUG::2014-10-29 11:19:27,347::task::993::Storage.TaskManager.Task::(_decref) Task=`5a19348e-9a2c-4e15-95ec-d14316ca036a`::ref 1 aborting False >Thread-136533::INFO::2014-10-29 11:19:27,350::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136533::DEBUG::2014-10-29 11:19:27,350::task::1191::Storage.TaskManager.Task::(prepare) Task=`5a19348e-9a2c-4e15-95ec-d14316ca036a`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136533::DEBUG::2014-10-29 11:19:27,350::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a19348e-9a2c-4e15-95ec-d14316ca036a`::moving from state preparing -> state finished >Thread-136533::DEBUG::2014-10-29 11:19:27,351::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136533::DEBUG::2014-10-29 11:19:27,351::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136533::DEBUG::2014-10-29 11:19:27,351::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136533::DEBUG::2014-10-29 11:19:27,352::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136533::DEBUG::2014-10-29 11:19:27,352::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136533::DEBUG::2014-10-29 11:19:27,352::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136533::DEBUG::2014-10-29 11:19:27,352::task::993::Storage.TaskManager.Task::(_decref) Task=`5a19348e-9a2c-4e15-95ec-d14316ca036a`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:19:27,374::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54438 >Detector thread::DEBUG::2014-10-29 11:19:27,375::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54438 >Detector thread::DEBUG::2014-10-29 11:19:27,376::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54438 >Detector thread::DEBUG::2014-10-29 11:19:27,376::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54438) >Thread-136538::DEBUG::2014-10-29 11:19:27,415::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136538::DEBUG::2014-10-29 11:19:27,415::task::595::Storage.TaskManager.Task::(_updateState) Task=`9df563aa-5fcf-458e-b497-b876f3d56498`::moving from state init -> state preparing >Thread-136538::INFO::2014-10-29 11:19:27,416::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136538::INFO::2014-10-29 11:19:27,417::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525491', 'lastCheck': '2.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000529821', 'lastCheck': '2.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558414', 'lastCheck': '2.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000551861', 'lastCheck': '2.4', 'valid': True}} >Thread-136538::DEBUG::2014-10-29 11:19:27,417::task::1191::Storage.TaskManager.Task::(prepare) Task=`9df563aa-5fcf-458e-b497-b876f3d56498`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525491', 'lastCheck': '2.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000529821', 'lastCheck': '2.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558414', 'lastCheck': '2.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000551861', 'lastCheck': '2.4', 'valid': True}} >Thread-136538::DEBUG::2014-10-29 11:19:27,417::task::595::Storage.TaskManager.Task::(_updateState) Task=`9df563aa-5fcf-458e-b497-b876f3d56498`::moving from state preparing -> state finished >Thread-136538::DEBUG::2014-10-29 11:19:27,417::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136538::DEBUG::2014-10-29 11:19:27,418::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136538::DEBUG::2014-10-29 11:19:27,418::task::993::Storage.TaskManager.Task::(_decref) Task=`9df563aa-5fcf-458e-b497-b876f3d56498`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:30,408::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:30,410::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:30,413::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:19:30,804::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54439 >Detector thread::DEBUG::2014-10-29 11:19:30,804::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54439 >Detector thread::DEBUG::2014-10-29 11:19:30,805::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54439 >Detector thread::DEBUG::2014-10-29 11:19:30,805::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54439) >Detector thread::DEBUG::2014-10-29 11:19:30,822::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54440 >Detector thread::DEBUG::2014-10-29 11:19:30,822::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54440 >Detector thread::DEBUG::2014-10-29 11:19:30,822::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54440 >Detector thread::DEBUG::2014-10-29 11:19:30,823::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54440) >Thread-136539::DEBUG::2014-10-29 11:19:30,844::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136539::DEBUG::2014-10-29 11:19:30,846::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136539::DEBUG::2014-10-29 11:19:30,866::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136540::DEBUG::2014-10-29 11:19:30,867::task::595::Storage.TaskManager.Task::(_updateState) Task=`1381499b-6b3e-4746-b1d9-e120f5640bfb`::moving from state init -> state preparing >Thread-136540::INFO::2014-10-29 11:19:30,870::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136540::INFO::2014-10-29 11:19:30,874::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525491', 'lastCheck': '5.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000529821', 'lastCheck': '5.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558414', 'lastCheck': '6.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000551861', 'lastCheck': '5.8', 'valid': True}} >Thread-136540::DEBUG::2014-10-29 11:19:30,876::task::1191::Storage.TaskManager.Task::(prepare) Task=`1381499b-6b3e-4746-b1d9-e120f5640bfb`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525491', 'lastCheck': '5.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000529821', 'lastCheck': '5.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558414', 'lastCheck': '6.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000551861', 'lastCheck': '5.8', 'valid': True}} >Thread-136540::DEBUG::2014-10-29 11:19:30,878::task::595::Storage.TaskManager.Task::(_updateState) Task=`1381499b-6b3e-4746-b1d9-e120f5640bfb`::moving from state preparing -> state finished >Thread-136540::DEBUG::2014-10-29 11:19:30,879::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136540::DEBUG::2014-10-29 11:19:30,881::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136540::DEBUG::2014-10-29 11:19:30,881::task::993::Storage.TaskManager.Task::(_decref) Task=`1381499b-6b3e-4746-b1d9-e120f5640bfb`::ref 0 aborting False >Thread-136539::DEBUG::2014-10-29 11:19:30,932::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '47', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '47', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:19:31,210::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54441 >Detector thread::DEBUG::2014-10-29 11:19:31,211::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54441 >Detector thread::DEBUG::2014-10-29 11:19:31,211::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54441 >Detector thread::DEBUG::2014-10-29 11:19:31,211::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54441) >Thread-136541::DEBUG::2014-10-29 11:19:31,250::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136541::DEBUG::2014-10-29 11:19:31,251::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136541::DEBUG::2014-10-29 11:19:31,252::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.33', 'elapsedTime': '514203', 'displayType': 'vnc', 'cpuSys': '0.80', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '4241397', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '69188', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '33745.03'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.06', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:33,793::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:33,799::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136542::DEBUG::2014-10-29 11:19:33,808::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:33,818::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:33,826::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136543::DEBUG::2014-10-29 11:19:33,843::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136543::DEBUG::2014-10-29 11:19:33,848::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:19:34,078::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >Thread-22::DEBUG::2014-10-29 11:19:34,208::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-17::DEBUG::2014-10-29 11:19:34,694::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:34,694::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:34,695::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:34,695::__init__::232::IOProcess::(_processLogs) (201247) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:34,696::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201247) Queuing response >Thread-179::DEBUG::2014-10-29 11:19:34,698::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:19:34,715::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000511613 s, 727 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:19:34,717::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:34,717::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:34,718::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:34,719::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201248) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:34,720::__init__::232::IOProcess::(_processLogs) (201248) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:35,066::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:35,066::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:35,068::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-10269::DEBUG::2014-10-29 11:19:35,068::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:19:35,087::__init__::232::IOProcess::(_processLogs) (201249) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:35,090::__init__::232::IOProcess::(_processLogs) (201249) Queuing response >Thread-10269::DEBUG::2014-10-29 11:19:35,090::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000792649 s, 633 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:19:35,093::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:35,093::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:35,093::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:35,093::__init__::232::IOProcess::(_processLogs) (201250) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:35,095::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201250) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:35,110::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:35,112::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:35,113::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-178::DEBUG::2014-10-29 11:19:35,113::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:19:35,115::__init__::232::IOProcess::(_processLogs) (201251) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:35,130::__init__::232::IOProcess::(_processLogs) (201251) Queuing response >Thread-178::DEBUG::2014-10-29 11:19:35,132::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000497992 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:19:35,133::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:35,134::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:35,134::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:35,136::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201252) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:35,137::__init__::232::IOProcess::(_processLogs) (201252) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:35,138::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:35,138::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:35,138::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:35,138::__init__::232::IOProcess::(_processLogs) (201253) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:35,139::__init__::232::IOProcess::(_processLogs) (201253) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:35,140::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:35,140::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:35,140::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:35,141::__init__::232::IOProcess::(_processLogs) (201254) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:35,141::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201254) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:35,142::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:35,143::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:35,144::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:35,144::__init__::232::IOProcess::(_processLogs) (201255) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:35,145::__init__::232::IOProcess::(_processLogs) (201255) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:35,152::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:35,153::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:35,153::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:35,153::__init__::232::IOProcess::(_processLogs) (201256) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:35,155::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201256) Queuing response >Thread-33::DEBUG::2014-10-29 11:19:35,156::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:19:35,173::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000426325 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:19:35,175::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:35,175::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:35,177::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:35,178::__init__::232::IOProcess::(_processLogs) (201257) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:35,179::__init__::232::IOProcess::(_processLogs) (201257) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:35,179::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:35,179::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:35,180::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:35,181::__init__::232::IOProcess::(_processLogs) (201258) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:35,181::__init__::232::IOProcess::(_processLogs) (201258) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:35,182::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:35,183::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:35,183::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:35,184::__init__::232::IOProcess::(_processLogs) (201259) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:35,184::__init__::232::IOProcess::(_processLogs) (201259) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:35,184::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:35,185::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:35,185::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:35,185::__init__::232::IOProcess::(_processLogs) (201260) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:35,185::__init__::232::IOProcess::(_processLogs) (201260) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:35,418::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:35,419::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:35,421::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:36,865::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:36,868::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136544::DEBUG::2014-10-29 11:19:36,872::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:36,874::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:36,877::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136545::DEBUG::2014-10-29 11:19:36,880::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136545::DEBUG::2014-10-29 11:19:36,882::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:19:37,994::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54444 >Detector thread::DEBUG::2014-10-29 11:19:37,995::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54444 >Detector thread::DEBUG::2014-10-29 11:19:37,995::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54444 >Detector thread::DEBUG::2014-10-29 11:19:37,996::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54444) >Thread-136546::DEBUG::2014-10-29 11:19:38,035::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136546::DEBUG::2014-10-29 11:19:38,036::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8eb312e-5816-4a0d-b596-241ca70d299b`::moving from state init -> state preparing >Thread-136546::INFO::2014-10-29 11:19:38,036::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136546::DEBUG::2014-10-29 11:19:38,041::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:19:38,042::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:38,042::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:38,042::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:38,042::__init__::232::IOProcess::(_processLogs) (201261) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:19:38,784::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201261) Queuing response >Thread-136546::DEBUG::2014-10-29 11:19:38,784::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136546::DEBUG::2014-10-29 11:19:38,785::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136546::INFO::2014-10-29 11:19:38,786::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136546::DEBUG::2014-10-29 11:19:38,786::task::1191::Storage.TaskManager.Task::(prepare) Task=`d8eb312e-5816-4a0d-b596-241ca70d299b`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136546::DEBUG::2014-10-29 11:19:38,786::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8eb312e-5816-4a0d-b596-241ca70d299b`::moving from state preparing -> state finished >Thread-136546::DEBUG::2014-10-29 11:19:38,786::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136546::DEBUG::2014-10-29 11:19:38,787::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136546::DEBUG::2014-10-29 11:19:38,787::task::993::Storage.TaskManager.Task::(_decref) Task=`d8eb312e-5816-4a0d-b596-241ca70d299b`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:19:38,831::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54445 >Detector thread::DEBUG::2014-10-29 11:19:38,831::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54445 >Detector thread::DEBUG::2014-10-29 11:19:38,832::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54445 >Detector thread::DEBUG::2014-10-29 11:19:38,832::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54445) >Thread-136547::DEBUG::2014-10-29 11:19:38,871::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136547::DEBUG::2014-10-29 11:19:38,872::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d08bd1a-98dd-4ea5-9b89-4d14b6d5d988`::moving from state init -> state preparing >Thread-136547::INFO::2014-10-29 11:19:38,872::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136547::DEBUG::2014-10-29 11:19:38,872::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136547::DEBUG::2014-10-29 11:19:38,873::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136547::DEBUG::2014-10-29 11:19:38,873::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136547::DEBUG::2014-10-29 11:19:38,873::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136547::DEBUG::2014-10-29 11:19:38,873::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136547::DEBUG::2014-10-29 11:19:38,874::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136547::DEBUG::2014-10-29 11:19:38,961::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136547::DEBUG::2014-10-29 11:19:38,963::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136547::DEBUG::2014-10-29 11:19:39,142::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136547::DEBUG::2014-10-29 11:19:39,143::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136547::DEBUG::2014-10-29 11:19:39,143::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136547::DEBUG::2014-10-29 11:19:39,144::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136547::DEBUG::2014-10-29 11:19:39,144::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136547::DEBUG::2014-10-29 11:19:39,144::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136547::DEBUG::2014-10-29 11:19:39,145::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136547::DEBUG::2014-10-29 11:19:39,145::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:19:39,150::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:39,150::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:39,152::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:39,156::__init__::232::IOProcess::(_processLogs) (201262) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:19:39,158::__init__::232::IOProcess::(_processLogs) (201262) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:39,159::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:39,161::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:39,162::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:39,164::__init__::232::IOProcess::(_processLogs) (201263) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:19:39,166::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:39,168::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:39,170::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:39,172::__init__::232::IOProcess::(_processLogs) (201264) Got request for method 'glob' >Thread-136547::DEBUG::2014-10-29 11:19:39,172::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:19:39,174::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:39,175::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:39,175::__init__::232::IOProcess::(_processLogs) (201263) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:39,176::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:39,176::__init__::232::IOProcess::(_processLogs) (201265) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:19:39,176::__init__::232::IOProcess::(_processLogs) (201264) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:39,176::__init__::232::IOProcess::(_processLogs) (201265) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:39,179::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:39,179::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:39,180::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:39,180::__init__::232::IOProcess::(_processLogs) (201266) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:19:39,181::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201266) Queuing response >Thread-136547::DEBUG::2014-10-29 11:19:39,181::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:19:39,183::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:39,184::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:39,184::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:39,184::__init__::232::IOProcess::(_processLogs) (201267) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:19:39,185::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201267) Queuing response >Thread-136547::DEBUG::2014-10-29 11:19:39,185::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:19:39,187::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:39,188::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:39,189::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:39,189::__init__::232::IOProcess::(_processLogs) (201268) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:39,190::__init__::232::IOProcess::(_processLogs) (201268) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:39,190::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:39,190::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:39,191::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:39,191::__init__::232::IOProcess::(_processLogs) (201269) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:19:39,192::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201269) Queuing response >Thread-136547::DEBUG::2014-10-29 11:19:39,192::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-136547::INFO::2014-10-29 11:19:39,193::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136547::INFO::2014-10-29 11:19:39,193::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136547::INFO::2014-10-29 11:19:39,194::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:19:39,194::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:39,195::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:39,195::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:39,195::__init__::232::IOProcess::(_processLogs) (201270) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:19:39,196::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201270) Queuing response >Thread-136547::DEBUG::2014-10-29 11:19:39,197::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136547::DEBUG::2014-10-29 11:19:39,199::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`a9a22d78-78e1-4569-bdec-ffc64ce3d873`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136547::DEBUG::2014-10-29 11:19:39,199::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136547::DEBUG::2014-10-29 11:19:39,200::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136547::DEBUG::2014-10-29 11:19:39,200::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`a9a22d78-78e1-4569-bdec-ffc64ce3d873`::Granted request >Thread-136547::DEBUG::2014-10-29 11:19:39,201::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7d08bd1a-98dd-4ea5-9b89-4d14b6d5d988`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136547::DEBUG::2014-10-29 11:19:39,201::task::993::Storage.TaskManager.Task::(_decref) Task=`7d08bd1a-98dd-4ea5-9b89-4d14b6d5d988`::ref 1 aborting False >Thread-136547::INFO::2014-10-29 11:19:39,204::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136547::DEBUG::2014-10-29 11:19:39,204::task::1191::Storage.TaskManager.Task::(prepare) Task=`7d08bd1a-98dd-4ea5-9b89-4d14b6d5d988`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136547::DEBUG::2014-10-29 11:19:39,204::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d08bd1a-98dd-4ea5-9b89-4d14b6d5d988`::moving from state preparing -> state finished >Thread-136547::DEBUG::2014-10-29 11:19:39,205::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136547::DEBUG::2014-10-29 11:19:39,205::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136547::DEBUG::2014-10-29 11:19:39,205::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136547::DEBUG::2014-10-29 11:19:39,206::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136547::DEBUG::2014-10-29 11:19:39,206::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136547::DEBUG::2014-10-29 11:19:39,206::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136547::DEBUG::2014-10-29 11:19:39,207::task::993::Storage.TaskManager.Task::(_decref) Task=`7d08bd1a-98dd-4ea5-9b89-4d14b6d5d988`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:19:39,228::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54446 >Detector thread::DEBUG::2014-10-29 11:19:39,229::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54446 >Detector thread::DEBUG::2014-10-29 11:19:39,229::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54446 >Detector thread::DEBUG::2014-10-29 11:19:39,230::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54446) >Thread-136552::DEBUG::2014-10-29 11:19:39,269::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136552::DEBUG::2014-10-29 11:19:39,270::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6f80625-0a95-4294-9929-2861dbfdf49c`::moving from state init -> state preparing >Thread-136552::INFO::2014-10-29 11:19:39,270::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136552::INFO::2014-10-29 11:19:39,271::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000497992', 'lastCheck': '4.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426325', 'lastCheck': '4.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511613', 'lastCheck': '4.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000792649', 'lastCheck': '4.2', 'valid': True}} >Thread-136552::DEBUG::2014-10-29 11:19:39,271::task::1191::Storage.TaskManager.Task::(prepare) Task=`b6f80625-0a95-4294-9929-2861dbfdf49c`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000497992', 'lastCheck': '4.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426325', 'lastCheck': '4.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511613', 'lastCheck': '4.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000792649', 'lastCheck': '4.2', 'valid': True}} >Thread-136552::DEBUG::2014-10-29 11:19:39,271::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6f80625-0a95-4294-9929-2861dbfdf49c`::moving from state preparing -> state finished >Thread-136552::DEBUG::2014-10-29 11:19:39,271::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136552::DEBUG::2014-10-29 11:19:39,272::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136552::DEBUG::2014-10-29 11:19:39,272::task::993::Storage.TaskManager.Task::(_decref) Task=`b6f80625-0a95-4294-9929-2861dbfdf49c`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:39,897::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:39,899::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136553::DEBUG::2014-10-29 11:19:39,902::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:39,904::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:39,906::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136554::DEBUG::2014-10-29 11:19:39,909::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136554::DEBUG::2014-10-29 11:19:39,912::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:19:40,399::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54447 >Detector thread::DEBUG::2014-10-29 11:19:40,400::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54447 >Detector thread::DEBUG::2014-10-29 11:19:40,400::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54447 >Detector thread::DEBUG::2014-10-29 11:19:40,401::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54447) >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:40,428::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:40,429::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:40,432::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136555::DEBUG::2014-10-29 11:19:40,440::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136555::DEBUG::2014-10-29 11:19:40,441::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136555::DEBUG::2014-10-29 11:19:40,442::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.02', 'elapsedTime': '514212', 'displayType': 'vnc', 'cpuSys': '0.47', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '4241397', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '69188', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '33745.03'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.23', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:19:40,876::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54449 >Detector thread::DEBUG::2014-10-29 11:19:40,877::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54449 >Detector thread::DEBUG::2014-10-29 11:19:40,877::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54449 >Detector thread::DEBUG::2014-10-29 11:19:40,877::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54449) >Thread-136556::DEBUG::2014-10-29 11:19:40,917::task::595::Storage.TaskManager.Task::(_updateState) Task=`a87eb17c-b001-40de-9495-543a5052fef3`::moving from state init -> state preparing >Thread-136556::INFO::2014-10-29 11:19:40,917::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136556::INFO::2014-10-29 11:19:40,918::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000497992', 'lastCheck': '5.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426325', 'lastCheck': '5.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511613', 'lastCheck': '6.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000792649', 'lastCheck': '5.8', 'valid': True}} >Thread-136556::DEBUG::2014-10-29 11:19:40,918::task::1191::Storage.TaskManager.Task::(prepare) Task=`a87eb17c-b001-40de-9495-543a5052fef3`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000497992', 'lastCheck': '5.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426325', 'lastCheck': '5.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511613', 'lastCheck': '6.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000792649', 'lastCheck': '5.8', 'valid': True}} >Thread-136556::DEBUG::2014-10-29 11:19:40,918::task::595::Storage.TaskManager.Task::(_updateState) Task=`a87eb17c-b001-40de-9495-543a5052fef3`::moving from state preparing -> state finished >Thread-136556::DEBUG::2014-10-29 11:19:40,919::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136556::DEBUG::2014-10-29 11:19:40,919::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136556::DEBUG::2014-10-29 11:19:40,919::task::993::Storage.TaskManager.Task::(_decref) Task=`a87eb17c-b001-40de-9495-543a5052fef3`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:19:40,980::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54450 >Detector thread::DEBUG::2014-10-29 11:19:40,981::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54450 >Detector thread::DEBUG::2014-10-29 11:19:40,981::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54450 >Detector thread::DEBUG::2014-10-29 11:19:40,982::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54450) >Thread-136557::DEBUG::2014-10-29 11:19:41,021::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136557::DEBUG::2014-10-29 11:19:41,023::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136557::DEBUG::2014-10-29 11:19:41,044::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136557::DEBUG::2014-10-29 11:19:41,103::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '30', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '30', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:42,928::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:42,931::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136558::DEBUG::2014-10-29 11:19:42,935::task::595::Storage.TaskManager.Task::(_updateState) Task=`9cbdf075-694b-4265-852d-ec185e7842bc`::moving from state init -> state preparing >Thread-136558::INFO::2014-10-29 11:19:42,935::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136558::INFO::2014-10-29 11:19:42,936::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000497992', 'lastCheck': '7.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426325', 'lastCheck': '7.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511613', 'lastCheck': '8.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000792649', 'lastCheck': '7.8', 'valid': True}} >Thread-136558::DEBUG::2014-10-29 11:19:42,936::task::1191::Storage.TaskManager.Task::(prepare) Task=`9cbdf075-694b-4265-852d-ec185e7842bc`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000497992', 'lastCheck': '7.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426325', 'lastCheck': '7.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000511613', 'lastCheck': '8.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000792649', 'lastCheck': '7.8', 'valid': True}} >Thread-136558::DEBUG::2014-10-29 11:19:42,937::task::595::Storage.TaskManager.Task::(_updateState) Task=`9cbdf075-694b-4265-852d-ec185e7842bc`::moving from state preparing -> state finished >Thread-136558::DEBUG::2014-10-29 11:19:42,937::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136558::DEBUG::2014-10-29 11:19:42,937::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136558::DEBUG::2014-10-29 11:19:42,937::task::993::Storage.TaskManager.Task::(_decref) Task=`9cbdf075-694b-4265-852d-ec185e7842bc`::ref 0 aborting False >Thread-136558::DEBUG::2014-10-29 11:19:42,959::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:42,981::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:42,983::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136559::DEBUG::2014-10-29 11:19:42,987::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136559::DEBUG::2014-10-29 11:19:42,989::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:19:44,723::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:44,724::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:44,724::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:44,724::__init__::232::IOProcess::(_processLogs) (201271) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:44,725::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201271) Queuing response >Thread-179::DEBUG::2014-10-29 11:19:44,727::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:19:44,745::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000703815 s, 529 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:19:44,747::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:44,748::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:44,748::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:44,748::__init__::232::IOProcess::(_processLogs) (201272) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:44,750::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201272) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:45,098::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:45,098::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:45,098::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:45,099::__init__::232::IOProcess::(_processLogs) (201273) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:45,100::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201273) Queuing response >Thread-10269::DEBUG::2014-10-29 11:19:45,102::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:19:45,118::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000524611 s, 957 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:19:45,120::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:45,121::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:45,121::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:45,121::__init__::232::IOProcess::(_processLogs) (201274) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:45,122::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201274) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:45,146::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:45,146::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:45,146::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:45,147::__init__::232::IOProcess::(_processLogs) (201275) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:45,147::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201275) Queuing response >Thread-178::DEBUG::2014-10-29 11:19:45,148::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:19:45,165::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000712424 s, 713 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:19:45,167::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:45,168::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:45,168::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:45,168::__init__::232::IOProcess::(_processLogs) (201276) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:45,169::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201276) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:45,171::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:45,172::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:45,173::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:45,173::__init__::232::IOProcess::(_processLogs) (201277) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:45,174::__init__::232::IOProcess::(_processLogs) (201277) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:45,174::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:45,175::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:45,176::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:45,176::__init__::232::IOProcess::(_processLogs) (201278) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:45,176::__init__::232::IOProcess::(_processLogs) (201278) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:45,177::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:45,178::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:45,178::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:45,180::__init__::232::IOProcess::(_processLogs) (201279) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:45,180::__init__::232::IOProcess::(_processLogs) (201279) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:45,188::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:45,188::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:45,188::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:45,188::__init__::232::IOProcess::(_processLogs) (201280) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:45,190::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201280) Queuing response >Thread-33::DEBUG::2014-10-29 11:19:45,192::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:19:45,211::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000575812 s, 846 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:19:45,214::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:45,215::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:45,215::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:45,215::__init__::232::IOProcess::(_processLogs) (201281) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:45,217::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201281) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:45,219::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:45,220::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:45,220::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:45,220::__init__::232::IOProcess::(_processLogs) (201282) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:45,221::__init__::232::IOProcess::(_processLogs) (201282) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:45,221::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:45,222::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:45,223::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:45,223::__init__::232::IOProcess::(_processLogs) (201283) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:45,223::__init__::232::IOProcess::(_processLogs) (201283) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:45,224::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:45,225::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:45,225::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:45,226::__init__::232::IOProcess::(_processLogs) (201284) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:45,227::__init__::232::IOProcess::(_processLogs) (201284) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:45,439::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:45,441::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:45,442::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:46,073::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:46,079::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136560::DEBUG::2014-10-29 11:19:46,087::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:46,093::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:46,099::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136561::DEBUG::2014-10-29 11:19:46,106::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136561::DEBUG::2014-10-29 11:19:46,118::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:49,147::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:49,150::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136562::DEBUG::2014-10-29 11:19:49,154::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:49,157::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:49,160::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136563::DEBUG::2014-10-29 11:19:49,166::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136563::DEBUG::2014-10-29 11:19:49,168::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:19:49,215::task::595::Storage.TaskManager.Task::(_updateState) Task=`a468c81b-d461-4e0d-a8d3-8f993cd6aebe`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:19:49,215::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:19:49,217::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:49,217::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:49,217::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:49,217::__init__::232::IOProcess::(_processLogs) (201285) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:19:49,222::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201285) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:49,225::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:49,225::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:49,226::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-22::INFO::2014-10-29 11:19:49,227::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010871808', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:19:49,228::__init__::232::IOProcess::(_processLogs) (201286) Got request for method 'stat' >Thread-22::DEBUG::2014-10-29 11:19:49,229::task::1191::Storage.TaskManager.Task::(prepare) Task=`a468c81b-d461-4e0d-a8d3-8f993cd6aebe`::finished: {'truesize': '6010871808', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:19:49,230::__init__::232::IOProcess::(_processLogs) (201286) Queuing response >Thread-22::DEBUG::2014-10-29 11:19:49,230::task::595::Storage.TaskManager.Task::(_updateState) Task=`a468c81b-d461-4e0d-a8d3-8f993cd6aebe`::moving from state preparing -> state finished >Thread-22::DEBUG::2014-10-29 11:19:49,231::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-10-29 11:19:49,231::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2014-10-29 11:19:49,232::task::993::Storage.TaskManager.Task::(_decref) Task=`a468c81b-d461-4e0d-a8d3-8f993cd6aebe`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:19:49,309::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Detector thread::DEBUG::2014-10-29 11:19:49,860::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54452 >Detector thread::DEBUG::2014-10-29 11:19:49,861::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54452 >Detector thread::DEBUG::2014-10-29 11:19:49,861::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54452 >Detector thread::DEBUG::2014-10-29 11:19:49,861::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54452) >Thread-136564::DEBUG::2014-10-29 11:19:49,901::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136564::DEBUG::2014-10-29 11:19:49,901::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c859372-363b-46b5-a83a-9ae5aecca7fe`::moving from state init -> state preparing >Thread-136564::INFO::2014-10-29 11:19:49,902::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136564::DEBUG::2014-10-29 11:19:49,905::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:19:49,905::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:49,906::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:49,906::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:49,906::__init__::232::IOProcess::(_processLogs) (201287) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:19:49,907::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201287) Queuing response >Thread-136564::DEBUG::2014-10-29 11:19:49,907::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136564::DEBUG::2014-10-29 11:19:49,909::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136564::INFO::2014-10-29 11:19:49,909::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136564::DEBUG::2014-10-29 11:19:49,909::task::1191::Storage.TaskManager.Task::(prepare) Task=`9c859372-363b-46b5-a83a-9ae5aecca7fe`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136564::DEBUG::2014-10-29 11:19:49,909::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c859372-363b-46b5-a83a-9ae5aecca7fe`::moving from state preparing -> state finished >Thread-136564::DEBUG::2014-10-29 11:19:49,910::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136564::DEBUG::2014-10-29 11:19:49,910::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136564::DEBUG::2014-10-29 11:19:49,910::task::993::Storage.TaskManager.Task::(_decref) Task=`9c859372-363b-46b5-a83a-9ae5aecca7fe`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:19:49,957::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54453 >Detector thread::DEBUG::2014-10-29 11:19:49,957::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54453 >Detector thread::DEBUG::2014-10-29 11:19:49,958::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54453 >Detector thread::DEBUG::2014-10-29 11:19:49,958::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54453) >Thread-136565::DEBUG::2014-10-29 11:19:49,997::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136565::DEBUG::2014-10-29 11:19:49,998::task::595::Storage.TaskManager.Task::(_updateState) Task=`c9b53cac-21c9-4c69-9169-a2134954fe4b`::moving from state init -> state preparing >Thread-136565::INFO::2014-10-29 11:19:49,998::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136565::DEBUG::2014-10-29 11:19:49,998::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136565::DEBUG::2014-10-29 11:19:49,999::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136565::DEBUG::2014-10-29 11:19:49,999::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136565::DEBUG::2014-10-29 11:19:49,999::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136565::DEBUG::2014-10-29 11:19:49,999::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136565::DEBUG::2014-10-29 11:19:50,000::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136565::DEBUG::2014-10-29 11:19:50,089::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136565::DEBUG::2014-10-29 11:19:50,091::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136565::DEBUG::2014-10-29 11:19:50,273::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136565::DEBUG::2014-10-29 11:19:50,273::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136565::DEBUG::2014-10-29 11:19:50,274::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136565::DEBUG::2014-10-29 11:19:50,274::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136565::DEBUG::2014-10-29 11:19:50,275::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136565::DEBUG::2014-10-29 11:19:50,275::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136565::DEBUG::2014-10-29 11:19:50,275::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136565::DEBUG::2014-10-29 11:19:50,276::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:19:50,281::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:50,285::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:50,286::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:50,286::__init__::232::IOProcess::(_processLogs) (201288) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:19:50,287::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201288) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:50,288::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:50,289::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:50,289::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:50,289::__init__::232::IOProcess::(_processLogs) (201289) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:19:50,290::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201289) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:50,292::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:50,295::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:50,297::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:50,299::__init__::232::IOProcess::(_processLogs) (201290) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:19:50,303::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201290) Queuing response >Thread-136565::DEBUG::2014-10-29 11:19:50,303::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:19:50,306::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:50,306::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:50,306::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:50,307::__init__::232::IOProcess::(_processLogs) (201291) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:19:50,308::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201291) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:50,308::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:50,308::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:50,309::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:50,309::__init__::232::IOProcess::(_processLogs) (201292) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:19:50,310::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201292) Queuing response >Thread-136565::DEBUG::2014-10-29 11:19:50,310::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:19:50,312::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:50,313::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:50,313::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:50,313::__init__::232::IOProcess::(_processLogs) (201293) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:19:50,314::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201293) Queuing response >Thread-136565::DEBUG::2014-10-29 11:19:50,314::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:19:50,316::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:50,317::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:50,317::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:50,317::__init__::232::IOProcess::(_processLogs) (201294) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:50,318::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201294) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:50,319::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:50,319::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:50,319::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:50,320::__init__::232::IOProcess::(_processLogs) (201295) Got request for method 'glob' >Thread-136565::DEBUG::2014-10-29 11:19:50,320::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:19:50,321::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201295) Queuing response >Thread-136565::INFO::2014-10-29 11:19:50,322::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136565::INFO::2014-10-29 11:19:50,323::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136565::INFO::2014-10-29 11:19:50,323::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:19:50,324::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:50,324::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:50,324::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:50,324::__init__::232::IOProcess::(_processLogs) (201296) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:19:50,325::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201296) Queuing response >Thread-136565::DEBUG::2014-10-29 11:19:50,326::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136565::DEBUG::2014-10-29 11:19:50,328::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`12659f8f-2d5a-4dab-9f14-f6ad4437c453`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136565::DEBUG::2014-10-29 11:19:50,328::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136565::DEBUG::2014-10-29 11:19:50,329::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136565::DEBUG::2014-10-29 11:19:50,329::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`12659f8f-2d5a-4dab-9f14-f6ad4437c453`::Granted request >Thread-136565::DEBUG::2014-10-29 11:19:50,330::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c9b53cac-21c9-4c69-9169-a2134954fe4b`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136565::DEBUG::2014-10-29 11:19:50,330::task::993::Storage.TaskManager.Task::(_decref) Task=`c9b53cac-21c9-4c69-9169-a2134954fe4b`::ref 1 aborting False >Thread-136565::INFO::2014-10-29 11:19:50,332::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136565::DEBUG::2014-10-29 11:19:50,333::task::1191::Storage.TaskManager.Task::(prepare) Task=`c9b53cac-21c9-4c69-9169-a2134954fe4b`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136565::DEBUG::2014-10-29 11:19:50,333::task::595::Storage.TaskManager.Task::(_updateState) Task=`c9b53cac-21c9-4c69-9169-a2134954fe4b`::moving from state preparing -> state finished >Thread-136565::DEBUG::2014-10-29 11:19:50,333::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136565::DEBUG::2014-10-29 11:19:50,334::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136565::DEBUG::2014-10-29 11:19:50,334::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136565::DEBUG::2014-10-29 11:19:50,334::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136565::DEBUG::2014-10-29 11:19:50,335::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136565::DEBUG::2014-10-29 11:19:50,335::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136565::DEBUG::2014-10-29 11:19:50,335::task::993::Storage.TaskManager.Task::(_decref) Task=`c9b53cac-21c9-4c69-9169-a2134954fe4b`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:19:50,357::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54454 >Detector thread::DEBUG::2014-10-29 11:19:50,358::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54454 >Detector thread::DEBUG::2014-10-29 11:19:50,358::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54454 >Detector thread::DEBUG::2014-10-29 11:19:50,359::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54454) >Thread-136570::DEBUG::2014-10-29 11:19:50,397::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136570::DEBUG::2014-10-29 11:19:50,397::task::595::Storage.TaskManager.Task::(_updateState) Task=`79a533f9-f218-4600-918a-b047e448ecbb`::moving from state init -> state preparing >Thread-136570::INFO::2014-10-29 11:19:50,398::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136570::INFO::2014-10-29 11:19:50,398::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000712424', 'lastCheck': '5.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000575812', 'lastCheck': '5.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000703815', 'lastCheck': '5.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000524611', 'lastCheck': '5.3', 'valid': True}} >Thread-136570::DEBUG::2014-10-29 11:19:50,399::task::1191::Storage.TaskManager.Task::(prepare) Task=`79a533f9-f218-4600-918a-b047e448ecbb`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000712424', 'lastCheck': '5.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000575812', 'lastCheck': '5.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000703815', 'lastCheck': '5.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000524611', 'lastCheck': '5.3', 'valid': True}} >Thread-136570::DEBUG::2014-10-29 11:19:50,399::task::595::Storage.TaskManager.Task::(_updateState) Task=`79a533f9-f218-4600-918a-b047e448ecbb`::moving from state preparing -> state finished >Thread-136570::DEBUG::2014-10-29 11:19:50,399::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136570::DEBUG::2014-10-29 11:19:50,399::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136570::DEBUG::2014-10-29 11:19:50,400::task::993::Storage.TaskManager.Task::(_decref) Task=`79a533f9-f218-4600-918a-b047e448ecbb`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:50,450::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:50,451::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:50,454::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:19:50,604::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54455 >Detector thread::DEBUG::2014-10-29 11:19:50,606::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54455 >Detector thread::DEBUG::2014-10-29 11:19:50,606::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54455 >Detector thread::DEBUG::2014-10-29 11:19:50,606::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54455) >Thread-136571::DEBUG::2014-10-29 11:19:50,644::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136571::DEBUG::2014-10-29 11:19:50,645::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136571::DEBUG::2014-10-29 11:19:50,645::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.72', 'elapsedTime': '514223', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '20599643', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '61131', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '32042.52'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.43', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:19:50,970::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54457 >Detector thread::DEBUG::2014-10-29 11:19:50,971::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54457 >Detector thread::DEBUG::2014-10-29 11:19:50,971::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54457 >Detector thread::DEBUG::2014-10-29 11:19:50,971::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54457) >Thread-136572::DEBUG::2014-10-29 11:19:51,011::task::595::Storage.TaskManager.Task::(_updateState) Task=`373d25a1-d885-42ee-8aaf-5f72145333a5`::moving from state init -> state preparing >Thread-136572::INFO::2014-10-29 11:19:51,011::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136572::INFO::2014-10-29 11:19:51,012::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000712424', 'lastCheck': '5.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000575812', 'lastCheck': '5.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000703815', 'lastCheck': '6.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000524611', 'lastCheck': '5.9', 'valid': True}} >Thread-136572::DEBUG::2014-10-29 11:19:51,012::task::1191::Storage.TaskManager.Task::(prepare) Task=`373d25a1-d885-42ee-8aaf-5f72145333a5`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000712424', 'lastCheck': '5.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000575812', 'lastCheck': '5.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000703815', 'lastCheck': '6.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000524611', 'lastCheck': '5.9', 'valid': True}} >Thread-136572::DEBUG::2014-10-29 11:19:51,012::task::595::Storage.TaskManager.Task::(_updateState) Task=`373d25a1-d885-42ee-8aaf-5f72145333a5`::moving from state preparing -> state finished >Thread-136572::DEBUG::2014-10-29 11:19:51,013::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136572::DEBUG::2014-10-29 11:19:51,013::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136572::DEBUG::2014-10-29 11:19:51,013::task::993::Storage.TaskManager.Task::(_decref) Task=`373d25a1-d885-42ee-8aaf-5f72145333a5`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:19:51,149::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54458 >Detector thread::DEBUG::2014-10-29 11:19:51,149::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54458 >Detector thread::DEBUG::2014-10-29 11:19:51,150::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54458 >Detector thread::DEBUG::2014-10-29 11:19:51,150::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54458) >Thread-136573::DEBUG::2014-10-29 11:19:51,189::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136573::DEBUG::2014-10-29 11:19:51,191::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136573::DEBUG::2014-10-29 11:19:51,210::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136573::DEBUG::2014-10-29 11:19:51,261::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '15', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '15', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:52,183::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:52,186::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136574::DEBUG::2014-10-29 11:19:52,192::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:52,194::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:52,196::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136575::DEBUG::2014-10-29 11:19:52,200::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136575::DEBUG::2014-10-29 11:19:52,202::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:19:54,754::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:54,756::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:54,757::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:54,757::__init__::232::IOProcess::(_processLogs) (201297) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:54,757::__init__::232::IOProcess::(_processLogs) (201297) Queuing response >Thread-179::DEBUG::2014-10-29 11:19:54,758::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:19:54,777::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000622415 s, 598 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:19:54,779::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:54,780::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:54,781::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:54,781::__init__::232::IOProcess::(_processLogs) (201298) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:54,782::__init__::232::IOProcess::(_processLogs) (201298) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:55,125::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:55,126::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:55,127::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-10269::DEBUG::2014-10-29 11:19:55,129::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:19:55,129::__init__::232::IOProcess::(_processLogs) (201299) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:55,148::__init__::232::IOProcess::(_processLogs) (201299) Queuing response >Thread-10269::DEBUG::2014-10-29 11:19:55,150::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000793722 s, 632 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:19:55,151::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:55,151::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:55,152::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:55,152::__init__::232::IOProcess::(_processLogs) (201300) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:55,152::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201300) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:55,181::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:55,181::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:55,181::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:55,182::__init__::232::IOProcess::(_processLogs) (201301) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:55,183::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201301) Queuing response >Thread-178::DEBUG::2014-10-29 11:19:55,185::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:19:55,207::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000729286 s, 697 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:19:55,209::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:55,210::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:55,210::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:55,210::__init__::232::IOProcess::(_processLogs) (201302) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:55,211::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201302) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:55,213::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:55,213::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:55,214::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:55,214::__init__::232::IOProcess::(_processLogs) (201303) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:55,214::__init__::232::IOProcess::(_processLogs) (201303) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:55,215::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:55,216::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:55,216::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:55,216::__init__::232::IOProcess::(_processLogs) (201304) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:55,216::__init__::232::IOProcess::(_processLogs) (201304) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:55,219::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-17::DEBUG::2014-10-29 11:19:55,225::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >JsonRpcServer::DEBUG::2014-10-29 11:19:55,225::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:19:55,229::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:55,232::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:55,233::__init__::232::IOProcess::(_processLogs) (201305) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:55,235::__init__::232::IOProcess::(_processLogs) (201305) Queuing response >Thread-136576::DEBUG::2014-10-29 11:19:55,236::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:19:55,241::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:55,243::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:55,243::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:55,243::__init__::232::IOProcess::(_processLogs) (201306) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:55,245::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201306) Queuing response >Thread-33::DEBUG::2014-10-29 11:19:55,246::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:55,265::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:55,268::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-33::DEBUG::2014-10-29 11:19:55,273::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00315833 s, 154 kB/s\n'; <rc> = 0 >Thread-136577::DEBUG::2014-10-29 11:19:55,279::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:19:55,280::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:55,283::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:55,285::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:55,287::__init__::232::IOProcess::(_processLogs) (201307) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:19:55,294::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201307) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:55,298::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-136577::DEBUG::2014-10-29 11:19:55,299::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:19:55,300::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:55,302::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:55,303::__init__::232::IOProcess::(_processLogs) (201308) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:55,304::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201308) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:55,305::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:55,305::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:55,305::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:55,305::__init__::232::IOProcess::(_processLogs) (201309) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:55,306::__init__::232::IOProcess::(_processLogs) (201309) Queuing response >Thread-17::DEBUG::2014-10-29 11:19:55,307::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:19:55,307::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:19:55,307::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:19:55,308::__init__::232::IOProcess::(_processLogs) (201310) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:19:55,308::__init__::232::IOProcess::(_processLogs) (201310) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:55,459::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:55,460::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:19:55,462::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:58,338::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:58,340::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136578::DEBUG::2014-10-29 11:19:58,345::task::595::Storage.TaskManager.Task::(_updateState) Task=`9bebe64c-b602-40f0-ac3b-12785ab7053b`::moving from state init -> state preparing >Thread-136578::INFO::2014-10-29 11:19:58,345::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136578::INFO::2014-10-29 11:19:58,346::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729286', 'lastCheck': '3.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00315833', 'lastCheck': '3.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622415', 'lastCheck': '3.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000793722', 'lastCheck': '3.2', 'valid': True}} >Thread-136578::DEBUG::2014-10-29 11:19:58,347::task::1191::Storage.TaskManager.Task::(prepare) Task=`9bebe64c-b602-40f0-ac3b-12785ab7053b`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729286', 'lastCheck': '3.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00315833', 'lastCheck': '3.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622415', 'lastCheck': '3.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000793722', 'lastCheck': '3.2', 'valid': True}} >Thread-136578::DEBUG::2014-10-29 11:19:58,347::task::595::Storage.TaskManager.Task::(_updateState) Task=`9bebe64c-b602-40f0-ac3b-12785ab7053b`::moving from state preparing -> state finished >Thread-136578::DEBUG::2014-10-29 11:19:58,347::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136578::DEBUG::2014-10-29 11:19:58,347::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136578::DEBUG::2014-10-29 11:19:58,348::task::993::Storage.TaskManager.Task::(_decref) Task=`9bebe64c-b602-40f0-ac3b-12785ab7053b`::ref 0 aborting False >Thread-136578::DEBUG::2014-10-29 11:19:58,393::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:19:58,422::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:19:58,423::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136579::DEBUG::2014-10-29 11:19:58,427::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136579::DEBUG::2014-10-29 11:19:58,429::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:20:00,318::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54459 >Detector thread::DEBUG::2014-10-29 11:20:00,321::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54459 >Detector thread::DEBUG::2014-10-29 11:20:00,321::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54459 >Detector thread::DEBUG::2014-10-29 11:20:00,322::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54459) >Thread-136580::DEBUG::2014-10-29 11:20:00,360::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136580::DEBUG::2014-10-29 11:20:00,362::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136580::DEBUG::2014-10-29 11:20:00,382::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136580::DEBUG::2014-10-29 11:20:00,426::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '98', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '98', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:00,469::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:00,470::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:00,473::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:20:00,795::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54460 >Detector thread::DEBUG::2014-10-29 11:20:00,796::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54460 >Detector thread::DEBUG::2014-10-29 11:20:00,796::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54460 >Detector thread::DEBUG::2014-10-29 11:20:00,797::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54460) >Thread-136581::DEBUG::2014-10-29 11:20:00,836::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136581::DEBUG::2014-10-29 11:20:00,837::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136581::DEBUG::2014-10-29 11:20:00,838::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.72', 'elapsedTime': '514233', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '20599643', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '61131', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '32042.52'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.53', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:20:00,967::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54463 >Detector thread::DEBUG::2014-10-29 11:20:00,967::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54463 >Detector thread::DEBUG::2014-10-29 11:20:00,968::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54463 >Detector thread::DEBUG::2014-10-29 11:20:00,968::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54463) >Thread-136582::DEBUG::2014-10-29 11:20:01,008::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136582::DEBUG::2014-10-29 11:20:01,009::task::595::Storage.TaskManager.Task::(_updateState) Task=`94ca5994-04ec-4100-a613-b000fcd9d9b5`::moving from state init -> state preparing >Thread-136582::INFO::2014-10-29 11:20:01,009::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136582::DEBUG::2014-10-29 11:20:01,027::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:20:01,028::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:01,028::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:01,029::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-136582::DEBUG::2014-10-29 11:20:01,029::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:20:01,030::__init__::232::IOProcess::(_processLogs) (201311) Got request for method 'glob' >Thread-136582::DEBUG::2014-10-29 11:20:01,031::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136582::INFO::2014-10-29 11:20:01,032::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-17::DEBUG::2014-10-29 11:20:01,032::__init__::232::IOProcess::(_processLogs) (201311) Queuing response >Thread-136582::DEBUG::2014-10-29 11:20:01,033::task::1191::Storage.TaskManager.Task::(prepare) Task=`94ca5994-04ec-4100-a613-b000fcd9d9b5`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136582::DEBUG::2014-10-29 11:20:01,034::task::595::Storage.TaskManager.Task::(_updateState) Task=`94ca5994-04ec-4100-a613-b000fcd9d9b5`::moving from state preparing -> state finished >Thread-136582::DEBUG::2014-10-29 11:20:01,035::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136582::DEBUG::2014-10-29 11:20:01,035::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136582::DEBUG::2014-10-29 11:20:01,035::task::993::Storage.TaskManager.Task::(_decref) Task=`94ca5994-04ec-4100-a613-b000fcd9d9b5`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:20:01,077::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54464 >Detector thread::DEBUG::2014-10-29 11:20:01,078::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54464 >Detector thread::DEBUG::2014-10-29 11:20:01,078::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54464 >Detector thread::DEBUG::2014-10-29 11:20:01,078::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54464) >Detector thread::DEBUG::2014-10-29 11:20:01,094::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54465 >Detector thread::DEBUG::2014-10-29 11:20:01,094::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54465 >Detector thread::DEBUG::2014-10-29 11:20:01,095::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54465 >Detector thread::DEBUG::2014-10-29 11:20:01,095::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54465) >Thread-136583::DEBUG::2014-10-29 11:20:01,118::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8c40175-210c-4515-a2b4-620f5cde1ab8`::moving from state init -> state preparing >Thread-136583::INFO::2014-10-29 11:20:01,118::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136583::INFO::2014-10-29 11:20:01,119::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729286', 'lastCheck': '5.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00315833', 'lastCheck': '5.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622415', 'lastCheck': '6.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000793722', 'lastCheck': '6.0', 'valid': True}} >Thread-136583::DEBUG::2014-10-29 11:20:01,119::task::1191::Storage.TaskManager.Task::(prepare) Task=`f8c40175-210c-4515-a2b4-620f5cde1ab8`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729286', 'lastCheck': '5.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00315833', 'lastCheck': '5.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622415', 'lastCheck': '6.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000793722', 'lastCheck': '6.0', 'valid': True}} >Thread-136583::DEBUG::2014-10-29 11:20:01,119::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8c40175-210c-4515-a2b4-620f5cde1ab8`::moving from state preparing -> state finished >Thread-136583::DEBUG::2014-10-29 11:20:01,119::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136583::DEBUG::2014-10-29 11:20:01,120::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136583::DEBUG::2014-10-29 11:20:01,120::task::993::Storage.TaskManager.Task::(_decref) Task=`f8c40175-210c-4515-a2b4-620f5cde1ab8`::ref 0 aborting False >Thread-136584::DEBUG::2014-10-29 11:20:01,135::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136584::DEBUG::2014-10-29 11:20:01,137::task::595::Storage.TaskManager.Task::(_updateState) Task=`abae464d-06a0-4c9b-96b7-9dfb108f86b3`::moving from state init -> state preparing >Thread-136584::INFO::2014-10-29 11:20:01,137::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136584::DEBUG::2014-10-29 11:20:01,138::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136584::DEBUG::2014-10-29 11:20:01,138::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136584::DEBUG::2014-10-29 11:20:01,138::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136584::DEBUG::2014-10-29 11:20:01,138::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136584::DEBUG::2014-10-29 11:20:01,139::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136584::DEBUG::2014-10-29 11:20:01,139::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136584::DEBUG::2014-10-29 11:20:01,231::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136584::DEBUG::2014-10-29 11:20:01,231::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136584::DEBUG::2014-10-29 11:20:01,415::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136584::DEBUG::2014-10-29 11:20:01,416::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136584::DEBUG::2014-10-29 11:20:01,416::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136584::DEBUG::2014-10-29 11:20:01,416::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136584::DEBUG::2014-10-29 11:20:01,417::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136584::DEBUG::2014-10-29 11:20:01,417::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136584::DEBUG::2014-10-29 11:20:01,417::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136584::DEBUG::2014-10-29 11:20:01,418::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:20:01,426::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:01,428::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:01,428::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:01,429::__init__::232::IOProcess::(_processLogs) (201312) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:01,431::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201312) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:01,433::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:01,433::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:01,434::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:01,434::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:01,435::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:01,435::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:01,436::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:01,436::__init__::232::IOProcess::(_processLogs) (201313) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:01,436::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:01,436::__init__::232::IOProcess::(_processLogs) (201314) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:01,437::__init__::232::IOProcess::(_processLogs) (201313) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:01,437::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:01,437::__init__::232::IOProcess::(_processLogs) (201315) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:01,437::__init__::232::IOProcess::(_processLogs) (201314) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:01,438::__init__::232::IOProcess::(_processLogs) (201315) Queuing response >Thread-136584::DEBUG::2014-10-29 11:20:01,443::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:20:01,445::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:01,446::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:01,447::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:01,447::__init__::232::IOProcess::(_processLogs) (201316) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:20:01,449::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201316) Queuing response >Thread-136584::DEBUG::2014-10-29 11:20:01,450::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:20:01,452::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:01,452::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:01,452::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:01,452::__init__::232::IOProcess::(_processLogs) (201317) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:20:01,457::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201317) Queuing response >Thread-136584::DEBUG::2014-10-29 11:20:01,458::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:20:01,459::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:01,460::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:01,461::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:01,461::__init__::232::IOProcess::(_processLogs) (201318) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:01,462::__init__::232::IOProcess::(_processLogs) (201318) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:01,462::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:01,462::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:01,463::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:01,463::__init__::232::IOProcess::(_processLogs) (201319) Got request for method 'glob' >Thread-136584::DEBUG::2014-10-29 11:20:01,464::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:20:01,464::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201319) Queuing response >Thread-136584::INFO::2014-10-29 11:20:01,465::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136584::INFO::2014-10-29 11:20:01,466::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136584::INFO::2014-10-29 11:20:01,466::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:20:01,467::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:01,467::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:01,468::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:01,468::__init__::232::IOProcess::(_processLogs) (201320) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:20:01,469::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201320) Queuing response >Thread-136584::DEBUG::2014-10-29 11:20:01,469::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136584::DEBUG::2014-10-29 11:20:01,471::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`ceb43e02-568d-48b3-9fac-8192b410f2b9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136584::DEBUG::2014-10-29 11:20:01,471::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136584::DEBUG::2014-10-29 11:20:01,472::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136584::DEBUG::2014-10-29 11:20:01,472::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`ceb43e02-568d-48b3-9fac-8192b410f2b9`::Granted request >Thread-136584::DEBUG::2014-10-29 11:20:01,473::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`abae464d-06a0-4c9b-96b7-9dfb108f86b3`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136584::DEBUG::2014-10-29 11:20:01,473::task::993::Storage.TaskManager.Task::(_decref) Task=`abae464d-06a0-4c9b-96b7-9dfb108f86b3`::ref 1 aborting False >Thread-136584::INFO::2014-10-29 11:20:01,476::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136584::DEBUG::2014-10-29 11:20:01,476::task::1191::Storage.TaskManager.Task::(prepare) Task=`abae464d-06a0-4c9b-96b7-9dfb108f86b3`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136584::DEBUG::2014-10-29 11:20:01,476::task::595::Storage.TaskManager.Task::(_updateState) Task=`abae464d-06a0-4c9b-96b7-9dfb108f86b3`::moving from state preparing -> state finished >Thread-136584::DEBUG::2014-10-29 11:20:01,477::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136584::DEBUG::2014-10-29 11:20:01,477::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136584::DEBUG::2014-10-29 11:20:01,477::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136584::DEBUG::2014-10-29 11:20:01,478::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136584::DEBUG::2014-10-29 11:20:01,478::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136584::DEBUG::2014-10-29 11:20:01,478::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136584::DEBUG::2014-10-29 11:20:01,479::task::993::Storage.TaskManager.Task::(_decref) Task=`abae464d-06a0-4c9b-96b7-9dfb108f86b3`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:01,485::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-136589::DEBUG::2014-10-29 11:20:01,491::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpcServer::DEBUG::2014-10-29 11:20:01,488::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:01,495::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:01,505::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Detector thread::DEBUG::2014-10-29 11:20:01,508::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54466 >Detector thread::DEBUG::2014-10-29 11:20:01,509::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54466 >Detector thread::DEBUG::2014-10-29 11:20:01,510::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54466 >Detector thread::DEBUG::2014-10-29 11:20:01,510::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54466) >Thread-136590::DEBUG::2014-10-29 11:20:01,516::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136590::DEBUG::2014-10-29 11:20:01,519::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-136591::DEBUG::2014-10-29 11:20:01,548::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136591::DEBUG::2014-10-29 11:20:01,549::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf467918-b32d-4771-bc5e-236541154dc0`::moving from state init -> state preparing >Thread-136591::INFO::2014-10-29 11:20:01,549::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136591::INFO::2014-10-29 11:20:01,550::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729286', 'lastCheck': '6.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00315833', 'lastCheck': '6.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622415', 'lastCheck': '6.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000793722', 'lastCheck': '6.4', 'valid': True}} >Thread-136591::DEBUG::2014-10-29 11:20:01,550::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf467918-b32d-4771-bc5e-236541154dc0`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729286', 'lastCheck': '6.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00315833', 'lastCheck': '6.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622415', 'lastCheck': '6.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000793722', 'lastCheck': '6.4', 'valid': True}} >Thread-136591::DEBUG::2014-10-29 11:20:01,551::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf467918-b32d-4771-bc5e-236541154dc0`::moving from state preparing -> state finished >Thread-136591::DEBUG::2014-10-29 11:20:01,551::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136591::DEBUG::2014-10-29 11:20:01,551::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136591::DEBUG::2014-10-29 11:20:01,551::task::993::Storage.TaskManager.Task::(_decref) Task=`cf467918-b32d-4771-bc5e-236541154dc0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-10-29 11:20:04,166::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >Thread-22::DEBUG::2014-10-29 11:20:04,343::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:04,538::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:04,540::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136592::DEBUG::2014-10-29 11:20:04,544::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:04,546::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:04,548::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136593::DEBUG::2014-10-29 11:20:04,551::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136593::DEBUG::2014-10-29 11:20:04,554::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:20:04,785::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:04,787::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:04,787::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:04,787::__init__::232::IOProcess::(_processLogs) (201321) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:04,788::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201321) Queuing response >Thread-179::DEBUG::2014-10-29 11:20:04,790::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:20:04,807::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000436539 s, 852 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:20:04,809::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:04,809::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:04,810::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:04,810::__init__::232::IOProcess::(_processLogs) (201322) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:04,810::__init__::232::IOProcess::(_processLogs) (201322) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:05,155::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:05,156::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:05,156::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:05,156::__init__::232::IOProcess::(_processLogs) (201323) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:05,157::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201323) Queuing response >Thread-10269::DEBUG::2014-10-29 11:20:05,159::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:20:05,177::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000548104 s, 916 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:20:05,179::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:05,179::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:05,180::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:05,180::__init__::232::IOProcess::(_processLogs) (201324) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:05,182::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201324) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:05,243::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:05,244::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:05,244::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:05,244::__init__::232::IOProcess::(_processLogs) (201325) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:05,246::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201325) Queuing response >Thread-178::DEBUG::2014-10-29 11:20:05,247::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:20:05,265::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000524483 s, 969 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:20:05,267::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:05,267::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:05,269::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:05,270::__init__::232::IOProcess::(_processLogs) (201326) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:05,271::__init__::232::IOProcess::(_processLogs) (201326) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:05,271::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:05,272::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:05,272::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:05,273::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201327) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:05,273::__init__::232::IOProcess::(_processLogs) (201327) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:05,274::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:05,274::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:05,274::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:05,275::__init__::232::IOProcess::(_processLogs) (201328) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:05,276::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201328) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:05,276::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:05,277::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:05,277::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:05,277::__init__::232::IOProcess::(_processLogs) (201329) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:05,278::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201329) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:05,310::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:05,310::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:05,312::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-33::DEBUG::2014-10-29 11:20:05,313::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:20:05,313::__init__::232::IOProcess::(_processLogs) (201330) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:05,329::__init__::232::IOProcess::(_processLogs) (201330) Queuing response >Thread-33::DEBUG::2014-10-29 11:20:05,331::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.0005249 s, 928 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:20:05,332::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:05,333::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:05,333::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:05,333::__init__::232::IOProcess::(_processLogs) (201331) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:05,333::__init__::232::IOProcess::(_processLogs) (201331) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:05,336::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:05,336::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:05,336::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:05,337::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201332) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:05,338::__init__::232::IOProcess::(_processLogs) (201332) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:05,338::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:05,339::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:05,339::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:05,339::__init__::232::IOProcess::(_processLogs) (201333) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:05,340::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201333) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:05,341::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:05,341::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:05,341::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:05,342::__init__::232::IOProcess::(_processLogs) (201334) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:05,342::__init__::232::IOProcess::(_processLogs) (201334) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:05,481::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:05,483::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:05,484::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:07,580::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:07,583::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136594::DEBUG::2014-10-29 11:20:07,587::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:07,590::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:07,592::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136595::DEBUG::2014-10-29 11:20:07,595::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136595::DEBUG::2014-10-29 11:20:07,599::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:20:10,478::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54467 >Detector thread::DEBUG::2014-10-29 11:20:10,479::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54467 >Detector thread::DEBUG::2014-10-29 11:20:10,479::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54467 >Detector thread::DEBUG::2014-10-29 11:20:10,479::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54467) >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:10,488::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:10,490::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:10,491::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136596::DEBUG::2014-10-29 11:20:10,518::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136596::DEBUG::2014-10-29 11:20:10,520::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136596::DEBUG::2014-10-29 11:20:10,541::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136596::DEBUG::2014-10-29 11:20:10,591::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '82', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '82', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:10,613::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:10,616::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136597::DEBUG::2014-10-29 11:20:10,620::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:10,623::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:10,625::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136598::DEBUG::2014-10-29 11:20:10,627::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136598::DEBUG::2014-10-29 11:20:10,630::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:20:10,985::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54468 >Detector thread::DEBUG::2014-10-29 11:20:10,986::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54468 >Detector thread::DEBUG::2014-10-29 11:20:10,986::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54468 >Detector thread::DEBUG::2014-10-29 11:20:10,986::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54468) >Thread-136599::DEBUG::2014-10-29 11:20:11,025::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136599::DEBUG::2014-10-29 11:20:11,026::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136599::DEBUG::2014-10-29 11:20:11,027::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '10.06', 'elapsedTime': '514243', 'displayType': 'vnc', 'cpuSys': '2.05', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '20599643', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '61131', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '32042.52'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.68', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:20:11,203::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54470 >Detector thread::DEBUG::2014-10-29 11:20:11,204::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54470 >Detector thread::DEBUG::2014-10-29 11:20:11,204::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54470 >Detector thread::DEBUG::2014-10-29 11:20:11,205::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54470) >Thread-136600::DEBUG::2014-10-29 11:20:11,244::task::595::Storage.TaskManager.Task::(_updateState) Task=`3736f461-71b6-4066-81d5-85e08b8e7b85`::moving from state init -> state preparing >Thread-136600::INFO::2014-10-29 11:20:11,244::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136600::INFO::2014-10-29 11:20:11,245::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524483', 'lastCheck': '6.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0005249', 'lastCheck': '5.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436539', 'lastCheck': '6.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000548104', 'lastCheck': '6.1', 'valid': True}} >Thread-136600::DEBUG::2014-10-29 11:20:11,245::task::1191::Storage.TaskManager.Task::(prepare) Task=`3736f461-71b6-4066-81d5-85e08b8e7b85`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524483', 'lastCheck': '6.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0005249', 'lastCheck': '5.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436539', 'lastCheck': '6.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000548104', 'lastCheck': '6.1', 'valid': True}} >Thread-136600::DEBUG::2014-10-29 11:20:11,246::task::595::Storage.TaskManager.Task::(_updateState) Task=`3736f461-71b6-4066-81d5-85e08b8e7b85`::moving from state preparing -> state finished >Thread-136600::DEBUG::2014-10-29 11:20:11,246::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136600::DEBUG::2014-10-29 11:20:11,246::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136600::DEBUG::2014-10-29 11:20:11,246::task::993::Storage.TaskManager.Task::(_decref) Task=`3736f461-71b6-4066-81d5-85e08b8e7b85`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:20:12,236::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54472 >Detector thread::DEBUG::2014-10-29 11:20:12,238::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54472 >Detector thread::DEBUG::2014-10-29 11:20:12,239::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54472 >Detector thread::DEBUG::2014-10-29 11:20:12,239::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54472) >Thread-136601::DEBUG::2014-10-29 11:20:12,276::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136601::DEBUG::2014-10-29 11:20:12,277::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f4a4b98-adf5-41ed-bebb-0b3e394dbee6`::moving from state init -> state preparing >Thread-136601::INFO::2014-10-29 11:20:12,278::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136601::DEBUG::2014-10-29 11:20:12,290::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:20:12,293::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:12,294::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:12,294::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:12,294::__init__::232::IOProcess::(_processLogs) (201335) Got request for method 'glob' >Thread-136601::DEBUG::2014-10-29 11:20:12,296::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:20:12,296::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201335) Queuing response >Thread-136601::DEBUG::2014-10-29 11:20:12,298::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136601::INFO::2014-10-29 11:20:12,299::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136601::DEBUG::2014-10-29 11:20:12,299::task::1191::Storage.TaskManager.Task::(prepare) Task=`6f4a4b98-adf5-41ed-bebb-0b3e394dbee6`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136601::DEBUG::2014-10-29 11:20:12,299::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f4a4b98-adf5-41ed-bebb-0b3e394dbee6`::moving from state preparing -> state finished >Thread-136601::DEBUG::2014-10-29 11:20:12,300::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136601::DEBUG::2014-10-29 11:20:12,300::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136601::DEBUG::2014-10-29 11:20:12,301::task::993::Storage.TaskManager.Task::(_decref) Task=`6f4a4b98-adf5-41ed-bebb-0b3e394dbee6`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:20:12,364::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54473 >Detector thread::DEBUG::2014-10-29 11:20:12,365::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54473 >Detector thread::DEBUG::2014-10-29 11:20:12,365::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54473 >Detector thread::DEBUG::2014-10-29 11:20:12,366::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54473) >Thread-136602::DEBUG::2014-10-29 11:20:12,404::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136602::DEBUG::2014-10-29 11:20:12,405::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef7f5dd6-5b58-428b-8644-af9bc784570f`::moving from state init -> state preparing >Thread-136602::INFO::2014-10-29 11:20:12,405::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136602::DEBUG::2014-10-29 11:20:12,406::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136602::DEBUG::2014-10-29 11:20:12,406::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136602::DEBUG::2014-10-29 11:20:12,406::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136602::DEBUG::2014-10-29 11:20:12,407::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136602::DEBUG::2014-10-29 11:20:12,407::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136602::DEBUG::2014-10-29 11:20:12,407::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136602::DEBUG::2014-10-29 11:20:12,505::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136602::DEBUG::2014-10-29 11:20:12,506::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136602::DEBUG::2014-10-29 11:20:12,741::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136602::DEBUG::2014-10-29 11:20:12,742::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136602::DEBUG::2014-10-29 11:20:12,742::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136602::DEBUG::2014-10-29 11:20:12,742::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136602::DEBUG::2014-10-29 11:20:12,743::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136602::DEBUG::2014-10-29 11:20:12,743::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136602::DEBUG::2014-10-29 11:20:12,744::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136602::DEBUG::2014-10-29 11:20:12,744::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:20:12,750::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:12,752::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:12,754::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:12,755::__init__::232::IOProcess::(_processLogs) (201336) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:12,756::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201336) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:12,757::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:12,758::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:12,760::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:12,762::__init__::232::IOProcess::(_processLogs) (201337) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:12,764::__init__::232::IOProcess::(_processLogs) (201337) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:12,766::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:12,768::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:12,770::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-136602::DEBUG::2014-10-29 11:20:12,771::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:20:12,772::__init__::232::IOProcess::(_processLogs) (201338) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:12,774::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201338) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:12,775::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:12,775::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:12,776::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:12,776::__init__::232::IOProcess::(_processLogs) (201339) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:12,776::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:12,777::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:12,777::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:12,777::__init__::232::IOProcess::(_processLogs) (201340) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:20:12,778::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201339) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:12,782::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201340) Queuing response >Thread-136602::DEBUG::2014-10-29 11:20:12,783::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:20:12,785::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:12,785::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:12,785::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:12,786::__init__::232::IOProcess::(_processLogs) (201341) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:20:12,787::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201341) Queuing response >Thread-136602::DEBUG::2014-10-29 11:20:12,787::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:20:12,789::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:12,789::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:12,790::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:12,790::__init__::232::IOProcess::(_processLogs) (201342) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:12,791::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201342) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:12,792::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:12,792::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:12,793::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-136602::DEBUG::2014-10-29 11:20:12,793::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:20:12,794::__init__::232::IOProcess::(_processLogs) (201343) Got request for method 'glob' >Thread-136602::INFO::2014-10-29 11:20:12,794::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136602::INFO::2014-10-29 11:20:12,796::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:20:12,796::__init__::232::IOProcess::(_processLogs) (201343) Queuing response >Thread-136602::INFO::2014-10-29 11:20:12,797::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:20:12,798::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:12,798::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:12,799::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:12,799::__init__::232::IOProcess::(_processLogs) (201344) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:20:12,800::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201344) Queuing response >Thread-136602::DEBUG::2014-10-29 11:20:12,800::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136602::DEBUG::2014-10-29 11:20:12,802::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`65b03831-bf46-4948-aa06-fc52c7105bc6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136602::DEBUG::2014-10-29 11:20:12,802::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136602::DEBUG::2014-10-29 11:20:12,803::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136602::DEBUG::2014-10-29 11:20:12,803::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`65b03831-bf46-4948-aa06-fc52c7105bc6`::Granted request >Thread-136602::DEBUG::2014-10-29 11:20:12,804::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ef7f5dd6-5b58-428b-8644-af9bc784570f`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136602::DEBUG::2014-10-29 11:20:12,805::task::993::Storage.TaskManager.Task::(_decref) Task=`ef7f5dd6-5b58-428b-8644-af9bc784570f`::ref 1 aborting False >Thread-136602::INFO::2014-10-29 11:20:12,808::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136602::DEBUG::2014-10-29 11:20:12,809::task::1191::Storage.TaskManager.Task::(prepare) Task=`ef7f5dd6-5b58-428b-8644-af9bc784570f`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136602::DEBUG::2014-10-29 11:20:12,809::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef7f5dd6-5b58-428b-8644-af9bc784570f`::moving from state preparing -> state finished >Thread-136602::DEBUG::2014-10-29 11:20:12,809::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136602::DEBUG::2014-10-29 11:20:12,810::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136602::DEBUG::2014-10-29 11:20:12,810::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136602::DEBUG::2014-10-29 11:20:12,811::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136602::DEBUG::2014-10-29 11:20:12,811::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136602::DEBUG::2014-10-29 11:20:12,811::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136602::DEBUG::2014-10-29 11:20:12,812::task::993::Storage.TaskManager.Task::(_decref) Task=`ef7f5dd6-5b58-428b-8644-af9bc784570f`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:20:12,835::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54474 >Detector thread::DEBUG::2014-10-29 11:20:12,836::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54474 >Detector thread::DEBUG::2014-10-29 11:20:12,836::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54474 >Detector thread::DEBUG::2014-10-29 11:20:12,837::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54474) >Thread-136607::DEBUG::2014-10-29 11:20:12,875::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136607::DEBUG::2014-10-29 11:20:12,875::task::595::Storage.TaskManager.Task::(_updateState) Task=`5038fadf-7ca9-4dba-8ebb-242b1a707100`::moving from state init -> state preparing >Thread-136607::INFO::2014-10-29 11:20:12,876::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136607::INFO::2014-10-29 11:20:12,877::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524483', 'lastCheck': '7.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0005249', 'lastCheck': '7.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436539', 'lastCheck': '8.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000548104', 'lastCheck': '7.7', 'valid': True}} >Thread-136607::DEBUG::2014-10-29 11:20:12,877::task::1191::Storage.TaskManager.Task::(prepare) Task=`5038fadf-7ca9-4dba-8ebb-242b1a707100`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524483', 'lastCheck': '7.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0005249', 'lastCheck': '7.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436539', 'lastCheck': '8.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000548104', 'lastCheck': '7.7', 'valid': True}} >Thread-136607::DEBUG::2014-10-29 11:20:12,877::task::595::Storage.TaskManager.Task::(_updateState) Task=`5038fadf-7ca9-4dba-8ebb-242b1a707100`::moving from state preparing -> state finished >Thread-136607::DEBUG::2014-10-29 11:20:12,877::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136607::DEBUG::2014-10-29 11:20:12,878::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136607::DEBUG::2014-10-29 11:20:12,878::task::993::Storage.TaskManager.Task::(_decref) Task=`5038fadf-7ca9-4dba-8ebb-242b1a707100`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:13,643::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:13,646::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136608::DEBUG::2014-10-29 11:20:13,650::task::595::Storage.TaskManager.Task::(_updateState) Task=`9f032dfa-40fe-4bc6-8949-b1a9cf4ce63d`::moving from state init -> state preparing >Thread-136608::INFO::2014-10-29 11:20:13,651::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136608::INFO::2014-10-29 11:20:13,651::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524483', 'lastCheck': '8.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0005249', 'lastCheck': '8.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436539', 'lastCheck': '8.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000548104', 'lastCheck': '8.5', 'valid': True}} >Thread-136608::DEBUG::2014-10-29 11:20:13,651::task::1191::Storage.TaskManager.Task::(prepare) Task=`9f032dfa-40fe-4bc6-8949-b1a9cf4ce63d`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000524483', 'lastCheck': '8.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0005249', 'lastCheck': '8.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436539', 'lastCheck': '8.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000548104', 'lastCheck': '8.5', 'valid': True}} >Thread-136608::DEBUG::2014-10-29 11:20:13,652::task::595::Storage.TaskManager.Task::(_updateState) Task=`9f032dfa-40fe-4bc6-8949-b1a9cf4ce63d`::moving from state preparing -> state finished >Thread-136608::DEBUG::2014-10-29 11:20:13,652::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136608::DEBUG::2014-10-29 11:20:13,652::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136608::DEBUG::2014-10-29 11:20:13,653::task::993::Storage.TaskManager.Task::(_decref) Task=`9f032dfa-40fe-4bc6-8949-b1a9cf4ce63d`::ref 0 aborting False >Thread-136608::DEBUG::2014-10-29 11:20:13,676::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:13,702::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:13,704::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136609::DEBUG::2014-10-29 11:20:13,707::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136609::DEBUG::2014-10-29 11:20:13,709::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:20:14,816::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:14,817::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:14,817::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:14,817::__init__::232::IOProcess::(_processLogs) (201345) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:14,819::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201345) Queuing response >Thread-179::DEBUG::2014-10-29 11:20:14,820::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:20:14,838::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000468379 s, 794 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:20:14,840::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:14,841::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:14,841::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:14,841::__init__::232::IOProcess::(_processLogs) (201346) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:14,842::__init__::232::IOProcess::(_processLogs) (201346) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:15,184::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:15,184::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:15,185::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:15,185::__init__::232::IOProcess::(_processLogs) (201347) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:15,186::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201347) Queuing response >Thread-10269::DEBUG::2014-10-29 11:20:15,188::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:20:15,204::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000499941 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:20:15,206::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:15,207::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:15,207::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:15,207::__init__::232::IOProcess::(_processLogs) (201348) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:15,209::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201348) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:15,280::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:15,280::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:15,280::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:15,281::__init__::232::IOProcess::(_processLogs) (201349) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:15,282::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201349) Queuing response >Thread-178::DEBUG::2014-10-29 11:20:15,283::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:20:15,300::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000423361 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:20:15,301::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:15,304::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:15,305::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:15,305::__init__::232::IOProcess::(_processLogs) (201350) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:15,305::__init__::232::IOProcess::(_processLogs) (201350) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:15,306::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:15,306::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:15,306::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:15,307::__init__::232::IOProcess::(_processLogs) (201351) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:15,308::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201351) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:15,308::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:15,309::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:15,309::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:15,309::__init__::232::IOProcess::(_processLogs) (201352) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:15,310::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201352) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:15,311::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:15,312::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:15,312::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:15,312::__init__::232::IOProcess::(_processLogs) (201353) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:15,313::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201353) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:15,344::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:15,345::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:15,345::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:15,345::__init__::232::IOProcess::(_processLogs) (201354) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:15,347::__init__::232::IOProcess::(_processLogs) (201354) Queuing response >Thread-33::DEBUG::2014-10-29 11:20:15,348::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:20:15,367::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000539133 s, 903 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:20:15,369::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:15,369::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:15,371::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:15,373::__init__::232::IOProcess::(_processLogs) (201355) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:15,373::__init__::232::IOProcess::(_processLogs) (201355) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:15,373::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:15,374::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:15,375::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:15,376::__init__::232::IOProcess::(_processLogs) (201356) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:15,376::__init__::232::IOProcess::(_processLogs) (201356) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:15,376::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:15,377::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:15,378::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:15,378::__init__::232::IOProcess::(_processLogs) (201357) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:15,379::__init__::232::IOProcess::(_processLogs) (201357) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:15,379::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:15,379::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:15,380::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:15,380::__init__::232::IOProcess::(_processLogs) (201358) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:15,381::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201358) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:15,498::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:15,499::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:15,501::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:16,758::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:16,764::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136610::DEBUG::2014-10-29 11:20:16,773::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:16,779::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:16,784::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136611::DEBUG::2014-10-29 11:20:16,792::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136611::DEBUG::2014-10-29 11:20:16,810::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:20:19,368::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:19,831::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:19,834::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136612::DEBUG::2014-10-29 11:20:19,837::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:19,840::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:19,842::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136613::DEBUG::2014-10-29 11:20:19,845::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136613::DEBUG::2014-10-29 11:20:19,847::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:20:20,321::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54475 >Detector thread::DEBUG::2014-10-29 11:20:20,321::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54475 >Detector thread::DEBUG::2014-10-29 11:20:20,321::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54475 >Detector thread::DEBUG::2014-10-29 11:20:20,322::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54475) >Thread-136614::DEBUG::2014-10-29 11:20:20,362::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ce84464-aec7-4fed-aa82-84b5d036eedd`::moving from state init -> state preparing >Thread-136614::INFO::2014-10-29 11:20:20,362::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136614::INFO::2014-10-29 11:20:20,363::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000423361', 'lastCheck': '5.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539133', 'lastCheck': '5.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468379', 'lastCheck': '5.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000499941', 'lastCheck': '5.2', 'valid': True}} >Thread-136614::DEBUG::2014-10-29 11:20:20,363::task::1191::Storage.TaskManager.Task::(prepare) Task=`4ce84464-aec7-4fed-aa82-84b5d036eedd`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000423361', 'lastCheck': '5.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539133', 'lastCheck': '5.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468379', 'lastCheck': '5.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000499941', 'lastCheck': '5.2', 'valid': True}} >Thread-136614::DEBUG::2014-10-29 11:20:20,364::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ce84464-aec7-4fed-aa82-84b5d036eedd`::moving from state preparing -> state finished >Thread-136614::DEBUG::2014-10-29 11:20:20,364::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136614::DEBUG::2014-10-29 11:20:20,364::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136614::DEBUG::2014-10-29 11:20:20,364::task::993::Storage.TaskManager.Task::(_decref) Task=`4ce84464-aec7-4fed-aa82-84b5d036eedd`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:20,508::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:20,509::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:20,510::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:20:20,650::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54476 >Detector thread::DEBUG::2014-10-29 11:20:20,651::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54476 >Detector thread::DEBUG::2014-10-29 11:20:20,651::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54476 >Detector thread::DEBUG::2014-10-29 11:20:20,652::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54476) >Thread-136615::DEBUG::2014-10-29 11:20:20,691::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136615::DEBUG::2014-10-29 11:20:20,693::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136615::DEBUG::2014-10-29 11:20:20,712::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136615::DEBUG::2014-10-29 11:20:20,758::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '65', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '65', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:20:21,187::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54477 >Detector thread::DEBUG::2014-10-29 11:20:21,188::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54477 >Detector thread::DEBUG::2014-10-29 11:20:21,188::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54477 >Detector thread::DEBUG::2014-10-29 11:20:21,189::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54477) >Thread-136616::DEBUG::2014-10-29 11:20:21,227::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136616::DEBUG::2014-10-29 11:20:21,228::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136616::DEBUG::2014-10-29 11:20:21,229::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.33', 'elapsedTime': '514253', 'displayType': 'vnc', 'cpuSys': '0.87', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '20599643', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '61131', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '32042.52'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.88', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:22,862::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:22,865::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136617::DEBUG::2014-10-29 11:20:22,870::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:22,873::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:22,875::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136618::DEBUG::2014-10-29 11:20:22,879::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136618::DEBUG::2014-10-29 11:20:22,882::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:20:23,476::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54480 >Detector thread::DEBUG::2014-10-29 11:20:23,477::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54480 >Detector thread::DEBUG::2014-10-29 11:20:23,477::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54480 >Detector thread::DEBUG::2014-10-29 11:20:23,477::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54480) >Thread-136619::DEBUG::2014-10-29 11:20:23,517::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136619::DEBUG::2014-10-29 11:20:23,518::task::595::Storage.TaskManager.Task::(_updateState) Task=`6be66ae0-d113-4166-8192-258c27477c7b`::moving from state init -> state preparing >Thread-136619::INFO::2014-10-29 11:20:23,518::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136619::DEBUG::2014-10-29 11:20:23,521::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:20:23,522::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:23,522::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:23,523::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:23,523::__init__::232::IOProcess::(_processLogs) (201359) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:23,524::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201359) Queuing response >Thread-136619::DEBUG::2014-10-29 11:20:23,524::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136619::DEBUG::2014-10-29 11:20:23,525::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136619::INFO::2014-10-29 11:20:23,526::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136619::DEBUG::2014-10-29 11:20:23,526::task::1191::Storage.TaskManager.Task::(prepare) Task=`6be66ae0-d113-4166-8192-258c27477c7b`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136619::DEBUG::2014-10-29 11:20:23,526::task::595::Storage.TaskManager.Task::(_updateState) Task=`6be66ae0-d113-4166-8192-258c27477c7b`::moving from state preparing -> state finished >Thread-136619::DEBUG::2014-10-29 11:20:23,526::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136619::DEBUG::2014-10-29 11:20:23,527::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136619::DEBUG::2014-10-29 11:20:23,527::task::993::Storage.TaskManager.Task::(_decref) Task=`6be66ae0-d113-4166-8192-258c27477c7b`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:20:23,570::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54481 >Detector thread::DEBUG::2014-10-29 11:20:23,571::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54481 >Detector thread::DEBUG::2014-10-29 11:20:23,571::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54481 >Detector thread::DEBUG::2014-10-29 11:20:23,572::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54481) >Thread-136620::DEBUG::2014-10-29 11:20:23,610::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136620::DEBUG::2014-10-29 11:20:23,610::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b215941-d632-427e-a6ab-7ae0ecc8a244`::moving from state init -> state preparing >Thread-136620::INFO::2014-10-29 11:20:23,611::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136620::DEBUG::2014-10-29 11:20:23,611::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136620::DEBUG::2014-10-29 11:20:23,611::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136620::DEBUG::2014-10-29 11:20:23,612::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136620::DEBUG::2014-10-29 11:20:23,612::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136620::DEBUG::2014-10-29 11:20:23,612::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136620::DEBUG::2014-10-29 11:20:23,613::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136620::DEBUG::2014-10-29 11:20:23,705::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136620::DEBUG::2014-10-29 11:20:23,706::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136620::DEBUG::2014-10-29 11:20:23,881::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136620::DEBUG::2014-10-29 11:20:23,883::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136620::DEBUG::2014-10-29 11:20:23,884::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136620::DEBUG::2014-10-29 11:20:23,885::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136620::DEBUG::2014-10-29 11:20:23,885::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136620::DEBUG::2014-10-29 11:20:23,886::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136620::DEBUG::2014-10-29 11:20:23,886::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136620::DEBUG::2014-10-29 11:20:23,886::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:20:23,893::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:23,896::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:23,896::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:23,896::__init__::232::IOProcess::(_processLogs) (201360) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:23,897::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201360) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:23,899::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:23,899::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:23,899::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:23,900::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:23,900::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:23,900::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:23,900::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:23,901::__init__::232::IOProcess::(_processLogs) (201361) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:23,901::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:23,901::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:23,901::__init__::232::IOProcess::(_processLogs) (201362) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:23,902::__init__::232::IOProcess::(_processLogs) (201363) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:23,902::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201363) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:23,903::__init__::232::IOProcess::(_processLogs) (201361) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:23,904::__init__::232::IOProcess::(_processLogs) (201362) Queuing response >Thread-136620::DEBUG::2014-10-29 11:20:23,910::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:20:23,911::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:23,911::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:23,912::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:23,912::__init__::232::IOProcess::(_processLogs) (201364) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:20:23,913::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201364) Queuing response >Thread-136620::DEBUG::2014-10-29 11:20:23,914::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:20:23,915::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:23,915::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:23,916::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:23,916::__init__::232::IOProcess::(_processLogs) (201365) Got request for method 'readfile' >Thread-136620::DEBUG::2014-10-29 11:20:23,917::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:20:23,917::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201365) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:23,919::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:23,920::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:23,921::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:23,921::__init__::232::IOProcess::(_processLogs) (201366) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:23,921::__init__::232::IOProcess::(_processLogs) (201366) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:23,922::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:23,922::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:23,922::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:23,922::__init__::232::IOProcess::(_processLogs) (201367) Got request for method 'glob' >Thread-136620::DEBUG::2014-10-29 11:20:23,923::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:20:23,923::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201367) Queuing response >Thread-136620::INFO::2014-10-29 11:20:23,924::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136620::INFO::2014-10-29 11:20:23,925::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136620::INFO::2014-10-29 11:20:23,925::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:20:23,926::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:23,926::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:23,927::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:23,927::__init__::232::IOProcess::(_processLogs) (201368) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:20:23,927::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201368) Queuing response >Thread-136620::DEBUG::2014-10-29 11:20:23,928::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136620::DEBUG::2014-10-29 11:20:23,929::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`2f7f88cc-d58d-4830-9e4b-5ef305da25bb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136620::DEBUG::2014-10-29 11:20:23,930::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136620::DEBUG::2014-10-29 11:20:23,930::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136620::DEBUG::2014-10-29 11:20:23,930::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`2f7f88cc-d58d-4830-9e4b-5ef305da25bb`::Granted request >Thread-136620::DEBUG::2014-10-29 11:20:23,931::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8b215941-d632-427e-a6ab-7ae0ecc8a244`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136620::DEBUG::2014-10-29 11:20:23,931::task::993::Storage.TaskManager.Task::(_decref) Task=`8b215941-d632-427e-a6ab-7ae0ecc8a244`::ref 1 aborting False >Thread-136620::INFO::2014-10-29 11:20:23,934::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136620::DEBUG::2014-10-29 11:20:23,934::task::1191::Storage.TaskManager.Task::(prepare) Task=`8b215941-d632-427e-a6ab-7ae0ecc8a244`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136620::DEBUG::2014-10-29 11:20:23,935::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b215941-d632-427e-a6ab-7ae0ecc8a244`::moving from state preparing -> state finished >Thread-136620::DEBUG::2014-10-29 11:20:23,935::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136620::DEBUG::2014-10-29 11:20:23,935::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136620::DEBUG::2014-10-29 11:20:23,936::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136620::DEBUG::2014-10-29 11:20:23,936::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136620::DEBUG::2014-10-29 11:20:23,936::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136620::DEBUG::2014-10-29 11:20:23,936::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136620::DEBUG::2014-10-29 11:20:23,937::task::993::Storage.TaskManager.Task::(_decref) Task=`8b215941-d632-427e-a6ab-7ae0ecc8a244`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:20:23,969::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54482 >Detector thread::DEBUG::2014-10-29 11:20:23,970::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54482 >Detector thread::DEBUG::2014-10-29 11:20:23,971::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54482 >Detector thread::DEBUG::2014-10-29 11:20:23,971::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54482) >Thread-136625::DEBUG::2014-10-29 11:20:24,011::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136625::DEBUG::2014-10-29 11:20:24,012::task::595::Storage.TaskManager.Task::(_updateState) Task=`ec0d22ed-7e5a-4531-a947-c56252789b37`::moving from state init -> state preparing >Thread-136625::INFO::2014-10-29 11:20:24,012::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136625::INFO::2014-10-29 11:20:24,013::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000423361', 'lastCheck': '8.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539133', 'lastCheck': '8.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468379', 'lastCheck': '9.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000499941', 'lastCheck': '8.8', 'valid': True}} >Thread-136625::DEBUG::2014-10-29 11:20:24,013::task::1191::Storage.TaskManager.Task::(prepare) Task=`ec0d22ed-7e5a-4531-a947-c56252789b37`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000423361', 'lastCheck': '8.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539133', 'lastCheck': '8.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468379', 'lastCheck': '9.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000499941', 'lastCheck': '8.8', 'valid': True}} >Thread-136625::DEBUG::2014-10-29 11:20:24,013::task::595::Storage.TaskManager.Task::(_updateState) Task=`ec0d22ed-7e5a-4531-a947-c56252789b37`::moving from state preparing -> state finished >Thread-136625::DEBUG::2014-10-29 11:20:24,013::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136625::DEBUG::2014-10-29 11:20:24,014::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136625::DEBUG::2014-10-29 11:20:24,014::task::993::Storage.TaskManager.Task::(_decref) Task=`ec0d22ed-7e5a-4531-a947-c56252789b37`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:20:24,847::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:24,847::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:24,848::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:24,848::__init__::232::IOProcess::(_processLogs) (201369) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:24,849::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201369) Queuing response >Thread-179::DEBUG::2014-10-29 11:20:24,851::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:20:24,872::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000743151 s, 501 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:20:24,873::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:24,874::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:24,874::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:24,874::__init__::232::IOProcess::(_processLogs) (201370) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:24,876::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201370) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:25,212::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:25,212::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:25,212::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:25,213::__init__::232::IOProcess::(_processLogs) (201371) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:25,214::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201371) Queuing response >Thread-10269::DEBUG::2014-10-29 11:20:25,216::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:20:25,232::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000432321 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:20:25,234::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:25,234::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:25,237::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:25,239::__init__::232::IOProcess::(_processLogs) (201372) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:25,239::__init__::232::IOProcess::(_processLogs) (201372) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:25,315::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:25,315::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:25,316::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-178::DEBUG::2014-10-29 11:20:25,318::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:20:25,318::__init__::232::IOProcess::(_processLogs) (201373) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:25,334::__init__::232::IOProcess::(_processLogs) (201373) Queuing response >Thread-178::DEBUG::2014-10-29 11:20:25,336::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000589809 s, 861 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:20:25,338::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:25,338::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:25,339::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:25,339::__init__::232::IOProcess::(_processLogs) (201374) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:25,340::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201374) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:25,343::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:25,344::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:25,344::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:25,345::__init__::232::IOProcess::(_processLogs) (201375) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:25,345::__init__::232::IOProcess::(_processLogs) (201375) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:25,346::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:25,346::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:25,347::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:25,348::__init__::232::IOProcess::(_processLogs) (201376) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:25,348::__init__::232::IOProcess::(_processLogs) (201376) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:25,348::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:25,349::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:25,349::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:25,349::__init__::232::IOProcess::(_processLogs) (201377) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:25,350::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201377) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:25,384::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:25,384::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:25,385::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:25,385::__init__::232::IOProcess::(_processLogs) (201378) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:25,387::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201378) Queuing response >Thread-33::DEBUG::2014-10-29 11:20:25,388::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:20:25,405::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00053675 s, 907 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:20:25,406::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:25,407::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:25,407::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:25,407::__init__::232::IOProcess::(_processLogs) (201379) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:25,408::__init__::232::IOProcess::(_processLogs) (201379) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:25,410::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:25,411::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:25,411::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:25,412::__init__::232::IOProcess::(_processLogs) (201380) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:25,412::__init__::232::IOProcess::(_processLogs) (201380) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:25,412::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:25,413::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:25,414::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:25,414::__init__::232::IOProcess::(_processLogs) (201381) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:25,414::__init__::232::IOProcess::(_processLogs) (201381) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:25,415::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:25,416::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:25,416::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:25,417::__init__::232::IOProcess::(_processLogs) (201382) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:25,418::__init__::232::IOProcess::(_processLogs) (201382) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:25,519::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:25,521::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:25,522::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:25,902::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:25,904::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136626::DEBUG::2014-10-29 11:20:25,908::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:25,910::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:25,912::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136627::DEBUG::2014-10-29 11:20:25,915::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136627::DEBUG::2014-10-29 11:20:25,917::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:28,929::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:28,932::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136628::DEBUG::2014-10-29 11:20:28,936::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c3084aa-f8e4-4599-9aac-e973e6fc8d59`::moving from state init -> state preparing >Thread-136628::INFO::2014-10-29 11:20:28,937::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136628::INFO::2014-10-29 11:20:28,937::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589809', 'lastCheck': '3.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00053675', 'lastCheck': '3.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000743151', 'lastCheck': '4.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000432321', 'lastCheck': '3.7', 'valid': True}} >Thread-136628::DEBUG::2014-10-29 11:20:28,938::task::1191::Storage.TaskManager.Task::(prepare) Task=`6c3084aa-f8e4-4599-9aac-e973e6fc8d59`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589809', 'lastCheck': '3.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00053675', 'lastCheck': '3.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000743151', 'lastCheck': '4.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000432321', 'lastCheck': '3.7', 'valid': True}} >Thread-136628::DEBUG::2014-10-29 11:20:28,938::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c3084aa-f8e4-4599-9aac-e973e6fc8d59`::moving from state preparing -> state finished >Thread-136628::DEBUG::2014-10-29 11:20:28,938::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136628::DEBUG::2014-10-29 11:20:28,938::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136628::DEBUG::2014-10-29 11:20:28,939::task::993::Storage.TaskManager.Task::(_decref) Task=`6c3084aa-f8e4-4599-9aac-e973e6fc8d59`::ref 0 aborting False >Thread-136628::DEBUG::2014-10-29 11:20:28,972::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:28,994::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:28,996::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136629::DEBUG::2014-10-29 11:20:28,999::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136629::DEBUG::2014-10-29 11:20:29,002::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:20:30,394::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54483 >Detector thread::DEBUG::2014-10-29 11:20:30,394::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54483 >Detector thread::DEBUG::2014-10-29 11:20:30,394::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54483 >Detector thread::DEBUG::2014-10-29 11:20:30,395::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54483) >Detector thread::DEBUG::2014-10-29 11:20:30,423::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54484 >Detector thread::DEBUG::2014-10-29 11:20:30,424::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54484 >Detector thread::DEBUG::2014-10-29 11:20:30,424::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54484 >Detector thread::DEBUG::2014-10-29 11:20:30,425::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54484) >Thread-136630::DEBUG::2014-10-29 11:20:30,434::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136630::DEBUG::2014-10-29 11:20:30,435::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136630::DEBUG::2014-10-29 11:20:30,436::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.33', 'elapsedTime': '514262', 'displayType': 'vnc', 'cpuSys': '0.87', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '20599643', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '61131', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '32042.52'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.06', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-136631::DEBUG::2014-10-29 11:20:30,465::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1eb4488-2fbe-4c79-93b6-fc42d0641610`::moving from state init -> state preparing >Thread-136631::INFO::2014-10-29 11:20:30,465::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136631::INFO::2014-10-29 11:20:30,466::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589809', 'lastCheck': '5.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00053675', 'lastCheck': '5.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000743151', 'lastCheck': '5.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000432321', 'lastCheck': '5.2', 'valid': True}} >Thread-136631::DEBUG::2014-10-29 11:20:30,466::task::1191::Storage.TaskManager.Task::(prepare) Task=`a1eb4488-2fbe-4c79-93b6-fc42d0641610`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589809', 'lastCheck': '5.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00053675', 'lastCheck': '5.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000743151', 'lastCheck': '5.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000432321', 'lastCheck': '5.2', 'valid': True}} >Thread-136631::DEBUG::2014-10-29 11:20:30,467::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1eb4488-2fbe-4c79-93b6-fc42d0641610`::moving from state preparing -> state finished >Thread-136631::DEBUG::2014-10-29 11:20:30,467::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136631::DEBUG::2014-10-29 11:20:30,467::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136631::DEBUG::2014-10-29 11:20:30,467::task::993::Storage.TaskManager.Task::(_decref) Task=`a1eb4488-2fbe-4c79-93b6-fc42d0641610`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:30,528::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:30,530::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:30,531::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:20:30,808::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54486 >Detector thread::DEBUG::2014-10-29 11:20:30,808::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54486 >Detector thread::DEBUG::2014-10-29 11:20:30,808::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54486 >Detector thread::DEBUG::2014-10-29 11:20:30,809::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54486) >Thread-136632::DEBUG::2014-10-29 11:20:30,848::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136632::DEBUG::2014-10-29 11:20:30,850::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136632::DEBUG::2014-10-29 11:20:30,870::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136632::DEBUG::2014-10-29 11:20:30,917::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '49', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '49', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:32,048::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:32,055::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136633::DEBUG::2014-10-29 11:20:32,065::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:32,071::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:32,077::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136634::DEBUG::2014-10-29 11:20:32,087::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136634::DEBUG::2014-10-29 11:20:32,106::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:20:34,203::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >Thread-22::DEBUG::2014-10-29 11:20:34,416::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Detector thread::DEBUG::2014-10-29 11:20:34,566::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54488 >Detector thread::DEBUG::2014-10-29 11:20:34,567::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54488 >Detector thread::DEBUG::2014-10-29 11:20:34,567::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54488 >Detector thread::DEBUG::2014-10-29 11:20:34,568::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54488) >Thread-136635::DEBUG::2014-10-29 11:20:34,608::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136635::DEBUG::2014-10-29 11:20:34,609::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3f05d1b-4910-4776-a6c7-b61eef4a608e`::moving from state init -> state preparing >Thread-136635::INFO::2014-10-29 11:20:34,609::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136635::DEBUG::2014-10-29 11:20:34,613::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:20:34,614::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:34,615::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:34,615::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:34,615::__init__::232::IOProcess::(_processLogs) (201383) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:34,616::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201383) Queuing response >Thread-136635::DEBUG::2014-10-29 11:20:34,617::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136635::DEBUG::2014-10-29 11:20:34,618::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136635::INFO::2014-10-29 11:20:34,618::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136635::DEBUG::2014-10-29 11:20:34,619::task::1191::Storage.TaskManager.Task::(prepare) Task=`f3f05d1b-4910-4776-a6c7-b61eef4a608e`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136635::DEBUG::2014-10-29 11:20:34,619::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3f05d1b-4910-4776-a6c7-b61eef4a608e`::moving from state preparing -> state finished >Thread-136635::DEBUG::2014-10-29 11:20:34,619::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136635::DEBUG::2014-10-29 11:20:34,619::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136635::DEBUG::2014-10-29 11:20:34,620::task::993::Storage.TaskManager.Task::(_decref) Task=`f3f05d1b-4910-4776-a6c7-b61eef4a608e`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:20:34,664::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54489 >Detector thread::DEBUG::2014-10-29 11:20:34,665::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54489 >Detector thread::DEBUG::2014-10-29 11:20:34,665::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54489 >Detector thread::DEBUG::2014-10-29 11:20:34,666::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54489) >Thread-136636::DEBUG::2014-10-29 11:20:34,705::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136636::DEBUG::2014-10-29 11:20:34,706::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b0bdafb-a955-45b4-977c-69bdce4141e2`::moving from state init -> state preparing >Thread-136636::INFO::2014-10-29 11:20:34,706::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136636::DEBUG::2014-10-29 11:20:34,706::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136636::DEBUG::2014-10-29 11:20:34,707::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136636::DEBUG::2014-10-29 11:20:34,707::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136636::DEBUG::2014-10-29 11:20:34,707::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136636::DEBUG::2014-10-29 11:20:34,707::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136636::DEBUG::2014-10-29 11:20:34,708::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136636::DEBUG::2014-10-29 11:20:34,785::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136636::DEBUG::2014-10-29 11:20:34,786::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-17::DEBUG::2014-10-29 11:20:34,880::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:34,881::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:34,881::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:34,881::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201384) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:34,899::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201384) Queuing response >Thread-179::DEBUG::2014-10-29 11:20:34,901::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:20:34,922::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000418508 s, 889 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:20:34,924::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:34,924::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:34,925::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:34,925::__init__::232::IOProcess::(_processLogs) (201385) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:34,926::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201385) Queuing response >Thread-136636::DEBUG::2014-10-29 11:20:34,980::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136636::DEBUG::2014-10-29 11:20:34,980::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136636::DEBUG::2014-10-29 11:20:34,981::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136636::DEBUG::2014-10-29 11:20:34,981::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136636::DEBUG::2014-10-29 11:20:34,982::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136636::DEBUG::2014-10-29 11:20:34,982::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136636::DEBUG::2014-10-29 11:20:34,982::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136636::DEBUG::2014-10-29 11:20:34,983::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:20:34,989::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:34,990::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:34,990::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:34,991::__init__::232::IOProcess::(_processLogs) (201386) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:34,992::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201386) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:34,995::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:34,995::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:34,995::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:34,996::__init__::232::IOProcess::(_processLogs) (201387) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:34,997::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201387) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:34,998::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:35,000::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:35,002::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:35,004::__init__::232::IOProcess::(_processLogs) (201388) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:35,009::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201388) Queuing response >Thread-136636::DEBUG::2014-10-29 11:20:35,010::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:20:35,013::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:35,013::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:35,013::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:35,013::__init__::232::IOProcess::(_processLogs) (201389) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:35,014::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201389) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:35,015::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:35,015::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:35,016::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:35,016::__init__::232::IOProcess::(_processLogs) (201390) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:20:35,017::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201390) Queuing response >Thread-136636::DEBUG::2014-10-29 11:20:35,017::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:20:35,019::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:35,020::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:35,020::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:35,020::__init__::232::IOProcess::(_processLogs) (201391) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:20:35,021::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201391) Queuing response >Thread-136636::DEBUG::2014-10-29 11:20:35,021::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:20:35,023::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:35,024::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:35,025::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:35,025::__init__::232::IOProcess::(_processLogs) (201392) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:35,025::__init__::232::IOProcess::(_processLogs) (201392) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:35,026::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:35,026::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-136636::DEBUG::2014-10-29 11:20:35,027::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:20:35,027::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-136636::INFO::2014-10-29 11:20:35,029::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:20:35,029::__init__::232::IOProcess::(_processLogs) (201393) Got request for method 'glob' >Thread-136636::INFO::2014-10-29 11:20:35,030::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:20:35,031::__init__::232::IOProcess::(_processLogs) (201393) Queuing response >Thread-136636::INFO::2014-10-29 11:20:35,033::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:20:35,033::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:35,034::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:35,034::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:35,034::__init__::232::IOProcess::(_processLogs) (201394) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:20:35,035::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201394) Queuing response >Thread-136636::DEBUG::2014-10-29 11:20:35,035::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136636::DEBUG::2014-10-29 11:20:35,037::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`9ed8b843-5132-4d03-ba61-e82d74e3fd0a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136636::DEBUG::2014-10-29 11:20:35,037::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136636::DEBUG::2014-10-29 11:20:35,037::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136636::DEBUG::2014-10-29 11:20:35,038::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`9ed8b843-5132-4d03-ba61-e82d74e3fd0a`::Granted request >Thread-136636::DEBUG::2014-10-29 11:20:35,038::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5b0bdafb-a955-45b4-977c-69bdce4141e2`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136636::DEBUG::2014-10-29 11:20:35,038::task::993::Storage.TaskManager.Task::(_decref) Task=`5b0bdafb-a955-45b4-977c-69bdce4141e2`::ref 1 aborting False >Thread-136636::INFO::2014-10-29 11:20:35,041::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136636::DEBUG::2014-10-29 11:20:35,041::task::1191::Storage.TaskManager.Task::(prepare) Task=`5b0bdafb-a955-45b4-977c-69bdce4141e2`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136636::DEBUG::2014-10-29 11:20:35,042::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b0bdafb-a955-45b4-977c-69bdce4141e2`::moving from state preparing -> state finished >Thread-136636::DEBUG::2014-10-29 11:20:35,042::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136636::DEBUG::2014-10-29 11:20:35,042::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136636::DEBUG::2014-10-29 11:20:35,043::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136636::DEBUG::2014-10-29 11:20:35,043::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136636::DEBUG::2014-10-29 11:20:35,043::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136636::DEBUG::2014-10-29 11:20:35,044::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136636::DEBUG::2014-10-29 11:20:35,044::task::993::Storage.TaskManager.Task::(_decref) Task=`5b0bdafb-a955-45b4-977c-69bdce4141e2`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:20:35,066::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54490 >Detector thread::DEBUG::2014-10-29 11:20:35,067::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54490 >Detector thread::DEBUG::2014-10-29 11:20:35,067::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54490 >Detector thread::DEBUG::2014-10-29 11:20:35,068::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54490) >Thread-136641::DEBUG::2014-10-29 11:20:35,107::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136641::DEBUG::2014-10-29 11:20:35,108::task::595::Storage.TaskManager.Task::(_updateState) Task=`52ee3e1d-5a49-4fc2-a19a-4039f564ef57`::moving from state init -> state preparing >Thread-136641::INFO::2014-10-29 11:20:35,108::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136641::INFO::2014-10-29 11:20:35,109::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589809', 'lastCheck': '9.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00053675', 'lastCheck': '9.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418508', 'lastCheck': '0.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000432321', 'lastCheck': '9.9', 'valid': True}} >Thread-136641::DEBUG::2014-10-29 11:20:35,109::task::1191::Storage.TaskManager.Task::(prepare) Task=`52ee3e1d-5a49-4fc2-a19a-4039f564ef57`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589809', 'lastCheck': '9.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00053675', 'lastCheck': '9.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418508', 'lastCheck': '0.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000432321', 'lastCheck': '9.9', 'valid': True}} >Thread-136641::DEBUG::2014-10-29 11:20:35,109::task::595::Storage.TaskManager.Task::(_updateState) Task=`52ee3e1d-5a49-4fc2-a19a-4039f564ef57`::moving from state preparing -> state finished >Thread-136641::DEBUG::2014-10-29 11:20:35,110::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136641::DEBUG::2014-10-29 11:20:35,110::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136641::DEBUG::2014-10-29 11:20:35,110::task::993::Storage.TaskManager.Task::(_decref) Task=`52ee3e1d-5a49-4fc2-a19a-4039f564ef57`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:35,127::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:35,129::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136642::DEBUG::2014-10-29 11:20:35,133::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:35,138::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:35,141::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136643::DEBUG::2014-10-29 11:20:35,144::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136643::DEBUG::2014-10-29 11:20:35,146::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:20:35,239::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:35,240::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:35,240::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:35,240::__init__::232::IOProcess::(_processLogs) (201395) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:35,242::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201395) Queuing response >Thread-10269::DEBUG::2014-10-29 11:20:35,243::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:20:35,267::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00184553 s, 272 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:20:35,269::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:35,272::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:35,272::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:35,272::__init__::232::IOProcess::(_processLogs) (201396) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:35,272::__init__::232::IOProcess::(_processLogs) (201396) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:35,352::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:35,352::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:35,353::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:35,353::__init__::232::IOProcess::(_processLogs) (201397) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:35,354::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201397) Queuing response >Thread-178::DEBUG::2014-10-29 11:20:35,356::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:20:35,373::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000655737 s, 775 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:20:35,375::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:35,375::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:35,375::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:35,376::__init__::232::IOProcess::(_processLogs) (201398) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:35,376::__init__::232::IOProcess::(_processLogs) (201398) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:35,378::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:35,378::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:35,379::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:35,379::__init__::232::IOProcess::(_processLogs) (201399) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:35,379::__init__::232::IOProcess::(_processLogs) (201399) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:35,381::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:35,381::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:35,381::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:35,382::__init__::232::IOProcess::(_processLogs) (201400) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:35,382::__init__::232::IOProcess::(_processLogs) (201400) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:35,383::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:35,383::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:35,384::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:35,384::__init__::232::IOProcess::(_processLogs) (201401) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:35,385::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201401) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:35,418::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:35,418::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:35,435::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:35,436::__init__::232::IOProcess::(_processLogs) (201402) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:35,437::__init__::232::IOProcess::(_processLogs) (201402) Queuing response >Thread-33::DEBUG::2014-10-29 11:20:35,437::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:20:35,460::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000432043 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:20:35,461::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:35,462::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:35,464::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:35,465::__init__::232::IOProcess::(_processLogs) (201403) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:35,466::__init__::232::IOProcess::(_processLogs) (201403) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:35,466::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:35,467::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:35,468::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:35,468::__init__::232::IOProcess::(_processLogs) (201404) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:35,468::__init__::232::IOProcess::(_processLogs) (201404) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:35,469::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:35,469::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:35,470::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:35,471::__init__::232::IOProcess::(_processLogs) (201405) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:35,471::__init__::232::IOProcess::(_processLogs) (201405) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:35,471::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:35,472::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:35,472::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:35,472::__init__::232::IOProcess::(_processLogs) (201406) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:35,473::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201406) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:35,538::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:35,539::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:35,540::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:38,159::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:38,162::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136644::DEBUG::2014-10-29 11:20:38,167::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:38,169::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:38,171::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136645::DEBUG::2014-10-29 11:20:38,174::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136645::DEBUG::2014-10-29 11:20:38,177::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:20:40,539::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54491 >Detector thread::DEBUG::2014-10-29 11:20:40,539::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54491 >Detector thread::DEBUG::2014-10-29 11:20:40,540::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54491 >Detector thread::DEBUG::2014-10-29 11:20:40,541::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54491) >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:40,547::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:40,548::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:40,549::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136646::DEBUG::2014-10-29 11:20:40,581::task::595::Storage.TaskManager.Task::(_updateState) Task=`be289a94-f0c6-45a2-9ebf-145f7f46e048`::moving from state init -> state preparing >Thread-136646::INFO::2014-10-29 11:20:40,582::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136646::INFO::2014-10-29 11:20:40,582::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000655737', 'lastCheck': '5.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000432043', 'lastCheck': '5.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418508', 'lastCheck': '5.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00184553', 'lastCheck': '5.3', 'valid': True}} >Thread-136646::DEBUG::2014-10-29 11:20:40,583::task::1191::Storage.TaskManager.Task::(prepare) Task=`be289a94-f0c6-45a2-9ebf-145f7f46e048`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000655737', 'lastCheck': '5.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000432043', 'lastCheck': '5.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418508', 'lastCheck': '5.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00184553', 'lastCheck': '5.3', 'valid': True}} >Thread-136646::DEBUG::2014-10-29 11:20:40,583::task::595::Storage.TaskManager.Task::(_updateState) Task=`be289a94-f0c6-45a2-9ebf-145f7f46e048`::moving from state preparing -> state finished >Thread-136646::DEBUG::2014-10-29 11:20:40,583::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136646::DEBUG::2014-10-29 11:20:40,583::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136646::DEBUG::2014-10-29 11:20:40,584::task::993::Storage.TaskManager.Task::(_decref) Task=`be289a94-f0c6-45a2-9ebf-145f7f46e048`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:20:40,594::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54492 >Detector thread::DEBUG::2014-10-29 11:20:40,594::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54492 >Detector thread::DEBUG::2014-10-29 11:20:40,595::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54492 >Detector thread::DEBUG::2014-10-29 11:20:40,595::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54492) >Thread-136647::DEBUG::2014-10-29 11:20:40,634::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136647::DEBUG::2014-10-29 11:20:40,635::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136647::DEBUG::2014-10-29 11:20:40,636::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.32', 'elapsedTime': '514273', 'displayType': 'vnc', 'cpuSys': '0.66', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '20599643', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '61131', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '32042.52'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.22', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:20:40,962::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54494 >Detector thread::DEBUG::2014-10-29 11:20:40,963::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54494 >Detector thread::DEBUG::2014-10-29 11:20:40,963::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54494 >Detector thread::DEBUG::2014-10-29 11:20:40,963::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54494) >Thread-136648::DEBUG::2014-10-29 11:20:41,002::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136648::DEBUG::2014-10-29 11:20:41,004::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136648::DEBUG::2014-10-29 11:20:41,023::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136648::DEBUG::2014-10-29 11:20:41,072::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '34', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '34', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:41,190::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:41,193::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136649::DEBUG::2014-10-29 11:20:41,196::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:41,198::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:41,200::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136650::DEBUG::2014-10-29 11:20:41,203::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136650::DEBUG::2014-10-29 11:20:41,206::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:44,218::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:44,222::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136651::DEBUG::2014-10-29 11:20:44,226::task::595::Storage.TaskManager.Task::(_updateState) Task=`95cbad3f-1bfa-43dd-9d41-c0b4a5205e71`::moving from state init -> state preparing >Thread-136651::INFO::2014-10-29 11:20:44,227::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136651::INFO::2014-10-29 11:20:44,228::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000655737', 'lastCheck': '8.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000432043', 'lastCheck': '8.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418508', 'lastCheck': '9.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00184553', 'lastCheck': '9.0', 'valid': True}} >Thread-136651::DEBUG::2014-10-29 11:20:44,228::task::1191::Storage.TaskManager.Task::(prepare) Task=`95cbad3f-1bfa-43dd-9d41-c0b4a5205e71`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000655737', 'lastCheck': '8.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000432043', 'lastCheck': '8.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418508', 'lastCheck': '9.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00184553', 'lastCheck': '9.0', 'valid': True}} >Thread-136651::DEBUG::2014-10-29 11:20:44,228::task::595::Storage.TaskManager.Task::(_updateState) Task=`95cbad3f-1bfa-43dd-9d41-c0b4a5205e71`::moving from state preparing -> state finished >Thread-136651::DEBUG::2014-10-29 11:20:44,228::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136651::DEBUG::2014-10-29 11:20:44,229::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136651::DEBUG::2014-10-29 11:20:44,229::task::993::Storage.TaskManager.Task::(_decref) Task=`95cbad3f-1bfa-43dd-9d41-c0b4a5205e71`::ref 0 aborting False >Thread-136651::DEBUG::2014-10-29 11:20:44,263::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:44,291::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:44,293::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136652::DEBUG::2014-10-29 11:20:44,297::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136652::DEBUG::2014-10-29 11:20:44,299::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:20:44,930::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:44,931::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:44,931::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:44,931::__init__::232::IOProcess::(_processLogs) (201407) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:44,934::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201407) Queuing response >Thread-179::DEBUG::2014-10-29 11:20:44,935::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:20:44,956::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000589057 s, 632 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:20:44,959::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:44,959::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:44,959::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:44,960::__init__::232::IOProcess::(_processLogs) (201408) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:44,960::__init__::232::IOProcess::(_processLogs) (201408) Queuing response >Thread-10269::DEBUG::2014-10-29 11:20:45,272::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain de096187-36e2-44e5-b8db-a9b67c3960de >Thread-17::DEBUG::2014-10-29 11:20:45,279::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:45,281::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:45,282::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:45,282::__init__::232::IOProcess::(_processLogs) (201409) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:45,283::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201409) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:45,285::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:45,285::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:45,285::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:45,285::__init__::232::IOProcess::(_processLogs) (201410) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:45,286::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201410) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:45,287::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:45,287::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:45,288::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:45,289::__init__::232::IOProcess::(_processLogs) (201411) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:45,290::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201411) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:45,291::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:45,292::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:45,292::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:45,293::__init__::232::IOProcess::(_processLogs) (201412) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:45,294::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201412) Queuing response >Thread-10269::DEBUG::2014-10-29 11:20:45,298::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de >Thread-17::DEBUG::2014-10-29 11:20:45,299::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:45,299::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:45,299::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:45,300::__init__::232::IOProcess::(_processLogs) (201413) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:20:45,302::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201413) Queuing response >Thread-10269::DEBUG::2014-10-29 11:20:45,303::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:20:45,304::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:45,304::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:45,304::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:45,304::__init__::232::IOProcess::(_processLogs) (201414) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:20:45,305::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201414) Queuing response >Thread-10269::DEBUG::2014-10-29 11:20:45,306::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nsednev-iso-domain', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=00000002-0002-0002-0002-000000000324,00000002-0002-0002-0002-00000000002d,00000002-0002-0002-0002-0000000003d4,00000002-0002-0002-0002-000000000321', 'REMOTE_PATH=monster-nfs.scl.lab.tlv.redhat.com:/RHEV/nsednev-iso-domain', 'ROLE=Regular', 'SDUUID=de096187-36e2-44e5-b8db-a9b67c3960de', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=4fa36e197e83f2488bfc8aea7825ed34cc463260'] >Thread-17::DEBUG::2014-10-29 11:20:45,308::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:45,308::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:45,309::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:45,310::__init__::232::IOProcess::(_processLogs) (201415) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:45,310::__init__::232::IOProcess::(_processLogs) (201415) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:45,311::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:45,311::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:45,311::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:45,311::__init__::232::IOProcess::(_processLogs) (201416) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:45,312::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201416) Queuing response >Thread-10269::DEBUG::2014-10-29 11:20:45,312::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-10269::INFO::2014-10-29 11:20:45,314::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace de096187-36e2-44e5-b8db-a9b67c3960de_imageNS already registered >Thread-10269::INFO::2014-10-29 11:20:45,314::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace de096187-36e2-44e5-b8db-a9b67c3960de_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:20:45,315::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:45,315::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:45,317::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-10269::DEBUG::2014-10-29 11:20:45,319::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:20:45,319::__init__::232::IOProcess::(_processLogs) (201417) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:45,340::__init__::232::IOProcess::(_processLogs) (201417) Queuing response >Thread-10269::DEBUG::2014-10-29 11:20:45,342::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000671253 s, 748 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:20:45,343::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:45,344::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:45,346::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:45,346::__init__::232::IOProcess::(_processLogs) (201418) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:45,346::__init__::232::IOProcess::(_processLogs) (201418) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:45,388::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:45,390::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-178::DEBUG::2014-10-29 11:20:45,391::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:20:45,392::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:45,411::__init__::232::IOProcess::(_processLogs) (201419) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:45,412::__init__::232::IOProcess::(_processLogs) (201419) Queuing response >Thread-178::DEBUG::2014-10-29 11:20:45,417::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00439786 s, 116 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:20:45,424::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:45,425::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:45,425::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:45,425::__init__::232::IOProcess::(_processLogs) (201420) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:45,426::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201420) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:45,426::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:45,426::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:45,427::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:45,427::__init__::232::IOProcess::(_processLogs) (201421) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:45,427::__init__::232::IOProcess::(_processLogs) (201421) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:45,428::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:45,428::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:45,428::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:45,428::__init__::232::IOProcess::(_processLogs) (201422) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:45,429::__init__::232::IOProcess::(_processLogs) (201422) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:45,429::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:45,429::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:45,430::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:45,430::__init__::232::IOProcess::(_processLogs) (201423) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:45,430::__init__::232::IOProcess::(_processLogs) (201423) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:45,475::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:45,475::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:45,476::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:45,476::__init__::232::IOProcess::(_processLogs) (201424) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:45,477::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201424) Queuing response >Thread-33::DEBUG::2014-10-29 11:20:45,479::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:20:45,504::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00712196 s, 68.4 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:20:45,506::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:45,507::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:45,507::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:45,508::__init__::232::IOProcess::(_processLogs) (201425) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:45,509::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201425) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:45,511::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:45,516::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:45,516::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:45,516::__init__::232::IOProcess::(_processLogs) (201426) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:45,517::__init__::232::IOProcess::(_processLogs) (201426) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:45,517::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:45,517::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:45,517::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:45,518::__init__::232::IOProcess::(_processLogs) (201427) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:45,518::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201427) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:45,518::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:45,519::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:45,519::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:45,519::__init__::232::IOProcess::(_processLogs) (201428) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:45,519::__init__::232::IOProcess::(_processLogs) (201428) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:45,556::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:45,557::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:45,562::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:20:45,742::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54496 >Detector thread::DEBUG::2014-10-29 11:20:45,743::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54496 >Detector thread::DEBUG::2014-10-29 11:20:45,743::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54496 >Detector thread::DEBUG::2014-10-29 11:20:45,744::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54496) >Thread-136657::DEBUG::2014-10-29 11:20:45,784::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136657::DEBUG::2014-10-29 11:20:45,785::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab0d5995-502a-4d53-8aeb-43e3d767612e`::moving from state init -> state preparing >Thread-136657::INFO::2014-10-29 11:20:45,786::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136657::DEBUG::2014-10-29 11:20:45,789::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:20:45,790::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:45,790::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:45,790::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:45,790::__init__::232::IOProcess::(_processLogs) (201429) Got request for method 'glob' >Thread-136657::DEBUG::2014-10-29 11:20:45,791::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:20:45,791::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201429) Queuing response >Thread-136657::DEBUG::2014-10-29 11:20:45,793::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136657::INFO::2014-10-29 11:20:45,793::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136657::DEBUG::2014-10-29 11:20:45,794::task::1191::Storage.TaskManager.Task::(prepare) Task=`ab0d5995-502a-4d53-8aeb-43e3d767612e`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136657::DEBUG::2014-10-29 11:20:45,794::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab0d5995-502a-4d53-8aeb-43e3d767612e`::moving from state preparing -> state finished >Thread-136657::DEBUG::2014-10-29 11:20:45,794::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136657::DEBUG::2014-10-29 11:20:45,794::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136657::DEBUG::2014-10-29 11:20:45,795::task::993::Storage.TaskManager.Task::(_decref) Task=`ab0d5995-502a-4d53-8aeb-43e3d767612e`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:20:45,838::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54497 >Detector thread::DEBUG::2014-10-29 11:20:45,839::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54497 >Detector thread::DEBUG::2014-10-29 11:20:45,839::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54497 >Detector thread::DEBUG::2014-10-29 11:20:45,840::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54497) >Thread-136658::DEBUG::2014-10-29 11:20:45,878::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136658::DEBUG::2014-10-29 11:20:45,879::task::595::Storage.TaskManager.Task::(_updateState) Task=`72261316-dede-4bc3-8178-203ebbe6928d`::moving from state init -> state preparing >Thread-136658::INFO::2014-10-29 11:20:45,879::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136658::DEBUG::2014-10-29 11:20:45,879::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136658::DEBUG::2014-10-29 11:20:45,880::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136658::DEBUG::2014-10-29 11:20:45,880::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136658::DEBUG::2014-10-29 11:20:45,880::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136658::DEBUG::2014-10-29 11:20:45,881::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136658::DEBUG::2014-10-29 11:20:45,881::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136658::DEBUG::2014-10-29 11:20:45,962::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136658::DEBUG::2014-10-29 11:20:45,963::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136658::DEBUG::2014-10-29 11:20:46,136::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136658::DEBUG::2014-10-29 11:20:46,139::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136658::DEBUG::2014-10-29 11:20:46,141::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136658::DEBUG::2014-10-29 11:20:46,143::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136658::DEBUG::2014-10-29 11:20:46,145::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136658::DEBUG::2014-10-29 11:20:46,148::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136658::DEBUG::2014-10-29 11:20:46,150::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136658::DEBUG::2014-10-29 11:20:46,152::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:20:46,165::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:46,167::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:46,169::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:46,170::__init__::232::IOProcess::(_processLogs) (201430) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:46,175::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201430) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:46,178::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:46,180::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:46,181::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:46,183::__init__::232::IOProcess::(_processLogs) (201431) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:46,187::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201431) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:46,191::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:46,194::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:46,198::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:46,201::__init__::232::IOProcess::(_processLogs) (201432) Got request for method 'glob' >Thread-136658::DEBUG::2014-10-29 11:20:46,206::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:20:46,208::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201432) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:46,212::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:46,214::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:46,216::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:46,218::__init__::232::IOProcess::(_processLogs) (201433) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:46,222::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201433) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:46,224::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:46,226::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:46,227::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:46,228::__init__::232::IOProcess::(_processLogs) (201434) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:20:46,232::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201434) Queuing response >Thread-136658::DEBUG::2014-10-29 11:20:46,233::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:20:46,237::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:46,239::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:46,240::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:46,241::__init__::232::IOProcess::(_processLogs) (201435) Got request for method 'readfile' >Thread-136658::DEBUG::2014-10-29 11:20:46,245::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:20:46,245::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201435) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:46,250::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:46,251::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:46,252::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:46,253::__init__::232::IOProcess::(_processLogs) (201436) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:46,256::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201436) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:46,258::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:46,260::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:46,261::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:46,273::__init__::232::IOProcess::(_processLogs) (201437) Got request for method 'glob' >Thread-136658::DEBUG::2014-10-29 11:20:46,277::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:20:46,277::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201437) Queuing response >Thread-136658::INFO::2014-10-29 11:20:46,280::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136658::INFO::2014-10-29 11:20:46,283::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136658::INFO::2014-10-29 11:20:46,286::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:20:46,291::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:46,293::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:46,295::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:46,297::__init__::232::IOProcess::(_processLogs) (201438) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:20:46,299::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201438) Queuing response >Thread-136658::DEBUG::2014-10-29 11:20:46,300::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136658::DEBUG::2014-10-29 11:20:46,310::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`ce29837f-3a0a-47de-93c5-6d402e295615`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136658::DEBUG::2014-10-29 11:20:46,311::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136658::DEBUG::2014-10-29 11:20:46,313::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136658::DEBUG::2014-10-29 11:20:46,314::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`ce29837f-3a0a-47de-93c5-6d402e295615`::Granted request >Thread-136658::DEBUG::2014-10-29 11:20:46,318::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`72261316-dede-4bc3-8178-203ebbe6928d`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136658::DEBUG::2014-10-29 11:20:46,319::task::993::Storage.TaskManager.Task::(_decref) Task=`72261316-dede-4bc3-8178-203ebbe6928d`::ref 1 aborting False >Thread-136658::INFO::2014-10-29 11:20:46,331::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136658::DEBUG::2014-10-29 11:20:46,332::task::1191::Storage.TaskManager.Task::(prepare) Task=`72261316-dede-4bc3-8178-203ebbe6928d`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136658::DEBUG::2014-10-29 11:20:46,333::task::595::Storage.TaskManager.Task::(_updateState) Task=`72261316-dede-4bc3-8178-203ebbe6928d`::moving from state preparing -> state finished >Thread-136658::DEBUG::2014-10-29 11:20:46,334::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136658::DEBUG::2014-10-29 11:20:46,336::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136658::DEBUG::2014-10-29 11:20:46,338::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136658::DEBUG::2014-10-29 11:20:46,340::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136658::DEBUG::2014-10-29 11:20:46,341::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136658::DEBUG::2014-10-29 11:20:46,341::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136658::DEBUG::2014-10-29 11:20:46,342::task::993::Storage.TaskManager.Task::(_decref) Task=`72261316-dede-4bc3-8178-203ebbe6928d`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:20:46,369::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54498 >Detector thread::DEBUG::2014-10-29 11:20:46,370::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54498 >Detector thread::DEBUG::2014-10-29 11:20:46,370::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54498 >Detector thread::DEBUG::2014-10-29 11:20:46,371::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54498) >Thread-136663::DEBUG::2014-10-29 11:20:46,410::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136663::DEBUG::2014-10-29 11:20:46,413::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd5023a2-1d6b-4845-8e03-a8c5c30a747c`::moving from state init -> state preparing >Thread-136663::INFO::2014-10-29 11:20:46,415::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136663::INFO::2014-10-29 11:20:46,418::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00439786', 'lastCheck': '1.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00712196', 'lastCheck': '0.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589057', 'lastCheck': '1.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000671253', 'lastCheck': '1.1', 'valid': True}} >Thread-136663::DEBUG::2014-10-29 11:20:46,420::task::1191::Storage.TaskManager.Task::(prepare) Task=`bd5023a2-1d6b-4845-8e03-a8c5c30a747c`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00439786', 'lastCheck': '1.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00712196', 'lastCheck': '0.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589057', 'lastCheck': '1.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000671253', 'lastCheck': '1.1', 'valid': True}} >Thread-136663::DEBUG::2014-10-29 11:20:46,421::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd5023a2-1d6b-4845-8e03-a8c5c30a747c`::moving from state preparing -> state finished >Thread-136663::DEBUG::2014-10-29 11:20:46,422::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136663::DEBUG::2014-10-29 11:20:46,423::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136663::DEBUG::2014-10-29 11:20:46,425::task::993::Storage.TaskManager.Task::(_decref) Task=`bd5023a2-1d6b-4845-8e03-a8c5c30a747c`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:47,353::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:47,356::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136664::DEBUG::2014-10-29 11:20:47,361::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:47,363::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:47,365::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136665::DEBUG::2014-10-29 11:20:47,368::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136665::DEBUG::2014-10-29 11:20:47,371::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:20:49,421::task::595::Storage.TaskManager.Task::(_updateState) Task=`f9d452f7-cb83-4a0d-9ef1-5ab3afd4719b`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:20:49,421::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:20:49,423::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:49,423::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:49,423::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:49,424::__init__::232::IOProcess::(_processLogs) (201439) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:20:49,424::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201439) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:49,426::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:49,426::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:49,426::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:49,427::__init__::232::IOProcess::(_processLogs) (201440) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:20:49,428::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201440) Queuing response >Thread-22::INFO::2014-10-29 11:20:49,428::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010871808', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:20:49,429::task::1191::Storage.TaskManager.Task::(prepare) Task=`f9d452f7-cb83-4a0d-9ef1-5ab3afd4719b`::finished: {'truesize': '6010871808', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:20:49,430::task::595::Storage.TaskManager.Task::(_updateState) Task=`f9d452f7-cb83-4a0d-9ef1-5ab3afd4719b`::moving from state preparing -> state finished >Thread-22::DEBUG::2014-10-29 11:20:49,430::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-10-29 11:20:49,430::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2014-10-29 11:20:49,430::task::993::Storage.TaskManager.Task::(_decref) Task=`f9d452f7-cb83-4a0d-9ef1-5ab3afd4719b`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:20:49,503::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:50,387::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:50,389::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136666::DEBUG::2014-10-29 11:20:50,393::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:50,395::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:50,397::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136667::DEBUG::2014-10-29 11:20:50,401::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136667::DEBUG::2014-10-29 11:20:50,403::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:50,568::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:50,570::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:50,571::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:20:50,640::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54499 >Detector thread::DEBUG::2014-10-29 11:20:50,640::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54499 >Detector thread::DEBUG::2014-10-29 11:20:50,641::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54499 >Detector thread::DEBUG::2014-10-29 11:20:50,641::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54499) >Thread-136668::DEBUG::2014-10-29 11:20:50,681::task::595::Storage.TaskManager.Task::(_updateState) Task=`25e46ecf-dfb9-462f-b1d4-3da142acb29b`::moving from state init -> state preparing >Thread-136668::INFO::2014-10-29 11:20:50,681::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136668::INFO::2014-10-29 11:20:50,682::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00439786', 'lastCheck': '5.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00712196', 'lastCheck': '5.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589057', 'lastCheck': '5.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000671253', 'lastCheck': '5.3', 'valid': True}} >Thread-136668::DEBUG::2014-10-29 11:20:50,682::task::1191::Storage.TaskManager.Task::(prepare) Task=`25e46ecf-dfb9-462f-b1d4-3da142acb29b`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00439786', 'lastCheck': '5.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00712196', 'lastCheck': '5.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000589057', 'lastCheck': '5.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000671253', 'lastCheck': '5.3', 'valid': True}} >Thread-136668::DEBUG::2014-10-29 11:20:50,682::task::595::Storage.TaskManager.Task::(_updateState) Task=`25e46ecf-dfb9-462f-b1d4-3da142acb29b`::moving from state preparing -> state finished >Thread-136668::DEBUG::2014-10-29 11:20:50,682::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136668::DEBUG::2014-10-29 11:20:50,683::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136668::DEBUG::2014-10-29 11:20:50,683::task::993::Storage.TaskManager.Task::(_decref) Task=`25e46ecf-dfb9-462f-b1d4-3da142acb29b`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:20:50,797::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54500 >Detector thread::DEBUG::2014-10-29 11:20:50,798::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54500 >Detector thread::DEBUG::2014-10-29 11:20:50,798::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54500 >Detector thread::DEBUG::2014-10-29 11:20:50,798::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54500) >Thread-136669::DEBUG::2014-10-29 11:20:50,837::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136669::DEBUG::2014-10-29 11:20:50,838::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136669::DEBUG::2014-10-29 11:20:50,838::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.59', 'elapsedTime': '514283', 'displayType': 'vnc', 'cpuSys': '0.60', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '54734861', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57351', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '54096.31'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.42', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:20:51,119::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54502 >Detector thread::DEBUG::2014-10-29 11:20:51,120::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54502 >Detector thread::DEBUG::2014-10-29 11:20:51,120::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54502 >Detector thread::DEBUG::2014-10-29 11:20:51,121::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54502) >Thread-136670::DEBUG::2014-10-29 11:20:51,160::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136670::DEBUG::2014-10-29 11:20:51,162::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136670::DEBUG::2014-10-29 11:20:51,181::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136670::DEBUG::2014-10-29 11:20:51,228::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '18', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '18', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:53,416::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:53,419::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136671::DEBUG::2014-10-29 11:20:53,423::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:53,426::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:53,428::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136672::DEBUG::2014-10-29 11:20:53,431::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136672::DEBUG::2014-10-29 11:20:53,433::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:20:54,964::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:54,964::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:54,964::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:54,965::__init__::232::IOProcess::(_processLogs) (201441) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:54,965::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201441) Queuing response >Thread-179::DEBUG::2014-10-29 11:20:54,967::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:20:54,984::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000535163 s, 695 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:20:54,986::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:54,986::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:54,987::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:54,987::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201442) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:54,987::__init__::232::IOProcess::(_processLogs) (201442) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:55,347::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:55,350::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:55,351::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-10269::DEBUG::2014-10-29 11:20:55,351::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:20:55,353::__init__::232::IOProcess::(_processLogs) (201443) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:55,368::__init__::232::IOProcess::(_processLogs) (201443) Queuing response >Thread-10269::DEBUG::2014-10-29 11:20:55,369::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000954341 s, 526 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:20:55,371::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:55,371::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:55,373::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:55,375::__init__::232::IOProcess::(_processLogs) (201444) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:55,375::__init__::232::IOProcess::(_processLogs) (201444) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:55,438::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:55,438::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:55,438::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:55,439::__init__::232::IOProcess::(_processLogs) (201445) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:55,440::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201445) Queuing response >Thread-178::DEBUG::2014-10-29 11:20:55,441::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:20:55,458::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000518197 s, 980 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:20:55,460::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:55,461::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:55,461::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:55,461::__init__::232::IOProcess::(_processLogs) (201446) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:55,461::__init__::232::IOProcess::(_processLogs) (201446) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:55,464::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:55,464::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:55,465::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:55,466::__init__::232::IOProcess::(_processLogs) (201447) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:55,466::__init__::232::IOProcess::(_processLogs) (201447) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:55,466::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:55,467::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:55,468::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:55,468::__init__::232::IOProcess::(_processLogs) (201448) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:55,468::__init__::232::IOProcess::(_processLogs) (201448) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:55,469::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:55,470::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:55,470::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:55,470::__init__::232::IOProcess::(_processLogs) (201449) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:55,471::__init__::232::IOProcess::(_processLogs) (201449) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:55,516::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:55,516::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:55,517::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:55,518::__init__::232::IOProcess::(_processLogs) (201450) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:55,519::__init__::232::IOProcess::(_processLogs) (201450) Queuing response >Thread-33::DEBUG::2014-10-29 11:20:55,519::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:20:55,537::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000527302 s, 924 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:20:55,539::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:55,539::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:55,540::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:55,541::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201451) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:20:55,543::__init__::232::IOProcess::(_processLogs) (201451) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:55,543::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:55,544::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:55,544::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:55,544::__init__::232::IOProcess::(_processLogs) (201452) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:55,545::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201452) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:55,546::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:55,546::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:55,547::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:55,547::__init__::232::IOProcess::(_processLogs) (201453) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:55,548::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201453) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:55,549::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:55,549::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:55,549::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:55,549::__init__::232::IOProcess::(_processLogs) (201454) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:55,550::__init__::232::IOProcess::(_processLogs) (201454) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:55,579::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:55,580::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:20:55,582::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:56,448::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:56,451::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136673::DEBUG::2014-10-29 11:20:56,454::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:56,456::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:56,458::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136674::DEBUG::2014-10-29 11:20:56,461::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136674::DEBUG::2014-10-29 11:20:56,463::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:20:57,003::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54504 >Detector thread::DEBUG::2014-10-29 11:20:57,004::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54504 >Detector thread::DEBUG::2014-10-29 11:20:57,004::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54504 >Detector thread::DEBUG::2014-10-29 11:20:57,005::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54504) >Thread-136675::DEBUG::2014-10-29 11:20:57,044::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136675::DEBUG::2014-10-29 11:20:57,045::task::595::Storage.TaskManager.Task::(_updateState) Task=`abd27fd3-870a-4436-a0f9-67beb8f11124`::moving from state init -> state preparing >Thread-136675::INFO::2014-10-29 11:20:57,045::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136675::DEBUG::2014-10-29 11:20:57,063::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:20:57,064::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:57,064::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:57,064::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:57,065::__init__::232::IOProcess::(_processLogs) (201455) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:57,066::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201455) Queuing response >Thread-136675::DEBUG::2014-10-29 11:20:57,066::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136675::DEBUG::2014-10-29 11:20:57,067::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136675::INFO::2014-10-29 11:20:57,067::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136675::DEBUG::2014-10-29 11:20:57,068::task::1191::Storage.TaskManager.Task::(prepare) Task=`abd27fd3-870a-4436-a0f9-67beb8f11124`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136675::DEBUG::2014-10-29 11:20:57,068::task::595::Storage.TaskManager.Task::(_updateState) Task=`abd27fd3-870a-4436-a0f9-67beb8f11124`::moving from state preparing -> state finished >Thread-136675::DEBUG::2014-10-29 11:20:57,068::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136675::DEBUG::2014-10-29 11:20:57,069::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136675::DEBUG::2014-10-29 11:20:57,069::task::993::Storage.TaskManager.Task::(_decref) Task=`abd27fd3-870a-4436-a0f9-67beb8f11124`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:20:57,112::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54505 >Detector thread::DEBUG::2014-10-29 11:20:57,113::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54505 >Detector thread::DEBUG::2014-10-29 11:20:57,113::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54505 >Detector thread::DEBUG::2014-10-29 11:20:57,114::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54505) >Thread-136676::DEBUG::2014-10-29 11:20:57,152::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136676::DEBUG::2014-10-29 11:20:57,152::task::595::Storage.TaskManager.Task::(_updateState) Task=`38382008-44f3-4dca-940a-3ad1fba1a646`::moving from state init -> state preparing >Thread-136676::INFO::2014-10-29 11:20:57,153::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136676::DEBUG::2014-10-29 11:20:57,153::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136676::DEBUG::2014-10-29 11:20:57,154::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136676::DEBUG::2014-10-29 11:20:57,154::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136676::DEBUG::2014-10-29 11:20:57,154::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136676::DEBUG::2014-10-29 11:20:57,154::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136676::DEBUG::2014-10-29 11:20:57,155::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136676::DEBUG::2014-10-29 11:20:57,231::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136676::DEBUG::2014-10-29 11:20:57,232::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136676::DEBUG::2014-10-29 11:20:57,424::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136676::DEBUG::2014-10-29 11:20:57,425::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136676::DEBUG::2014-10-29 11:20:57,426::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136676::DEBUG::2014-10-29 11:20:57,426::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136676::DEBUG::2014-10-29 11:20:57,426::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136676::DEBUG::2014-10-29 11:20:57,427::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136676::DEBUG::2014-10-29 11:20:57,427::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136676::DEBUG::2014-10-29 11:20:57,428::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:20:57,434::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:57,437::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:57,438::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:57,438::__init__::232::IOProcess::(_processLogs) (201456) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:57,439::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201456) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:57,441::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:57,441::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:57,441::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:57,441::__init__::232::IOProcess::(_processLogs) (201457) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:57,442::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201457) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:57,444::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:57,446::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:57,448::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:57,450::__init__::232::IOProcess::(_processLogs) (201458) Got request for method 'glob' >Thread-136676::DEBUG::2014-10-29 11:20:57,454::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:20:57,456::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201458) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:57,458::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:57,458::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:57,458::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:57,458::__init__::232::IOProcess::(_processLogs) (201459) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:57,459::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:57,459::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:57,459::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:57,460::__init__::232::IOProcess::(_processLogs) (201460) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:20:57,460::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201459) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:57,462::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201460) Queuing response >Thread-136676::DEBUG::2014-10-29 11:20:57,463::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:20:57,464::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:57,464::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:57,464::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:57,465::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201461) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:20:57,465::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201461) Queuing response >Thread-136676::DEBUG::2014-10-29 11:20:57,466::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:20:57,468::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:57,468::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:57,469::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:57,469::__init__::232::IOProcess::(_processLogs) (201462) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:20:57,470::__init__::232::IOProcess::(_processLogs) (201462) Queuing response >Thread-17::DEBUG::2014-10-29 11:20:57,470::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:57,470::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:57,471::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:57,471::__init__::232::IOProcess::(_processLogs) (201463) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:20:57,472::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201463) Queuing response >Thread-136676::DEBUG::2014-10-29 11:20:57,472::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-136676::INFO::2014-10-29 11:20:57,473::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136676::INFO::2014-10-29 11:20:57,473::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136676::INFO::2014-10-29 11:20:57,474::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:20:57,474::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:20:57,475::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:20:57,475::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:20:57,475::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201464) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:20:57,476::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201464) Queuing response >Thread-136676::DEBUG::2014-10-29 11:20:57,477::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136676::DEBUG::2014-10-29 11:20:57,478::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`9e6211c9-009d-4cfa-96eb-4919f7f2865d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136676::DEBUG::2014-10-29 11:20:57,478::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136676::DEBUG::2014-10-29 11:20:57,479::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136676::DEBUG::2014-10-29 11:20:57,479::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`9e6211c9-009d-4cfa-96eb-4919f7f2865d`::Granted request >Thread-136676::DEBUG::2014-10-29 11:20:57,480::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`38382008-44f3-4dca-940a-3ad1fba1a646`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136676::DEBUG::2014-10-29 11:20:57,480::task::993::Storage.TaskManager.Task::(_decref) Task=`38382008-44f3-4dca-940a-3ad1fba1a646`::ref 1 aborting False >Thread-136676::INFO::2014-10-29 11:20:57,483::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136676::DEBUG::2014-10-29 11:20:57,483::task::1191::Storage.TaskManager.Task::(prepare) Task=`38382008-44f3-4dca-940a-3ad1fba1a646`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136676::DEBUG::2014-10-29 11:20:57,483::task::595::Storage.TaskManager.Task::(_updateState) Task=`38382008-44f3-4dca-940a-3ad1fba1a646`::moving from state preparing -> state finished >Thread-136676::DEBUG::2014-10-29 11:20:57,484::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136676::DEBUG::2014-10-29 11:20:57,484::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136676::DEBUG::2014-10-29 11:20:57,484::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136676::DEBUG::2014-10-29 11:20:57,485::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136676::DEBUG::2014-10-29 11:20:57,485::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136676::DEBUG::2014-10-29 11:20:57,485::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136676::DEBUG::2014-10-29 11:20:57,485::task::993::Storage.TaskManager.Task::(_decref) Task=`38382008-44f3-4dca-940a-3ad1fba1a646`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:20:57,509::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54506 >Detector thread::DEBUG::2014-10-29 11:20:57,509::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54506 >Detector thread::DEBUG::2014-10-29 11:20:57,509::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54506 >Detector thread::DEBUG::2014-10-29 11:20:57,510::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54506) >Thread-136681::DEBUG::2014-10-29 11:20:57,549::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136681::DEBUG::2014-10-29 11:20:57,549::task::595::Storage.TaskManager.Task::(_updateState) Task=`bbee9263-37bc-4855-ad86-3aebd904f3ad`::moving from state init -> state preparing >Thread-136681::INFO::2014-10-29 11:20:57,550::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136681::INFO::2014-10-29 11:20:57,551::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518197', 'lastCheck': '2.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527302', 'lastCheck': '2.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535163', 'lastCheck': '2.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000954341', 'lastCheck': '2.2', 'valid': True}} >Thread-136681::DEBUG::2014-10-29 11:20:57,551::task::1191::Storage.TaskManager.Task::(prepare) Task=`bbee9263-37bc-4855-ad86-3aebd904f3ad`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518197', 'lastCheck': '2.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527302', 'lastCheck': '2.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535163', 'lastCheck': '2.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000954341', 'lastCheck': '2.2', 'valid': True}} >Thread-136681::DEBUG::2014-10-29 11:20:57,551::task::595::Storage.TaskManager.Task::(_updateState) Task=`bbee9263-37bc-4855-ad86-3aebd904f3ad`::moving from state preparing -> state finished >Thread-136681::DEBUG::2014-10-29 11:20:57,551::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136681::DEBUG::2014-10-29 11:20:57,552::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136681::DEBUG::2014-10-29 11:20:57,552::task::993::Storage.TaskManager.Task::(_decref) Task=`bbee9263-37bc-4855-ad86-3aebd904f3ad`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:59,489::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:59,492::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136682::DEBUG::2014-10-29 11:20:59,496::task::595::Storage.TaskManager.Task::(_updateState) Task=`11cb1de7-7fca-4520-99f4-e600094e32b5`::moving from state init -> state preparing >Thread-136682::INFO::2014-10-29 11:20:59,496::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136682::INFO::2014-10-29 11:20:59,497::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518197', 'lastCheck': '4.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527302', 'lastCheck': '3.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535163', 'lastCheck': '4.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000954341', 'lastCheck': '4.1', 'valid': True}} >Thread-136682::DEBUG::2014-10-29 11:20:59,497::task::1191::Storage.TaskManager.Task::(prepare) Task=`11cb1de7-7fca-4520-99f4-e600094e32b5`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518197', 'lastCheck': '4.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527302', 'lastCheck': '3.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535163', 'lastCheck': '4.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000954341', 'lastCheck': '4.1', 'valid': True}} >Thread-136682::DEBUG::2014-10-29 11:20:59,498::task::595::Storage.TaskManager.Task::(_updateState) Task=`11cb1de7-7fca-4520-99f4-e600094e32b5`::moving from state preparing -> state finished >Thread-136682::DEBUG::2014-10-29 11:20:59,498::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136682::DEBUG::2014-10-29 11:20:59,498::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136682::DEBUG::2014-10-29 11:20:59,498::task::993::Storage.TaskManager.Task::(_decref) Task=`11cb1de7-7fca-4520-99f4-e600094e32b5`::ref 0 aborting False >Thread-136682::DEBUG::2014-10-29 11:20:59,533::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:20:59,559::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:20:59,560::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136683::DEBUG::2014-10-29 11:20:59,564::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136683::DEBUG::2014-10-29 11:20:59,566::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:21:00,271::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54507 >Detector thread::DEBUG::2014-10-29 11:21:00,271::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54507 >Detector thread::DEBUG::2014-10-29 11:21:00,272::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54507 >Detector thread::DEBUG::2014-10-29 11:21:00,272::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54507) >Thread-136684::DEBUG::2014-10-29 11:21:00,311::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136684::DEBUG::2014-10-29 11:21:00,313::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136684::DEBUG::2014-10-29 11:21:00,331::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136684::DEBUG::2014-10-29 11:21:00,382::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '103', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '3', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:00,589::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:00,590::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:00,593::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:21:00,746::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54508 >Detector thread::DEBUG::2014-10-29 11:21:00,746::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54508 >Detector thread::DEBUG::2014-10-29 11:21:00,747::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54508 >Detector thread::DEBUG::2014-10-29 11:21:00,747::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54508) >Thread-136685::DEBUG::2014-10-29 11:21:00,787::task::595::Storage.TaskManager.Task::(_updateState) Task=`95105a47-1878-47a7-b0f4-8846c3917b29`::moving from state init -> state preparing >Thread-136685::INFO::2014-10-29 11:21:00,787::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136685::INFO::2014-10-29 11:21:00,788::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518197', 'lastCheck': '5.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527302', 'lastCheck': '5.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535163', 'lastCheck': '5.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000954341', 'lastCheck': '5.4', 'valid': True}} >Thread-136685::DEBUG::2014-10-29 11:21:00,788::task::1191::Storage.TaskManager.Task::(prepare) Task=`95105a47-1878-47a7-b0f4-8846c3917b29`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518197', 'lastCheck': '5.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000527302', 'lastCheck': '5.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535163', 'lastCheck': '5.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000954341', 'lastCheck': '5.4', 'valid': True}} >Thread-136685::DEBUG::2014-10-29 11:21:00,788::task::595::Storage.TaskManager.Task::(_updateState) Task=`95105a47-1878-47a7-b0f4-8846c3917b29`::moving from state preparing -> state finished >Thread-136685::DEBUG::2014-10-29 11:21:00,789::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136685::DEBUG::2014-10-29 11:21:00,789::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136685::DEBUG::2014-10-29 11:21:00,789::task::993::Storage.TaskManager.Task::(_decref) Task=`95105a47-1878-47a7-b0f4-8846c3917b29`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:21:00,986::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54509 >Detector thread::DEBUG::2014-10-29 11:21:00,987::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54509 >Detector thread::DEBUG::2014-10-29 11:21:00,987::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54509 >Detector thread::DEBUG::2014-10-29 11:21:00,988::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54509) >Thread-136686::DEBUG::2014-10-29 11:21:01,027::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136686::DEBUG::2014-10-29 11:21:01,028::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136686::DEBUG::2014-10-29 11:21:01,028::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.59', 'elapsedTime': '514293', 'displayType': 'vnc', 'cpuSys': '0.60', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '54734861', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57351', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '54096.31'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.52', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:02,657::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:02,660::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136687::DEBUG::2014-10-29 11:21:02,663::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:02,665::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:02,667::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136688::DEBUG::2014-10-29 11:21:02,670::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136688::DEBUG::2014-10-29 11:21:02,672::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:21:04,255::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >Thread-22::DEBUG::2014-10-29 11:21:04,524::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-17::DEBUG::2014-10-29 11:21:04,992::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:04,993::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:04,993::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:04,993::__init__::232::IOProcess::(_processLogs) (201465) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:04,995::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201465) Queuing response >Thread-179::DEBUG::2014-10-29 11:21:04,997::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:21:05,017::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000426098 s, 873 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:21:05,018::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:05,019::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:05,019::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:05,019::__init__::232::IOProcess::(_processLogs) (201466) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:05,020::__init__::232::IOProcess::(_processLogs) (201466) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:05,376::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:05,376::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:05,376::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:05,377::__init__::232::IOProcess::(_processLogs) (201467) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:05,378::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201467) Queuing response >Thread-10269::DEBUG::2014-10-29 11:21:05,379::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:21:05,398::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000429212 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:21:05,400::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:05,401::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:05,401::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:05,401::__init__::232::IOProcess::(_processLogs) (201468) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:05,401::__init__::232::IOProcess::(_processLogs) (201468) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:05,472::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:05,472::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:05,473::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:05,473::__init__::232::IOProcess::(_processLogs) (201469) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:05,473::__init__::232::IOProcess::(_processLogs) (201469) Queuing response >Thread-178::DEBUG::2014-10-29 11:21:05,475::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:21:05,491::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000512242 s, 992 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:21:05,493::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:05,494::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:05,494::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:05,494::__init__::232::IOProcess::(_processLogs) (201470) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:05,494::__init__::232::IOProcess::(_processLogs) (201470) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:05,496::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:05,497::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:05,498::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:05,498::__init__::232::IOProcess::(_processLogs) (201471) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:05,499::__init__::232::IOProcess::(_processLogs) (201471) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:05,499::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:05,500::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:05,501::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:05,501::__init__::232::IOProcess::(_processLogs) (201472) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:05,501::__init__::232::IOProcess::(_processLogs) (201472) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:05,502::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:05,503::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:05,504::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:05,505::__init__::232::IOProcess::(_processLogs) (201473) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:05,505::__init__::232::IOProcess::(_processLogs) (201473) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:05,552::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:05,552::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:05,552::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:05,553::__init__::232::IOProcess::(_processLogs) (201474) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:05,554::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201474) Queuing response >Thread-33::DEBUG::2014-10-29 11:21:05,555::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:21:05,574::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000610476 s, 798 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:21:05,576::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:05,576::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:05,578::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:05,580::__init__::232::IOProcess::(_processLogs) (201475) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:05,580::__init__::232::IOProcess::(_processLogs) (201475) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:05,581::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:05,581::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:05,581::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:05,581::__init__::232::IOProcess::(_processLogs) (201476) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:05,582::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201476) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:05,583::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:05,583::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:05,583::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:05,584::__init__::232::IOProcess::(_processLogs) (201477) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:05,584::__init__::232::IOProcess::(_processLogs) (201477) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:05,585::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:05,585::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:05,586::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:05,586::__init__::232::IOProcess::(_processLogs) (201478) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:05,586::__init__::232::IOProcess::(_processLogs) (201478) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:05,601::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:05,602::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:05,604::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:05,689::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:05,692::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136689::DEBUG::2014-10-29 11:21:05,695::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:05,697::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:05,699::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136690::DEBUG::2014-10-29 11:21:05,702::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136690::DEBUG::2014-10-29 11:21:05,704::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:21:08,139::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54512 >Detector thread::DEBUG::2014-10-29 11:21:08,139::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54512 >Detector thread::DEBUG::2014-10-29 11:21:08,140::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54512 >Detector thread::DEBUG::2014-10-29 11:21:08,140::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54512) >Thread-136691::DEBUG::2014-10-29 11:21:08,180::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136691::DEBUG::2014-10-29 11:21:08,181::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d5b5d2e-c2fa-4a81-9093-8b36a4d0b3b2`::moving from state init -> state preparing >Thread-136691::INFO::2014-10-29 11:21:08,181::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136691::DEBUG::2014-10-29 11:21:08,184::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:21:08,185::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:08,185::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:08,185::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:08,186::__init__::232::IOProcess::(_processLogs) (201479) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:08,186::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201479) Queuing response >Thread-136691::DEBUG::2014-10-29 11:21:08,187::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136691::DEBUG::2014-10-29 11:21:08,188::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136691::INFO::2014-10-29 11:21:08,188::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136691::DEBUG::2014-10-29 11:21:08,188::task::1191::Storage.TaskManager.Task::(prepare) Task=`9d5b5d2e-c2fa-4a81-9093-8b36a4d0b3b2`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136691::DEBUG::2014-10-29 11:21:08,189::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d5b5d2e-c2fa-4a81-9093-8b36a4d0b3b2`::moving from state preparing -> state finished >Thread-136691::DEBUG::2014-10-29 11:21:08,189::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136691::DEBUG::2014-10-29 11:21:08,189::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136691::DEBUG::2014-10-29 11:21:08,190::task::993::Storage.TaskManager.Task::(_decref) Task=`9d5b5d2e-c2fa-4a81-9093-8b36a4d0b3b2`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:21:08,239::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54513 >Detector thread::DEBUG::2014-10-29 11:21:08,242::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54513 >Detector thread::DEBUG::2014-10-29 11:21:08,242::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54513 >Detector thread::DEBUG::2014-10-29 11:21:08,243::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54513) >Thread-136692::DEBUG::2014-10-29 11:21:08,282::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136692::DEBUG::2014-10-29 11:21:08,283::task::595::Storage.TaskManager.Task::(_updateState) Task=`93b29bc9-4833-421a-a2d7-30f1c4f25fba`::moving from state init -> state preparing >Thread-136692::INFO::2014-10-29 11:21:08,284::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136692::DEBUG::2014-10-29 11:21:08,284::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136692::DEBUG::2014-10-29 11:21:08,284::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136692::DEBUG::2014-10-29 11:21:08,285::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136692::DEBUG::2014-10-29 11:21:08,285::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136692::DEBUG::2014-10-29 11:21:08,285::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136692::DEBUG::2014-10-29 11:21:08,286::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136692::DEBUG::2014-10-29 11:21:08,383::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136692::DEBUG::2014-10-29 11:21:08,384::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136692::DEBUG::2014-10-29 11:21:08,556::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136692::DEBUG::2014-10-29 11:21:08,558::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136692::DEBUG::2014-10-29 11:21:08,558::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136692::DEBUG::2014-10-29 11:21:08,559::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136692::DEBUG::2014-10-29 11:21:08,559::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136692::DEBUG::2014-10-29 11:21:08,559::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136692::DEBUG::2014-10-29 11:21:08,560::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136692::DEBUG::2014-10-29 11:21:08,560::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:21:08,564::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:08,564::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:08,565::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:08,570::__init__::232::IOProcess::(_processLogs) (201480) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:08,571::__init__::232::IOProcess::(_processLogs) (201480) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:08,572::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:08,572::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:08,573::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:08,573::__init__::232::IOProcess::(_processLogs) (201481) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:08,575::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201481) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:08,578::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:08,580::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:08,582::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:08,583::__init__::232::IOProcess::(_processLogs) (201482) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:08,585::__init__::232::IOProcess::(_processLogs) (201482) Queuing response >Thread-136692::DEBUG::2014-10-29 11:21:08,588::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:21:08,591::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:08,592::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:08,593::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:08,593::__init__::232::IOProcess::(_processLogs) (201483) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:08,594::__init__::232::IOProcess::(_processLogs) (201483) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:08,594::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:08,595::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:08,595::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:08,595::__init__::232::IOProcess::(_processLogs) (201484) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:21:08,596::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201484) Queuing response >Thread-136692::DEBUG::2014-10-29 11:21:08,597::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:21:08,598::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:08,598::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:08,599::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:08,600::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201485) Got request for method 'readfile' >Thread-136692::DEBUG::2014-10-29 11:21:08,600::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:21:08,601::__init__::232::IOProcess::(_processLogs) (201485) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:08,603::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:08,604::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:08,604::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:08,605::__init__::232::IOProcess::(_processLogs) (201486) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:08,605::__init__::232::IOProcess::(_processLogs) (201486) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:08,606::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:08,606::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:08,606::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:08,607::__init__::232::IOProcess::(_processLogs) (201487) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:08,608::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201487) Queuing response >Thread-136692::DEBUG::2014-10-29 11:21:08,607::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-136692::INFO::2014-10-29 11:21:08,609::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136692::INFO::2014-10-29 11:21:08,609::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136692::INFO::2014-10-29 11:21:08,609::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:21:08,610::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:08,611::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:08,611::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:08,611::__init__::232::IOProcess::(_processLogs) (201488) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:21:08,612::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201488) Queuing response >Thread-136692::DEBUG::2014-10-29 11:21:08,613::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136692::DEBUG::2014-10-29 11:21:08,615::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`e9a7dd1a-6866-4508-a10b-e4d9736dd389`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136692::DEBUG::2014-10-29 11:21:08,615::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136692::DEBUG::2014-10-29 11:21:08,616::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136692::DEBUG::2014-10-29 11:21:08,616::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`e9a7dd1a-6866-4508-a10b-e4d9736dd389`::Granted request >Thread-136692::DEBUG::2014-10-29 11:21:08,617::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`93b29bc9-4833-421a-a2d7-30f1c4f25fba`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136692::DEBUG::2014-10-29 11:21:08,617::task::993::Storage.TaskManager.Task::(_decref) Task=`93b29bc9-4833-421a-a2d7-30f1c4f25fba`::ref 1 aborting False >Thread-136692::INFO::2014-10-29 11:21:08,620::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136692::DEBUG::2014-10-29 11:21:08,620::task::1191::Storage.TaskManager.Task::(prepare) Task=`93b29bc9-4833-421a-a2d7-30f1c4f25fba`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136692::DEBUG::2014-10-29 11:21:08,620::task::595::Storage.TaskManager.Task::(_updateState) Task=`93b29bc9-4833-421a-a2d7-30f1c4f25fba`::moving from state preparing -> state finished >Thread-136692::DEBUG::2014-10-29 11:21:08,620::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136692::DEBUG::2014-10-29 11:21:08,621::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136692::DEBUG::2014-10-29 11:21:08,621::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136692::DEBUG::2014-10-29 11:21:08,621::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136692::DEBUG::2014-10-29 11:21:08,622::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136692::DEBUG::2014-10-29 11:21:08,622::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136692::DEBUG::2014-10-29 11:21:08,622::task::993::Storage.TaskManager.Task::(_decref) Task=`93b29bc9-4833-421a-a2d7-30f1c4f25fba`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:21:08,655::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54514 >Detector thread::DEBUG::2014-10-29 11:21:08,655::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54514 >Detector thread::DEBUG::2014-10-29 11:21:08,656::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54514 >Detector thread::DEBUG::2014-10-29 11:21:08,656::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54514) >Thread-136697::DEBUG::2014-10-29 11:21:08,695::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136697::DEBUG::2014-10-29 11:21:08,696::task::595::Storage.TaskManager.Task::(_updateState) Task=`bb043802-2fd9-4813-9d5a-4d00be6056d2`::moving from state init -> state preparing >Thread-136697::INFO::2014-10-29 11:21:08,696::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136697::INFO::2014-10-29 11:21:08,697::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000512242', 'lastCheck': '3.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610476', 'lastCheck': '3.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426098', 'lastCheck': '3.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000429212', 'lastCheck': '3.3', 'valid': True}} >Thread-136697::DEBUG::2014-10-29 11:21:08,697::task::1191::Storage.TaskManager.Task::(prepare) Task=`bb043802-2fd9-4813-9d5a-4d00be6056d2`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000512242', 'lastCheck': '3.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610476', 'lastCheck': '3.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426098', 'lastCheck': '3.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000429212', 'lastCheck': '3.3', 'valid': True}} >Thread-136697::DEBUG::2014-10-29 11:21:08,698::task::595::Storage.TaskManager.Task::(_updateState) Task=`bb043802-2fd9-4813-9d5a-4d00be6056d2`::moving from state preparing -> state finished >Thread-136697::DEBUG::2014-10-29 11:21:08,698::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136697::DEBUG::2014-10-29 11:21:08,698::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136697::DEBUG::2014-10-29 11:21:08,698::task::993::Storage.TaskManager.Task::(_decref) Task=`bb043802-2fd9-4813-9d5a-4d00be6056d2`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:08,718::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:08,720::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136698::DEBUG::2014-10-29 11:21:08,725::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:08,727::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:08,729::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136699::DEBUG::2014-10-29 11:21:08,732::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136699::DEBUG::2014-10-29 11:21:08,735::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:21:10,449::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54515 >Detector thread::DEBUG::2014-10-29 11:21:10,450::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54515 >Detector thread::DEBUG::2014-10-29 11:21:10,450::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54515 >Detector thread::DEBUG::2014-10-29 11:21:10,451::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54515) >Thread-136700::DEBUG::2014-10-29 11:21:10,491::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136700::DEBUG::2014-10-29 11:21:10,493::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136700::DEBUG::2014-10-29 11:21:10,514::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136700::DEBUG::2014-10-29 11:21:10,562::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '85', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '85', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:10,607::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:10,609::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:10,619::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:21:10,846::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54516 >Detector thread::DEBUG::2014-10-29 11:21:10,847::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54516 >Detector thread::DEBUG::2014-10-29 11:21:10,847::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54516 >Detector thread::DEBUG::2014-10-29 11:21:10,848::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54516) >Thread-136701::DEBUG::2014-10-29 11:21:10,887::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0d57643-6505-4b48-9fd1-cd0b4ff05a38`::moving from state init -> state preparing >Thread-136701::INFO::2014-10-29 11:21:10,887::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136701::INFO::2014-10-29 11:21:10,888::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000512242', 'lastCheck': '5.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610476', 'lastCheck': '5.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426098', 'lastCheck': '5.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000429212', 'lastCheck': '5.5', 'valid': True}} >Thread-136701::DEBUG::2014-10-29 11:21:10,888::task::1191::Storage.TaskManager.Task::(prepare) Task=`d0d57643-6505-4b48-9fd1-cd0b4ff05a38`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000512242', 'lastCheck': '5.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610476', 'lastCheck': '5.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426098', 'lastCheck': '5.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000429212', 'lastCheck': '5.5', 'valid': True}} >Thread-136701::DEBUG::2014-10-29 11:21:10,889::task::595::Storage.TaskManager.Task::(_updateState) Task=`d0d57643-6505-4b48-9fd1-cd0b4ff05a38`::moving from state preparing -> state finished >Thread-136701::DEBUG::2014-10-29 11:21:10,889::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136701::DEBUG::2014-10-29 11:21:10,889::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136701::DEBUG::2014-10-29 11:21:10,889::task::993::Storage.TaskManager.Task::(_decref) Task=`d0d57643-6505-4b48-9fd1-cd0b4ff05a38`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:21:11,172::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54517 >Detector thread::DEBUG::2014-10-29 11:21:11,173::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54517 >Detector thread::DEBUG::2014-10-29 11:21:11,173::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54517 >Detector thread::DEBUG::2014-10-29 11:21:11,173::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54517) >Thread-136702::DEBUG::2014-10-29 11:21:11,212::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136702::DEBUG::2014-10-29 11:21:11,213::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136702::DEBUG::2014-10-29 11:21:11,213::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.57', 'elapsedTime': '514303', 'displayType': 'vnc', 'cpuSys': '1.26', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '54734861', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57351', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '54096.31'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.69', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:11,754::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:11,757::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136703::DEBUG::2014-10-29 11:21:11,760::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:11,763::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:11,765::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136704::DEBUG::2014-10-29 11:21:11,768::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136704::DEBUG::2014-10-29 11:21:11,770::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:14,784::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:14,787::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136705::DEBUG::2014-10-29 11:21:14,791::task::595::Storage.TaskManager.Task::(_updateState) Task=`b548b4db-b4fa-4f08-b29e-16ba45cd2557`::moving from state init -> state preparing >Thread-136705::INFO::2014-10-29 11:21:14,792::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136705::INFO::2014-10-29 11:21:14,793::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000512242', 'lastCheck': '9.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610476', 'lastCheck': '9.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426098', 'lastCheck': '9.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000429212', 'lastCheck': '9.4', 'valid': True}} >Thread-136705::DEBUG::2014-10-29 11:21:14,793::task::1191::Storage.TaskManager.Task::(prepare) Task=`b548b4db-b4fa-4f08-b29e-16ba45cd2557`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000512242', 'lastCheck': '9.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000610476', 'lastCheck': '9.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000426098', 'lastCheck': '9.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000429212', 'lastCheck': '9.4', 'valid': True}} >Thread-136705::DEBUG::2014-10-29 11:21:14,793::task::595::Storage.TaskManager.Task::(_updateState) Task=`b548b4db-b4fa-4f08-b29e-16ba45cd2557`::moving from state preparing -> state finished >Thread-136705::DEBUG::2014-10-29 11:21:14,793::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136705::DEBUG::2014-10-29 11:21:14,794::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136705::DEBUG::2014-10-29 11:21:14,794::task::993::Storage.TaskManager.Task::(_decref) Task=`b548b4db-b4fa-4f08-b29e-16ba45cd2557`::ref 0 aborting False >Thread-136705::DEBUG::2014-10-29 11:21:14,827::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:14,850::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:14,852::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136706::DEBUG::2014-10-29 11:21:14,855::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136706::DEBUG::2014-10-29 11:21:14,857::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:21:15,024::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:15,025::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:15,025::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:15,025::__init__::232::IOProcess::(_processLogs) (201489) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:15,026::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201489) Queuing response >Thread-179::DEBUG::2014-10-29 11:21:15,028::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:21:15,046::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000578666 s, 643 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:21:15,048::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:15,049::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:15,049::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:15,049::__init__::232::IOProcess::(_processLogs) (201490) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:15,051::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201490) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:15,404::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:15,405::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:15,405::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:15,405::__init__::232::IOProcess::(_processLogs) (201491) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:15,407::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201491) Queuing response >Thread-10269::DEBUG::2014-10-29 11:21:15,408::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:21:15,426::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000525961 s, 954 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:21:15,429::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:15,429::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:15,429::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:15,430::__init__::232::IOProcess::(_processLogs) (201492) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:15,430::__init__::232::IOProcess::(_processLogs) (201492) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:15,506::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:15,506::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:15,506::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:15,506::__init__::232::IOProcess::(_processLogs) (201493) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:15,508::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201493) Queuing response >Thread-178::DEBUG::2014-10-29 11:21:15,509::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:21:15,527::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000506196 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:21:15,530::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:15,531::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:15,531::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:15,531::__init__::232::IOProcess::(_processLogs) (201494) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:15,533::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201494) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:15,535::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:15,535::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:15,535::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:15,536::__init__::232::IOProcess::(_processLogs) (201495) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:15,537::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201495) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:15,537::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:15,538::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:15,538::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:15,539::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201496) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:15,540::__init__::232::IOProcess::(_processLogs) (201496) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:15,540::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:15,540::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:15,541::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:15,542::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201497) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:15,542::__init__::232::IOProcess::(_processLogs) (201497) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:15,588::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:15,589::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:15,589::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:15,590::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201498) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:15,593::__init__::232::IOProcess::(_processLogs) (201498) Queuing response >Thread-33::DEBUG::2014-10-29 11:21:15,592::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:21:15,611::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000630837 s, 772 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:21:15,613::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:15,615::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:15,617::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:15,617::__init__::232::IOProcess::(_processLogs) (201499) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:15,618::__init__::232::IOProcess::(_processLogs) (201499) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:15,618::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:15,619::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:15,619::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:15,619::__init__::232::IOProcess::(_processLogs) (201500) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:15,620::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201500) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:15,621::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:15,622::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:15,622::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:15,622::__init__::232::IOProcess::(_processLogs) (201501) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:15,622::__init__::232::IOProcess::(_processLogs) (201501) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:15,624::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:15,624::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:15,626::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:15,629::__init__::232::IOProcess::(_processLogs) (201502) Got request for method 'access' >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:15,629::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:21:15,631::__init__::232::IOProcess::(_processLogs) (201502) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:15,633::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:15,634::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:17,910::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:17,912::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136707::DEBUG::2014-10-29 11:21:17,915::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:17,917::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:17,919::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136708::DEBUG::2014-10-29 11:21:17,922::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136708::DEBUG::2014-10-29 11:21:17,925::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:21:19,272::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54520 >Detector thread::DEBUG::2014-10-29 11:21:19,274::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54520 >Detector thread::DEBUG::2014-10-29 11:21:19,275::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54520 >Detector thread::DEBUG::2014-10-29 11:21:19,275::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54520) >Thread-136709::DEBUG::2014-10-29 11:21:19,313::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136709::DEBUG::2014-10-29 11:21:19,314::task::595::Storage.TaskManager.Task::(_updateState) Task=`eaeb85f8-4ded-4b20-8de9-1f65cd984c4b`::moving from state init -> state preparing >Thread-136709::INFO::2014-10-29 11:21:19,314::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136709::DEBUG::2014-10-29 11:21:19,331::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:21:19,332::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:19,332::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:19,333::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:19,333::__init__::232::IOProcess::(_processLogs) (201503) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:19,333::__init__::232::IOProcess::(_processLogs) (201503) Queuing response >Thread-136709::DEBUG::2014-10-29 11:21:19,334::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136709::DEBUG::2014-10-29 11:21:19,335::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136709::INFO::2014-10-29 11:21:19,335::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136709::DEBUG::2014-10-29 11:21:19,335::task::1191::Storage.TaskManager.Task::(prepare) Task=`eaeb85f8-4ded-4b20-8de9-1f65cd984c4b`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136709::DEBUG::2014-10-29 11:21:19,336::task::595::Storage.TaskManager.Task::(_updateState) Task=`eaeb85f8-4ded-4b20-8de9-1f65cd984c4b`::moving from state preparing -> state finished >Thread-136709::DEBUG::2014-10-29 11:21:19,336::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136709::DEBUG::2014-10-29 11:21:19,336::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136709::DEBUG::2014-10-29 11:21:19,336::task::993::Storage.TaskManager.Task::(_decref) Task=`eaeb85f8-4ded-4b20-8de9-1f65cd984c4b`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:21:19,380::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54521 >Detector thread::DEBUG::2014-10-29 11:21:19,380::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54521 >Detector thread::DEBUG::2014-10-29 11:21:19,381::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54521 >Detector thread::DEBUG::2014-10-29 11:21:19,381::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54521) >Thread-136710::DEBUG::2014-10-29 11:21:19,420::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136710::DEBUG::2014-10-29 11:21:19,420::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a49277a-7a96-4967-80e4-4c27befe2e92`::moving from state init -> state preparing >Thread-136710::INFO::2014-10-29 11:21:19,421::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136710::DEBUG::2014-10-29 11:21:19,421::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136710::DEBUG::2014-10-29 11:21:19,421::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136710::DEBUG::2014-10-29 11:21:19,422::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136710::DEBUG::2014-10-29 11:21:19,422::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136710::DEBUG::2014-10-29 11:21:19,422::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136710::DEBUG::2014-10-29 11:21:19,423::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136710::DEBUG::2014-10-29 11:21:19,500::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136710::DEBUG::2014-10-29 11:21:19,501::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-22::DEBUG::2014-10-29 11:21:19,551::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-136710::DEBUG::2014-10-29 11:21:19,677::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136710::DEBUG::2014-10-29 11:21:19,678::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136710::DEBUG::2014-10-29 11:21:19,679::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136710::DEBUG::2014-10-29 11:21:19,679::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136710::DEBUG::2014-10-29 11:21:19,679::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136710::DEBUG::2014-10-29 11:21:19,680::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136710::DEBUG::2014-10-29 11:21:19,680::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136710::DEBUG::2014-10-29 11:21:19,680::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:21:19,688::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:19,690::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:19,690::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:19,691::__init__::232::IOProcess::(_processLogs) (201504) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:19,692::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201504) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:19,693::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:19,693::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:19,694::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:19,694::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:19,694::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:19,695::__init__::232::IOProcess::(_processLogs) (201505) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:19,695::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:19,695::__init__::232::IOProcess::(_processLogs) (201506) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:19,696::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201506) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:19,697::__init__::232::IOProcess::(_processLogs) (201505) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:19,697::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:19,697::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:19,698::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:19,698::__init__::232::IOProcess::(_processLogs) (201507) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:19,699::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201507) Queuing response >Thread-136710::DEBUG::2014-10-29 11:21:19,705::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:21:19,706::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:19,706::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:19,706::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:19,707::__init__::232::IOProcess::(_processLogs) (201508) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:21:19,708::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201508) Queuing response >Thread-136710::DEBUG::2014-10-29 11:21:19,709::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:21:19,710::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:19,711::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:19,711::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:19,711::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201509) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:21:19,712::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201509) Queuing response >Thread-136710::DEBUG::2014-10-29 11:21:19,712::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:21:19,715::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:19,716::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:19,716::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:19,716::__init__::232::IOProcess::(_processLogs) (201510) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:19,717::__init__::232::IOProcess::(_processLogs) (201510) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:19,717::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:19,718::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:19,718::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:19,718::__init__::232::IOProcess::(_processLogs) (201511) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:19,719::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201511) Queuing response >Thread-136710::DEBUG::2014-10-29 11:21:19,719::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-136710::INFO::2014-10-29 11:21:19,720::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136710::INFO::2014-10-29 11:21:19,720::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136710::INFO::2014-10-29 11:21:19,721::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:21:19,722::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:19,722::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:19,722::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:19,722::__init__::232::IOProcess::(_processLogs) (201512) Got request for method 'readfile' >Thread-136710::DEBUG::2014-10-29 11:21:19,723::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:21:19,723::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201512) Queuing response >Thread-136710::DEBUG::2014-10-29 11:21:19,726::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`e84b9c95-f30c-4163-a8c7-886d643af6b8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136710::DEBUG::2014-10-29 11:21:19,726::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136710::DEBUG::2014-10-29 11:21:19,727::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136710::DEBUG::2014-10-29 11:21:19,727::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`e84b9c95-f30c-4163-a8c7-886d643af6b8`::Granted request >Thread-136710::DEBUG::2014-10-29 11:21:19,728::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6a49277a-7a96-4967-80e4-4c27befe2e92`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136710::DEBUG::2014-10-29 11:21:19,728::task::993::Storage.TaskManager.Task::(_decref) Task=`6a49277a-7a96-4967-80e4-4c27befe2e92`::ref 1 aborting False >Thread-136710::INFO::2014-10-29 11:21:19,731::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136710::DEBUG::2014-10-29 11:21:19,731::task::1191::Storage.TaskManager.Task::(prepare) Task=`6a49277a-7a96-4967-80e4-4c27befe2e92`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136710::DEBUG::2014-10-29 11:21:19,731::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a49277a-7a96-4967-80e4-4c27befe2e92`::moving from state preparing -> state finished >Thread-136710::DEBUG::2014-10-29 11:21:19,731::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136710::DEBUG::2014-10-29 11:21:19,732::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136710::DEBUG::2014-10-29 11:21:19,732::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136710::DEBUG::2014-10-29 11:21:19,732::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136710::DEBUG::2014-10-29 11:21:19,733::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136710::DEBUG::2014-10-29 11:21:19,733::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136710::DEBUG::2014-10-29 11:21:19,733::task::993::Storage.TaskManager.Task::(_decref) Task=`6a49277a-7a96-4967-80e4-4c27befe2e92`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:21:19,756::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54522 >Detector thread::DEBUG::2014-10-29 11:21:19,756::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54522 >Detector thread::DEBUG::2014-10-29 11:21:19,756::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54522 >Detector thread::DEBUG::2014-10-29 11:21:19,757::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54522) >Thread-136715::DEBUG::2014-10-29 11:21:19,796::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136715::DEBUG::2014-10-29 11:21:19,796::task::595::Storage.TaskManager.Task::(_updateState) Task=`449bd342-8181-4f6e-9cc9-5dcec2c53f68`::moving from state init -> state preparing >Thread-136715::INFO::2014-10-29 11:21:19,797::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136715::INFO::2014-10-29 11:21:19,797::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506196', 'lastCheck': '4.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630837', 'lastCheck': '4.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000578666', 'lastCheck': '4.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000525961', 'lastCheck': '4.4', 'valid': True}} >Thread-136715::DEBUG::2014-10-29 11:21:19,798::task::1191::Storage.TaskManager.Task::(prepare) Task=`449bd342-8181-4f6e-9cc9-5dcec2c53f68`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506196', 'lastCheck': '4.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630837', 'lastCheck': '4.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000578666', 'lastCheck': '4.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000525961', 'lastCheck': '4.4', 'valid': True}} >Thread-136715::DEBUG::2014-10-29 11:21:19,798::task::595::Storage.TaskManager.Task::(_updateState) Task=`449bd342-8181-4f6e-9cc9-5dcec2c53f68`::moving from state preparing -> state finished >Thread-136715::DEBUG::2014-10-29 11:21:19,798::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136715::DEBUG::2014-10-29 11:21:19,798::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136715::DEBUG::2014-10-29 11:21:19,799::task::993::Storage.TaskManager.Task::(_decref) Task=`449bd342-8181-4f6e-9cc9-5dcec2c53f68`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:21:20,361::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54523 >Detector thread::DEBUG::2014-10-29 11:21:20,362::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54523 >Detector thread::DEBUG::2014-10-29 11:21:20,362::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54523 >Detector thread::DEBUG::2014-10-29 11:21:20,363::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54523) >Thread-136716::DEBUG::2014-10-29 11:21:20,402::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136716::DEBUG::2014-10-29 11:21:20,403::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136716::DEBUG::2014-10-29 11:21:20,404::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.43', 'elapsedTime': '514312', 'displayType': 'vnc', 'cpuSys': '0.47', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '54734861', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57351', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '54096.31'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.87', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:21:20,611::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54525 >Detector thread::DEBUG::2014-10-29 11:21:20,612::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54525 >Detector thread::DEBUG::2014-10-29 11:21:20,612::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54525 >Detector thread::DEBUG::2014-10-29 11:21:20,612::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54525) >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:20,641::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:20,642::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:20,645::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136717::DEBUG::2014-10-29 11:21:20,651::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136717::DEBUG::2014-10-29 11:21:20,653::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136717::DEBUG::2014-10-29 11:21:20,671::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136717::DEBUG::2014-10-29 11:21:20,717::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '69', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '69', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:20,944::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:20,947::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136718::DEBUG::2014-10-29 11:21:20,951::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:20,953::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:20,955::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Detector thread::DEBUG::2014-10-29 11:21:20,957::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54526 >Detector thread::DEBUG::2014-10-29 11:21:20,960::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54526 >Detector thread::DEBUG::2014-10-29 11:21:20,962::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54526 >Thread-136719::DEBUG::2014-10-29 11:21:20,963::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:21:20,965::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54526) >Thread-136719::DEBUG::2014-10-29 11:21:20,971::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-136720::DEBUG::2014-10-29 11:21:20,998::task::595::Storage.TaskManager.Task::(_updateState) Task=`afb156cc-dacd-41e1-a5d8-2f5997be03f5`::moving from state init -> state preparing >Thread-136720::INFO::2014-10-29 11:21:20,998::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136720::INFO::2014-10-29 11:21:20,999::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506196', 'lastCheck': '5.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630837', 'lastCheck': '5.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000578666', 'lastCheck': '5.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000525961', 'lastCheck': '5.6', 'valid': True}} >Thread-136720::DEBUG::2014-10-29 11:21:20,999::task::1191::Storage.TaskManager.Task::(prepare) Task=`afb156cc-dacd-41e1-a5d8-2f5997be03f5`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506196', 'lastCheck': '5.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630837', 'lastCheck': '5.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000578666', 'lastCheck': '5.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000525961', 'lastCheck': '5.6', 'valid': True}} >Thread-136720::DEBUG::2014-10-29 11:21:21,000::task::595::Storage.TaskManager.Task::(_updateState) Task=`afb156cc-dacd-41e1-a5d8-2f5997be03f5`::moving from state preparing -> state finished >Thread-136720::DEBUG::2014-10-29 11:21:21,000::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136720::DEBUG::2014-10-29 11:21:21,000::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136720::DEBUG::2014-10-29 11:21:21,000::task::993::Storage.TaskManager.Task::(_decref) Task=`afb156cc-dacd-41e1-a5d8-2f5997be03f5`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:23,986::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:23,990::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136721::DEBUG::2014-10-29 11:21:23,994::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:23,996::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:23,998::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136722::DEBUG::2014-10-29 11:21:24,001::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136722::DEBUG::2014-10-29 11:21:24,004::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:21:25,055::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:25,056::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:25,056::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:25,056::__init__::232::IOProcess::(_processLogs) (201513) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:25,058::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201513) Queuing response >Thread-179::DEBUG::2014-10-29 11:21:25,059::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:21:25,077::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000593106 s, 627 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:21:25,079::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:25,079::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:25,079::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:25,080::__init__::232::IOProcess::(_processLogs) (201514) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:25,081::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201514) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:25,433::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:25,434::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:25,434::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:25,434::__init__::232::IOProcess::(_processLogs) (201515) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:25,434::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201515) Queuing response >Thread-10269::DEBUG::2014-10-29 11:21:25,436::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:21:25,453::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000452434 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:21:25,455::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:25,455::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:25,455::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:25,456::__init__::232::IOProcess::(_processLogs) (201516) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:25,456::__init__::232::IOProcess::(_processLogs) (201516) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:25,544::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:25,545::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:25,545::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:25,545::__init__::232::IOProcess::(_processLogs) (201517) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:25,546::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201517) Queuing response >Thread-178::DEBUG::2014-10-29 11:21:25,548::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:21:25,568::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000928637 s, 547 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:21:25,569::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:25,570::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:25,570::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:25,570::__init__::232::IOProcess::(_processLogs) (201518) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:25,572::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201518) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:25,574::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:25,574::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:25,575::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:25,576::__init__::232::IOProcess::(_processLogs) (201519) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:25,576::__init__::232::IOProcess::(_processLogs) (201519) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:25,576::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:25,577::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:25,577::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:25,578::__init__::232::IOProcess::(_processLogs) (201520) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:25,578::__init__::232::IOProcess::(_processLogs) (201520) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:25,579::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:25,579::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:25,580::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:25,581::__init__::232::IOProcess::(_processLogs) (201521) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:25,582::__init__::232::IOProcess::(_processLogs) (201521) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:25,629::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:25,629::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:25,630::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:25,630::__init__::232::IOProcess::(_processLogs) (201522) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:25,631::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201522) Queuing response >Thread-33::DEBUG::2014-10-29 11:21:25,632::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:21:25,649::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000531235 s, 917 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:21:25,654::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:25,656::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:21:25,657::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:25,658::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:25,660::__init__::232::IOProcess::(_processLogs) (201523) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:25,662::__init__::232::IOProcess::(_processLogs) (201523) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:25,663::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:25,671::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:21:25,673::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:25,675::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:25,676::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:25,676::__init__::232::IOProcess::(_processLogs) (201524) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:25,676::__init__::232::IOProcess::(_processLogs) (201524) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:25,677::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:25,678::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:25,679::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:25,679::__init__::232::IOProcess::(_processLogs) (201525) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:25,679::__init__::232::IOProcess::(_processLogs) (201525) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:25,680::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:25,680::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:25,681::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:25,682::__init__::232::IOProcess::(_processLogs) (201526) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:25,682::__init__::232::IOProcess::(_processLogs) (201526) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:27,017::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:27,019::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136723::DEBUG::2014-10-29 11:21:27,023::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:27,025::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:27,026::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136724::DEBUG::2014-10-29 11:21:27,030::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136724::DEBUG::2014-10-29 11:21:27,032::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:30,049::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:30,052::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136725::DEBUG::2014-10-29 11:21:30,056::task::595::Storage.TaskManager.Task::(_updateState) Task=`b62ff9a0-6efd-4e14-94d3-0fb2be4a8be4`::moving from state init -> state preparing >Thread-136725::INFO::2014-10-29 11:21:30,057::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136725::INFO::2014-10-29 11:21:30,058::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000928637', 'lastCheck': '4.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531235', 'lastCheck': '4.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000593106', 'lastCheck': '5.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000452434', 'lastCheck': '4.6', 'valid': True}} >Thread-136725::DEBUG::2014-10-29 11:21:30,058::task::1191::Storage.TaskManager.Task::(prepare) Task=`b62ff9a0-6efd-4e14-94d3-0fb2be4a8be4`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000928637', 'lastCheck': '4.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531235', 'lastCheck': '4.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000593106', 'lastCheck': '5.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000452434', 'lastCheck': '4.6', 'valid': True}} >Thread-136725::DEBUG::2014-10-29 11:21:30,058::task::595::Storage.TaskManager.Task::(_updateState) Task=`b62ff9a0-6efd-4e14-94d3-0fb2be4a8be4`::moving from state preparing -> state finished >Thread-136725::DEBUG::2014-10-29 11:21:30,059::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136725::DEBUG::2014-10-29 11:21:30,059::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136725::DEBUG::2014-10-29 11:21:30,059::task::993::Storage.TaskManager.Task::(_decref) Task=`b62ff9a0-6efd-4e14-94d3-0fb2be4a8be4`::ref 0 aborting False >Thread-136725::DEBUG::2014-10-29 11:21:30,094::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:30,120::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:30,122::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136726::DEBUG::2014-10-29 11:21:30,126::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136726::DEBUG::2014-10-29 11:21:30,128::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:21:30,383::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54528 >Detector thread::DEBUG::2014-10-29 11:21:30,383::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54528 >Detector thread::DEBUG::2014-10-29 11:21:30,384::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54528 >Detector thread::DEBUG::2014-10-29 11:21:30,384::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54528) >Thread-136727::DEBUG::2014-10-29 11:21:30,424::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136727::DEBUG::2014-10-29 11:21:30,425::task::595::Storage.TaskManager.Task::(_updateState) Task=`e94161fe-cec8-455d-83e8-c071e0ca2eac`::moving from state init -> state preparing >Thread-136727::INFO::2014-10-29 11:21:30,425::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136727::DEBUG::2014-10-29 11:21:30,428::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:21:30,429::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:30,429::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:30,429::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:30,430::__init__::232::IOProcess::(_processLogs) (201527) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:30,431::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201527) Queuing response >Thread-136727::DEBUG::2014-10-29 11:21:30,432::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136727::DEBUG::2014-10-29 11:21:30,433::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136727::INFO::2014-10-29 11:21:30,433::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136727::DEBUG::2014-10-29 11:21:30,433::task::1191::Storage.TaskManager.Task::(prepare) Task=`e94161fe-cec8-455d-83e8-c071e0ca2eac`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136727::DEBUG::2014-10-29 11:21:30,433::task::595::Storage.TaskManager.Task::(_updateState) Task=`e94161fe-cec8-455d-83e8-c071e0ca2eac`::moving from state preparing -> state finished >Thread-136727::DEBUG::2014-10-29 11:21:30,434::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136727::DEBUG::2014-10-29 11:21:30,434::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136727::DEBUG::2014-10-29 11:21:30,434::task::993::Storage.TaskManager.Task::(_decref) Task=`e94161fe-cec8-455d-83e8-c071e0ca2eac`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:21:30,478::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54529 >Detector thread::DEBUG::2014-10-29 11:21:30,478::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54529 >Detector thread::DEBUG::2014-10-29 11:21:30,479::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54529 >Detector thread::DEBUG::2014-10-29 11:21:30,479::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54529) >Thread-136728::DEBUG::2014-10-29 11:21:30,518::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136728::DEBUG::2014-10-29 11:21:30,518::task::595::Storage.TaskManager.Task::(_updateState) Task=`05d7e6e3-ed41-4cea-a8c0-a88bb1ceb5ce`::moving from state init -> state preparing >Thread-136728::INFO::2014-10-29 11:21:30,519::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136728::DEBUG::2014-10-29 11:21:30,519::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136728::DEBUG::2014-10-29 11:21:30,519::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136728::DEBUG::2014-10-29 11:21:30,520::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136728::DEBUG::2014-10-29 11:21:30,520::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136728::DEBUG::2014-10-29 11:21:30,520::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136728::DEBUG::2014-10-29 11:21:30,521::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Detector thread::DEBUG::2014-10-29 11:21:30,555::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54530 >Detector thread::DEBUG::2014-10-29 11:21:30,556::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54530 >Detector thread::DEBUG::2014-10-29 11:21:30,556::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54530 >Detector thread::DEBUG::2014-10-29 11:21:30,557::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54530) >Thread-136729::DEBUG::2014-10-29 11:21:30,596::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136729::DEBUG::2014-10-29 11:21:30,598::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136729::DEBUG::2014-10-29 11:21:30,601::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.43', 'elapsedTime': '514323', 'displayType': 'vnc', 'cpuSys': '0.47', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '54734861', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57351', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '54096.31'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.03', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-136728::DEBUG::2014-10-29 11:21:30,604::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136728::DEBUG::2014-10-29 11:21:30,610::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:30,681::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:30,683::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:30,684::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:21:30,776::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54532 >Detector thread::DEBUG::2014-10-29 11:21:30,778::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54532 >Detector thread::DEBUG::2014-10-29 11:21:30,778::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54532 >Detector thread::DEBUG::2014-10-29 11:21:30,779::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54532) >Thread-136728::DEBUG::2014-10-29 11:21:30,789::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136728::DEBUG::2014-10-29 11:21:30,790::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136728::DEBUG::2014-10-29 11:21:30,790::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136728::DEBUG::2014-10-29 11:21:30,791::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136728::DEBUG::2014-10-29 11:21:30,791::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136728::DEBUG::2014-10-29 11:21:30,791::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136728::DEBUG::2014-10-29 11:21:30,792::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136728::DEBUG::2014-10-29 11:21:30,792::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:21:30,795::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:30,801::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:30,803::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:30,803::__init__::232::IOProcess::(_processLogs) (201528) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:30,803::__init__::232::IOProcess::(_processLogs) (201528) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:30,804::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:30,805::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:30,806::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:30,806::__init__::232::IOProcess::(_processLogs) (201529) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:30,806::__init__::232::IOProcess::(_processLogs) (201529) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:30,807::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:30,809::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:30,809::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:30,809::__init__::232::IOProcess::(_processLogs) (201530) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:30,809::__init__::232::IOProcess::(_processLogs) (201530) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:30,810::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:30,810::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:30,810::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:30,810::__init__::232::IOProcess::(_processLogs) (201531) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:30,812::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201531) Queuing response >Thread-136728::DEBUG::2014-10-29 11:21:30,816::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:21:30,817::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:30,817::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:30,818::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-136730::DEBUG::2014-10-29 11:21:30,819::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-17::DEBUG::2014-10-29 11:21:30,820::__init__::232::IOProcess::(_processLogs) (201532) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:21:30,822::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201532) Queuing response >Thread-136728::DEBUG::2014-10-29 11:21:30,823::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:21:30,830::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-136730::DEBUG::2014-10-29 11:21:30,831::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-17::DEBUG::2014-10-29 11:21:30,832::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:30,850::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:30,850::__init__::232::IOProcess::(_processLogs) (201533) Got request for method 'readfile' >Thread-136730::DEBUG::2014-10-29 11:21:30,853::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:21:30,853::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201533) Queuing response >Thread-136728::DEBUG::2014-10-29 11:21:30,853::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:21:30,862::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:30,864::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:30,866::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:30,868::__init__::232::IOProcess::(_processLogs) (201534) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:30,870::__init__::232::IOProcess::(_processLogs) (201534) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:30,873::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:30,875::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:30,878::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-136728::DEBUG::2014-10-29 11:21:30,878::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:21:30,880::__init__::232::IOProcess::(_processLogs) (201535) Got request for method 'glob' >Thread-136728::INFO::2014-10-29 11:21:30,881::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136728::INFO::2014-10-29 11:21:30,883::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:21:30,883::__init__::232::IOProcess::(_processLogs) (201535) Queuing response >Thread-136728::INFO::2014-10-29 11:21:30,886::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:21:30,890::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:30,892::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:30,894::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:30,896::__init__::232::IOProcess::(_processLogs) (201536) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:21:30,901::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201536) Queuing response >Thread-136728::DEBUG::2014-10-29 11:21:30,902::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136728::DEBUG::2014-10-29 11:21:30,911::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`6c1c9b8c-6ccc-45f8-ace9-970629bca50b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136728::DEBUG::2014-10-29 11:21:30,912::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136728::DEBUG::2014-10-29 11:21:30,915::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136728::DEBUG::2014-10-29 11:21:30,916::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`6c1c9b8c-6ccc-45f8-ace9-970629bca50b`::Granted request >Thread-136728::DEBUG::2014-10-29 11:21:30,920::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`05d7e6e3-ed41-4cea-a8c0-a88bb1ceb5ce`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136728::DEBUG::2014-10-29 11:21:30,922::task::993::Storage.TaskManager.Task::(_decref) Task=`05d7e6e3-ed41-4cea-a8c0-a88bb1ceb5ce`::ref 1 aborting False >Thread-136728::INFO::2014-10-29 11:21:30,937::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136728::DEBUG::2014-10-29 11:21:30,939::task::1191::Storage.TaskManager.Task::(prepare) Task=`05d7e6e3-ed41-4cea-a8c0-a88bb1ceb5ce`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136728::DEBUG::2014-10-29 11:21:30,940::task::595::Storage.TaskManager.Task::(_updateState) Task=`05d7e6e3-ed41-4cea-a8c0-a88bb1ceb5ce`::moving from state preparing -> state finished >Thread-136728::DEBUG::2014-10-29 11:21:30,942::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136728::DEBUG::2014-10-29 11:21:30,943::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136728::DEBUG::2014-10-29 11:21:30,945::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136728::DEBUG::2014-10-29 11:21:30,948::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136728::DEBUG::2014-10-29 11:21:30,949::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136728::DEBUG::2014-10-29 11:21:30,950::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136728::DEBUG::2014-10-29 11:21:30,953::task::993::Storage.TaskManager.Task::(_decref) Task=`05d7e6e3-ed41-4cea-a8c0-a88bb1ceb5ce`::ref 0 aborting False >Thread-136730::DEBUG::2014-10-29 11:21:30,987::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '42', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '42', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:21:30,990::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54533 >Detector thread::DEBUG::2014-10-29 11:21:30,993::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54533 >Detector thread::DEBUG::2014-10-29 11:21:30,995::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54533 >Detector thread::DEBUG::2014-10-29 11:21:30,997::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54533) >Thread-136735::DEBUG::2014-10-29 11:21:31,030::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136735::DEBUG::2014-10-29 11:21:31,030::task::595::Storage.TaskManager.Task::(_updateState) Task=`f99cb9e4-5850-4de4-9002-63f75984a908`::moving from state init -> state preparing >Thread-136735::INFO::2014-10-29 11:21:31,031::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136735::INFO::2014-10-29 11:21:31,032::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000928637', 'lastCheck': '5.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531235', 'lastCheck': '5.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000593106', 'lastCheck': '5.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000452434', 'lastCheck': '5.6', 'valid': True}} >Thread-136735::DEBUG::2014-10-29 11:21:31,032::task::1191::Storage.TaskManager.Task::(prepare) Task=`f99cb9e4-5850-4de4-9002-63f75984a908`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000928637', 'lastCheck': '5.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531235', 'lastCheck': '5.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000593106', 'lastCheck': '5.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000452434', 'lastCheck': '5.6', 'valid': True}} >Thread-136735::DEBUG::2014-10-29 11:21:31,032::task::595::Storage.TaskManager.Task::(_updateState) Task=`f99cb9e4-5850-4de4-9002-63f75984a908`::moving from state preparing -> state finished >Thread-136735::DEBUG::2014-10-29 11:21:31,032::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136735::DEBUG::2014-10-29 11:21:31,033::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136735::DEBUG::2014-10-29 11:21:31,033::task::993::Storage.TaskManager.Task::(_decref) Task=`f99cb9e4-5850-4de4-9002-63f75984a908`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:21:31,061::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54534 >Detector thread::DEBUG::2014-10-29 11:21:31,061::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54534 >Detector thread::DEBUG::2014-10-29 11:21:31,061::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54534 >Detector thread::DEBUG::2014-10-29 11:21:31,062::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54534) >Thread-136736::DEBUG::2014-10-29 11:21:31,102::task::595::Storage.TaskManager.Task::(_updateState) Task=`e13c9d8b-b01e-434a-a511-f992ae60df07`::moving from state init -> state preparing >Thread-136736::INFO::2014-10-29 11:21:31,102::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136736::INFO::2014-10-29 11:21:31,103::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000928637', 'lastCheck': '5.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531235', 'lastCheck': '5.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000593106', 'lastCheck': '6.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000452434', 'lastCheck': '5.6', 'valid': True}} >Thread-136736::DEBUG::2014-10-29 11:21:31,103::task::1191::Storage.TaskManager.Task::(prepare) Task=`e13c9d8b-b01e-434a-a511-f992ae60df07`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000928637', 'lastCheck': '5.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531235', 'lastCheck': '5.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000593106', 'lastCheck': '6.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000452434', 'lastCheck': '5.6', 'valid': True}} >Thread-136736::DEBUG::2014-10-29 11:21:31,103::task::595::Storage.TaskManager.Task::(_updateState) Task=`e13c9d8b-b01e-434a-a511-f992ae60df07`::moving from state preparing -> state finished >Thread-136736::DEBUG::2014-10-29 11:21:31,104::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136736::DEBUG::2014-10-29 11:21:31,104::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136736::DEBUG::2014-10-29 11:21:31,104::task::993::Storage.TaskManager.Task::(_decref) Task=`e13c9d8b-b01e-434a-a511-f992ae60df07`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:33,189::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:33,192::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136737::DEBUG::2014-10-29 11:21:33,195::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:33,198::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:33,199::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136738::DEBUG::2014-10-29 11:21:33,202::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136738::DEBUG::2014-10-29 11:21:33,204::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:21:34,290::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >Thread-22::DEBUG::2014-10-29 11:21:34,586::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-17::DEBUG::2014-10-29 11:21:35,085::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:35,086::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:35,086::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:35,086::__init__::232::IOProcess::(_processLogs) (201537) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:35,090::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201537) Queuing response >Thread-179::DEBUG::2014-10-29 11:21:35,092::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:21:35,111::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000507045 s, 734 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:21:35,113::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:35,113::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:35,113::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:35,114::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201538) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:35,114::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201538) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:35,459::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:35,459::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:35,461::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-10269::DEBUG::2014-10-29 11:21:35,462::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:21:35,462::__init__::232::IOProcess::(_processLogs) (201539) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:35,480::__init__::232::IOProcess::(_processLogs) (201539) Queuing response >Thread-10269::DEBUG::2014-10-29 11:21:35,482::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000514257 s, 976 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:21:35,484::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:35,484::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:35,484::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:35,485::__init__::232::IOProcess::(_processLogs) (201540) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:35,486::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201540) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:35,582::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:35,583::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:35,583::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:35,584::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201541) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:35,586::__init__::232::IOProcess::(_processLogs) (201541) Queuing response >Thread-178::DEBUG::2014-10-29 11:21:35,586::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:21:35,605::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000457954 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:21:35,607::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:35,608::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:35,608::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:35,609::__init__::232::IOProcess::(_processLogs) (201542) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:35,610::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201542) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:35,612::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:35,613::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:35,613::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:35,614::__init__::232::IOProcess::(_processLogs) (201543) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:35,614::__init__::232::IOProcess::(_processLogs) (201543) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:35,615::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:35,615::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:35,616::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:35,617::__init__::232::IOProcess::(_processLogs) (201544) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:35,617::__init__::232::IOProcess::(_processLogs) (201544) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:35,618::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:35,618::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:35,618::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:35,618::__init__::232::IOProcess::(_processLogs) (201545) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:35,619::__init__::232::IOProcess::(_processLogs) (201545) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:35,683::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:35,683::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:35,686::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:35,686::__init__::232::IOProcess::(_processLogs) (201546) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:35,687::__init__::232::IOProcess::(_processLogs) (201546) Queuing response >Thread-33::DEBUG::2014-10-29 11:21:35,687::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:35,707::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-33::DEBUG::2014-10-29 11:21:35,711::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000505468 s, 963 kB/s\n'; <rc> = 0 >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:35,718::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:21:35,718::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:35,720::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:35,723::__init__::232::IOProcess::(_processLogs) Extracting request information... >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:35,724::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:21:35,725::__init__::232::IOProcess::(_processLogs) (201547) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:35,730::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201547) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:35,731::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:35,732::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:35,733::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:35,733::__init__::232::IOProcess::(_processLogs) (201548) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:35,733::__init__::232::IOProcess::(_processLogs) (201548) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:35,734::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:35,734::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:35,735::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:35,736::__init__::232::IOProcess::(_processLogs) (201549) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:35,736::__init__::232::IOProcess::(_processLogs) (201549) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:35,737::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:35,737::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:35,738::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:35,739::__init__::232::IOProcess::(_processLogs) (201550) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:35,740::__init__::232::IOProcess::(_processLogs) (201550) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:36,222::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:36,224::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136739::DEBUG::2014-10-29 11:21:36,228::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:36,231::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:36,233::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136740::DEBUG::2014-10-29 11:21:36,236::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136740::DEBUG::2014-10-29 11:21:36,238::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:39,252::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:39,256::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136741::DEBUG::2014-10-29 11:21:39,259::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:39,262::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:39,264::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136742::DEBUG::2014-10-29 11:21:39,267::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136742::DEBUG::2014-10-29 11:21:39,269::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:40,735::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:40,736::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:40,737::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:21:40,816::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54535 >Detector thread::DEBUG::2014-10-29 11:21:40,817::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54535 >Detector thread::DEBUG::2014-10-29 11:21:40,817::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54535 >Detector thread::DEBUG::2014-10-29 11:21:40,818::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54535) >Thread-136743::DEBUG::2014-10-29 11:21:40,857::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136743::DEBUG::2014-10-29 11:21:40,858::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136743::DEBUG::2014-10-29 11:21:40,859::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.11', 'elapsedTime': '514333', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '54734861', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57351', 'readRate': '0.00', 'truesize': '6010871808', 'writeRate': '54096.31'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.25', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:21:41,049::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54537 >Detector thread::DEBUG::2014-10-29 11:21:41,050::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54537 >Detector thread::DEBUG::2014-10-29 11:21:41,050::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54537 >Detector thread::DEBUG::2014-10-29 11:21:41,051::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54537) >Thread-136744::DEBUG::2014-10-29 11:21:41,090::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136744::DEBUG::2014-10-29 11:21:41,092::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136744::DEBUG::2014-10-29 11:21:41,112::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136744::DEBUG::2014-10-29 11:21:41,158::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '25', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '25', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:21:41,207::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54538 >Detector thread::DEBUG::2014-10-29 11:21:41,208::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54538 >Detector thread::DEBUG::2014-10-29 11:21:41,208::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54538 >Detector thread::DEBUG::2014-10-29 11:21:41,208::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54538) >Thread-136745::DEBUG::2014-10-29 11:21:41,248::task::595::Storage.TaskManager.Task::(_updateState) Task=`0722814a-ac23-4cbc-9b64-1e866354deee`::moving from state init -> state preparing >Thread-136745::INFO::2014-10-29 11:21:41,249::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136745::INFO::2014-10-29 11:21:41,250::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457954', 'lastCheck': '5.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505468', 'lastCheck': '5.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507045', 'lastCheck': '6.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000514257', 'lastCheck': '5.8', 'valid': True}} >Thread-136745::DEBUG::2014-10-29 11:21:41,250::task::1191::Storage.TaskManager.Task::(prepare) Task=`0722814a-ac23-4cbc-9b64-1e866354deee`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457954', 'lastCheck': '5.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505468', 'lastCheck': '5.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507045', 'lastCheck': '6.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000514257', 'lastCheck': '5.8', 'valid': True}} >Thread-136745::DEBUG::2014-10-29 11:21:41,250::task::595::Storage.TaskManager.Task::(_updateState) Task=`0722814a-ac23-4cbc-9b64-1e866354deee`::moving from state preparing -> state finished >Thread-136745::DEBUG::2014-10-29 11:21:41,250::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136745::DEBUG::2014-10-29 11:21:41,251::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136745::DEBUG::2014-10-29 11:21:41,251::task::993::Storage.TaskManager.Task::(_decref) Task=`0722814a-ac23-4cbc-9b64-1e866354deee`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:21:41,602::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54540 >Detector thread::DEBUG::2014-10-29 11:21:41,602::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54540 >Detector thread::DEBUG::2014-10-29 11:21:41,603::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54540 >Detector thread::DEBUG::2014-10-29 11:21:41,603::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54540) >Thread-136746::DEBUG::2014-10-29 11:21:41,643::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136746::DEBUG::2014-10-29 11:21:41,643::task::595::Storage.TaskManager.Task::(_updateState) Task=`01d165b6-190e-4841-a9b0-6ce311513ea0`::moving from state init -> state preparing >Thread-136746::INFO::2014-10-29 11:21:41,644::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136746::DEBUG::2014-10-29 11:21:41,651::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:21:41,652::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:41,652::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:41,653::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:41,653::__init__::232::IOProcess::(_processLogs) (201551) Got request for method 'glob' >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:42,285::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:42,287::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136747::DEBUG::2014-10-29 11:21:42,290::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:42,292::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:42,294::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136748::DEBUG::2014-10-29 11:21:42,297::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136748::DEBUG::2014-10-29 11:21:42,299::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:21:42,780::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201551) Queuing response >Thread-136746::DEBUG::2014-10-29 11:21:42,780::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136746::DEBUG::2014-10-29 11:21:42,785::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136746::INFO::2014-10-29 11:21:42,788::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136746::DEBUG::2014-10-29 11:21:42,790::task::1191::Storage.TaskManager.Task::(prepare) Task=`01d165b6-190e-4841-a9b0-6ce311513ea0`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136746::DEBUG::2014-10-29 11:21:42,793::task::595::Storage.TaskManager.Task::(_updateState) Task=`01d165b6-190e-4841-a9b0-6ce311513ea0`::moving from state preparing -> state finished >Thread-136746::DEBUG::2014-10-29 11:21:42,795::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136746::DEBUG::2014-10-29 11:21:42,797::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136746::DEBUG::2014-10-29 11:21:42,800::task::993::Storage.TaskManager.Task::(_decref) Task=`01d165b6-190e-4841-a9b0-6ce311513ea0`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:21:42,864::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54541 >Detector thread::DEBUG::2014-10-29 11:21:42,865::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54541 >Detector thread::DEBUG::2014-10-29 11:21:42,865::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54541 >Detector thread::DEBUG::2014-10-29 11:21:42,866::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54541) >Thread-136749::DEBUG::2014-10-29 11:21:42,904::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136749::DEBUG::2014-10-29 11:21:42,905::task::595::Storage.TaskManager.Task::(_updateState) Task=`b86789ca-5a84-44a0-aa0b-a1390ac9922d`::moving from state init -> state preparing >Thread-136749::INFO::2014-10-29 11:21:42,905::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136749::DEBUG::2014-10-29 11:21:42,905::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136749::DEBUG::2014-10-29 11:21:42,906::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136749::DEBUG::2014-10-29 11:21:42,906::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136749::DEBUG::2014-10-29 11:21:42,906::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136749::DEBUG::2014-10-29 11:21:42,906::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136749::DEBUG::2014-10-29 11:21:42,907::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136749::DEBUG::2014-10-29 11:21:43,006::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136749::DEBUG::2014-10-29 11:21:43,007::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136749::DEBUG::2014-10-29 11:21:43,186::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136749::DEBUG::2014-10-29 11:21:43,187::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136749::DEBUG::2014-10-29 11:21:43,187::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136749::DEBUG::2014-10-29 11:21:43,188::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136749::DEBUG::2014-10-29 11:21:43,188::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136749::DEBUG::2014-10-29 11:21:43,189::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136749::DEBUG::2014-10-29 11:21:43,189::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136749::DEBUG::2014-10-29 11:21:43,189::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:21:43,198::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:43,200::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:43,200::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:43,201::__init__::232::IOProcess::(_processLogs) (201552) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:43,202::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201552) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:43,203::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:43,203::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:43,204::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:43,204::__init__::232::IOProcess::(_processLogs) (201553) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:43,205::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201553) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:43,207::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:43,209::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:43,210::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:43,212::__init__::232::IOProcess::(_processLogs) (201554) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:43,216::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201554) Queuing response >Thread-136749::DEBUG::2014-10-29 11:21:43,219::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:21:43,221::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:43,221::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:43,221::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:43,222::__init__::232::IOProcess::(_processLogs) (201555) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:43,223::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201555) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:43,224::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:43,224::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:43,224::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:43,225::__init__::232::IOProcess::(_processLogs) (201556) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:21:43,225::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201556) Queuing response >Thread-136749::DEBUG::2014-10-29 11:21:43,226::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:21:43,228::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:43,228::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:43,229::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:43,229::__init__::232::IOProcess::(_processLogs) (201557) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:21:43,230::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201557) Queuing response >Thread-136749::DEBUG::2014-10-29 11:21:43,231::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:21:43,233::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:43,233::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:43,234::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:43,234::__init__::232::IOProcess::(_processLogs) (201558) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:43,234::__init__::232::IOProcess::(_processLogs) (201558) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:43,235::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:43,235::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:43,236::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:43,236::__init__::232::IOProcess::(_processLogs) (201559) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:43,237::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201559) Queuing response >Thread-136749::DEBUG::2014-10-29 11:21:43,237::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-136749::INFO::2014-10-29 11:21:43,238::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136749::INFO::2014-10-29 11:21:43,238::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136749::INFO::2014-10-29 11:21:43,239::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:21:43,240::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:43,240::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:43,240::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:43,241::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201560) Got request for method 'readfile' >Thread-136749::DEBUG::2014-10-29 11:21:43,241::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:21:43,242::__init__::232::IOProcess::(_processLogs) (201560) Queuing response >Thread-136749::DEBUG::2014-10-29 11:21:43,245::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`008d86d3-1543-4771-8518-6b9784a81ad2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136749::DEBUG::2014-10-29 11:21:43,245::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136749::DEBUG::2014-10-29 11:21:43,246::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136749::DEBUG::2014-10-29 11:21:43,246::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`008d86d3-1543-4771-8518-6b9784a81ad2`::Granted request >Thread-136749::DEBUG::2014-10-29 11:21:43,247::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b86789ca-5a84-44a0-aa0b-a1390ac9922d`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136749::DEBUG::2014-10-29 11:21:43,247::task::993::Storage.TaskManager.Task::(_decref) Task=`b86789ca-5a84-44a0-aa0b-a1390ac9922d`::ref 1 aborting False >Thread-136749::INFO::2014-10-29 11:21:43,250::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136749::DEBUG::2014-10-29 11:21:43,250::task::1191::Storage.TaskManager.Task::(prepare) Task=`b86789ca-5a84-44a0-aa0b-a1390ac9922d`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136749::DEBUG::2014-10-29 11:21:43,250::task::595::Storage.TaskManager.Task::(_updateState) Task=`b86789ca-5a84-44a0-aa0b-a1390ac9922d`::moving from state preparing -> state finished >Thread-136749::DEBUG::2014-10-29 11:21:43,251::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136749::DEBUG::2014-10-29 11:21:43,251::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136749::DEBUG::2014-10-29 11:21:43,251::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136749::DEBUG::2014-10-29 11:21:43,252::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136749::DEBUG::2014-10-29 11:21:43,252::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136749::DEBUG::2014-10-29 11:21:43,252::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136749::DEBUG::2014-10-29 11:21:43,253::task::993::Storage.TaskManager.Task::(_decref) Task=`b86789ca-5a84-44a0-aa0b-a1390ac9922d`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:21:43,274::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54542 >Detector thread::DEBUG::2014-10-29 11:21:43,274::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54542 >Detector thread::DEBUG::2014-10-29 11:21:43,274::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54542 >Detector thread::DEBUG::2014-10-29 11:21:43,275::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54542) >Thread-136754::DEBUG::2014-10-29 11:21:43,314::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136754::DEBUG::2014-10-29 11:21:43,314::task::595::Storage.TaskManager.Task::(_updateState) Task=`af160ff5-66bc-4029-ae41-ceac82bf229f`::moving from state init -> state preparing >Thread-136754::INFO::2014-10-29 11:21:43,315::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136754::INFO::2014-10-29 11:21:43,315::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457954', 'lastCheck': '7.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505468', 'lastCheck': '7.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507045', 'lastCheck': '8.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000514257', 'lastCheck': '7.8', 'valid': True}} >Thread-136754::DEBUG::2014-10-29 11:21:43,316::task::1191::Storage.TaskManager.Task::(prepare) Task=`af160ff5-66bc-4029-ae41-ceac82bf229f`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457954', 'lastCheck': '7.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505468', 'lastCheck': '7.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000507045', 'lastCheck': '8.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000514257', 'lastCheck': '7.8', 'valid': True}} >Thread-136754::DEBUG::2014-10-29 11:21:43,316::task::595::Storage.TaskManager.Task::(_updateState) Task=`af160ff5-66bc-4029-ae41-ceac82bf229f`::moving from state preparing -> state finished >Thread-136754::DEBUG::2014-10-29 11:21:43,316::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136754::DEBUG::2014-10-29 11:21:43,317::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136754::DEBUG::2014-10-29 11:21:43,317::task::993::Storage.TaskManager.Task::(_decref) Task=`af160ff5-66bc-4029-ae41-ceac82bf229f`::ref 0 aborting False >Thread-179::DEBUG::2014-10-29 11:21:45,117::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 38dc6c98-2b6a-45c0-b765-c5ce685415f9 >Thread-17::DEBUG::2014-10-29 11:21:45,125::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:45,127::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:45,127::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:45,127::__init__::232::IOProcess::(_processLogs) (201561) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:45,129::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201561) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:45,130::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:45,130::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:45,131::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:45,131::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:45,131::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:45,132::__init__::232::IOProcess::(_processLogs) (201562) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:45,132::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:45,132::__init__::232::IOProcess::(_processLogs) (201563) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:45,133::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:45,135::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:45,137::__init__::232::IOProcess::(_processLogs) (201563) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:45,139::__init__::232::IOProcess::(_processLogs) (201562) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:45,140::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:45,142::__init__::232::IOProcess::(_processLogs) (201564) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:45,142::__init__::232::IOProcess::(_processLogs) (201564) Queuing response >Thread-179::DEBUG::2014-10-29 11:21:45,148::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9 >Thread-17::DEBUG::2014-10-29 11:21:45,149::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:45,149::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:45,149::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:45,149::__init__::232::IOProcess::(_processLogs) (201565) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:21:45,151::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201565) Queuing response >Thread-179::DEBUG::2014-10-29 11:21:45,152::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:21:45,153::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:45,153::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:45,153::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:45,154::__init__::232::IOProcess::(_processLogs) (201566) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:21:45,154::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201566) Queuing response >Thread-179::DEBUG::2014-10-29 11:21:45,155::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nsednev_rhevm_3_5_second_SD', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=00000002-0002-0002-0002-000000000321', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_rhevm_3_5_second_SD', 'ROLE=Regular', 'SDUUID=38dc6c98-2b6a-45c0-b765-c5ce685415f9', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ea5c54387b91bc1e37853d7501f0d1b2d7d233e7'] >Thread-17::DEBUG::2014-10-29 11:21:45,157::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:45,157::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:45,158::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:45,159::__init__::232::IOProcess::(_processLogs) (201567) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:45,159::__init__::232::IOProcess::(_processLogs) (201567) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:45,160::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:45,160::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:45,160::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:45,160::__init__::232::IOProcess::(_processLogs) (201568) Got request for method 'glob' >Thread-179::DEBUG::2014-10-29 11:21:45,161::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:21:45,161::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201568) Queuing response >Thread-179::INFO::2014-10-29 11:21:45,162::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 38dc6c98-2b6a-45c0-b765-c5ce685415f9_imageNS already registered >Thread-179::INFO::2014-10-29 11:21:45,163::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 38dc6c98-2b6a-45c0-b765-c5ce685415f9_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:21:45,164::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:45,164::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:45,164::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:45,165::__init__::232::IOProcess::(_processLogs) (201569) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:45,165::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201569) Queuing response >Thread-179::DEBUG::2014-10-29 11:21:45,166::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:21:45,190::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00448298 s, 83.0 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:21:45,192::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:45,193::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:45,193::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:45,193::__init__::232::IOProcess::(_processLogs) (201570) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:45,194::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201570) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:45,313::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:45,316::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136759::DEBUG::2014-10-29 11:21:45,320::task::595::Storage.TaskManager.Task::(_updateState) Task=`c62a3556-b7cb-48fe-a13d-09e762b41c07`::moving from state init -> state preparing >Thread-136759::INFO::2014-10-29 11:21:45,321::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136759::INFO::2014-10-29 11:21:45,321::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457954', 'lastCheck': '9.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505468', 'lastCheck': '9.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00448298', 'lastCheck': '0.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000514257', 'lastCheck': '9.8', 'valid': True}} >Thread-136759::DEBUG::2014-10-29 11:21:45,322::task::1191::Storage.TaskManager.Task::(prepare) Task=`c62a3556-b7cb-48fe-a13d-09e762b41c07`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457954', 'lastCheck': '9.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505468', 'lastCheck': '9.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00448298', 'lastCheck': '0.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000514257', 'lastCheck': '9.8', 'valid': True}} >Thread-136759::DEBUG::2014-10-29 11:21:45,322::task::595::Storage.TaskManager.Task::(_updateState) Task=`c62a3556-b7cb-48fe-a13d-09e762b41c07`::moving from state preparing -> state finished >Thread-136759::DEBUG::2014-10-29 11:21:45,322::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136759::DEBUG::2014-10-29 11:21:45,322::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136759::DEBUG::2014-10-29 11:21:45,323::task::993::Storage.TaskManager.Task::(_decref) Task=`c62a3556-b7cb-48fe-a13d-09e762b41c07`::ref 0 aborting False >Thread-136759::DEBUG::2014-10-29 11:21:45,347::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:45,369::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:45,371::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136760::DEBUG::2014-10-29 11:21:45,375::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136760::DEBUG::2014-10-29 11:21:45,377::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:21:45,489::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:45,489::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:45,491::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:45,492::__init__::232::IOProcess::(_processLogs) (201571) Got request for method 'statvfs' >Thread-10269::DEBUG::2014-10-29 11:21:45,492::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:21:45,494::__init__::232::IOProcess::(_processLogs) (201571) Queuing response >Thread-10269::DEBUG::2014-10-29 11:21:45,512::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000631822 s, 795 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:21:45,514::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:45,514::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:45,515::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:45,515::__init__::232::IOProcess::(_processLogs) (201572) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:45,517::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201572) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:45,621::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:45,621::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:45,622::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:45,622::__init__::232::IOProcess::(_processLogs) (201573) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:45,622::__init__::232::IOProcess::(_processLogs) (201573) Queuing response >Thread-178::DEBUG::2014-10-29 11:21:45,624::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:21:45,641::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000417132 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:21:45,643::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:45,643::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:45,645::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:45,646::__init__::232::IOProcess::(_processLogs) (201574) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:45,647::__init__::232::IOProcess::(_processLogs) (201574) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:45,648::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:45,648::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:45,649::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:45,650::__init__::232::IOProcess::(_processLogs) (201575) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:45,650::__init__::232::IOProcess::(_processLogs) (201575) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:45,651::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:45,651::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:45,651::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:45,652::__init__::232::IOProcess::(_processLogs) (201576) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:45,652::__init__::232::IOProcess::(_processLogs) (201576) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:45,653::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:45,654::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:45,654::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:45,655::__init__::232::IOProcess::(_processLogs) (201577) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:45,656::__init__::232::IOProcess::(_processLogs) (201577) Queuing response >Thread-33::DEBUG::2014-10-29 11:21:45,739::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:21:45,750::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:45,751::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:21:45,754::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:45,755::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:45,758::__init__::232::IOProcess::(_processLogs) (201578) Got request for method 'glob' >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:45,759::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:21:45,763::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201578) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:45,767::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:21:45,768::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:45,770::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:45,771::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:45,772::__init__::232::IOProcess::(_processLogs) (201579) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:45,773::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201579) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:45,778::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:45,781::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:45,782::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:45,783::__init__::232::IOProcess::(_processLogs) (201580) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:45,783::__init__::232::IOProcess::(_processLogs) (201580) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:45,786::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:45,786::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-33::DEBUG::2014-10-29 11:21:45,787::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:21:45,790::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:45,791::__init__::232::IOProcess::(_processLogs) (201581) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:45,791::__init__::232::IOProcess::(_processLogs) (201581) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:45,792::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:45,792::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:45,792::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:45,793::__init__::232::IOProcess::(_processLogs) (201582) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:21:45,793::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201582) Queuing response >Thread-33::DEBUG::2014-10-29 11:21:45,794::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:21:45,795::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:45,795::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:45,795::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:45,796::__init__::232::IOProcess::(_processLogs) (201583) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:21:45,796::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201583) Queuing response >Thread-33::DEBUG::2014-10-29 11:21:45,797::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:21:45,799::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:45,799::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:45,800::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:45,800::__init__::232::IOProcess::(_processLogs) (201584) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:45,801::__init__::232::IOProcess::(_processLogs) (201584) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:45,801::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:45,802::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:45,802::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-33::DEBUG::2014-10-29 11:21:45,802::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-33::INFO::2014-10-29 11:21:45,804::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:21:45,804::__init__::232::IOProcess::(_processLogs) (201585) Got request for method 'glob' >Thread-33::INFO::2014-10-29 11:21:45,805::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:21:45,806::__init__::232::IOProcess::(_processLogs) (201585) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:45,807::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:45,808::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:45,808::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:45,809::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201586) Got request for method 'statvfs' >Thread-33::DEBUG::2014-10-29 11:21:45,811::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:21:45,811::__init__::232::IOProcess::(_processLogs) (201586) Queuing response >Thread-33::DEBUG::2014-10-29 11:21:45,830::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000405343 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:21:45,832::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:45,832::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:45,832::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:45,833::__init__::232::IOProcess::(_processLogs) (201587) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:45,835::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201587) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:45,835::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:45,837::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:45,837::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:45,837::__init__::232::IOProcess::(_processLogs) (201588) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:45,838::__init__::232::IOProcess::(_processLogs) (201588) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:45,838::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:45,839::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:45,839::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:45,840::__init__::232::IOProcess::(_processLogs) (201589) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:45,840::__init__::232::IOProcess::(_processLogs) (201589) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:45,840::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:45,841::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:45,842::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:45,843::__init__::232::IOProcess::(_processLogs) (201590) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:45,843::__init__::232::IOProcess::(_processLogs) (201590) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:48,418::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:48,421::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136765::DEBUG::2014-10-29 11:21:48,424::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:48,427::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:48,429::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136766::DEBUG::2014-10-29 11:21:48,432::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136766::DEBUG::2014-10-29 11:21:48,434::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:21:49,608::task::595::Storage.TaskManager.Task::(_updateState) Task=`d46a210d-5929-4191-b895-03336e49ff6d`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:21:49,609::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:21:49,611::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:49,611::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:49,611::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:49,611::__init__::232::IOProcess::(_processLogs) (201591) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:21:49,612::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201591) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:49,614::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:49,616::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-22::INFO::2014-10-29 11:21:49,616::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010880000', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:21:49,617::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-22::DEBUG::2014-10-29 11:21:49,618::task::1191::Storage.TaskManager.Task::(prepare) Task=`d46a210d-5929-4191-b895-03336e49ff6d`::finished: {'truesize': '6010880000', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:21:49,618::__init__::232::IOProcess::(_processLogs) (201592) Got request for method 'stat' >Thread-22::DEBUG::2014-10-29 11:21:49,619::task::595::Storage.TaskManager.Task::(_updateState) Task=`d46a210d-5929-4191-b895-03336e49ff6d`::moving from state preparing -> state finished >Thread-17::DEBUG::2014-10-29 11:21:49,620::__init__::232::IOProcess::(_processLogs) (201592) Queuing response >Thread-22::DEBUG::2014-10-29 11:21:49,620::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-10-29 11:21:49,621::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2014-10-29 11:21:49,621::task::993::Storage.TaskManager.Task::(_decref) Task=`d46a210d-5929-4191-b895-03336e49ff6d`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:21:49,689::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:50,778::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:50,779::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:50,780::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:21:50,871::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54543 >Detector thread::DEBUG::2014-10-29 11:21:50,872::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54543 >Detector thread::DEBUG::2014-10-29 11:21:50,872::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54543 >Detector thread::DEBUG::2014-10-29 11:21:50,872::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54543) >Thread-136767::DEBUG::2014-10-29 11:21:50,912::task::595::Storage.TaskManager.Task::(_updateState) Task=`e109f544-52fa-4f30-bf9e-420c7ed3146d`::moving from state init -> state preparing >Thread-136767::INFO::2014-10-29 11:21:50,912::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136767::INFO::2014-10-29 11:21:50,913::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000417132', 'lastCheck': '5.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000405343', 'lastCheck': '5.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00448298', 'lastCheck': '5.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000631822', 'lastCheck': '5.4', 'valid': True}} >Thread-136767::DEBUG::2014-10-29 11:21:50,913::task::1191::Storage.TaskManager.Task::(prepare) Task=`e109f544-52fa-4f30-bf9e-420c7ed3146d`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000417132', 'lastCheck': '5.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000405343', 'lastCheck': '5.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00448298', 'lastCheck': '5.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000631822', 'lastCheck': '5.4', 'valid': True}} >Thread-136767::DEBUG::2014-10-29 11:21:50,913::task::595::Storage.TaskManager.Task::(_updateState) Task=`e109f544-52fa-4f30-bf9e-420c7ed3146d`::moving from state preparing -> state finished >Thread-136767::DEBUG::2014-10-29 11:21:50,914::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136767::DEBUG::2014-10-29 11:21:50,914::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136767::DEBUG::2014-10-29 11:21:50,914::task::993::Storage.TaskManager.Task::(_decref) Task=`e109f544-52fa-4f30-bf9e-420c7ed3146d`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:21:51,016::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54544 >Detector thread::DEBUG::2014-10-29 11:21:51,017::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54544 >Detector thread::DEBUG::2014-10-29 11:21:51,017::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54544 >Detector thread::DEBUG::2014-10-29 11:21:51,018::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54544) >Thread-136768::DEBUG::2014-10-29 11:21:51,056::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136768::DEBUG::2014-10-29 11:21:51,057::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136768::DEBUG::2014-10-29 11:21:51,057::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.75', 'elapsedTime': '514343', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '8978749', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '58995', 'readRate': '0.00', 'truesize': '6010880000', 'writeRate': '30828.20'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.45', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:21:51,219::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54546 >Detector thread::DEBUG::2014-10-29 11:21:51,220::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54546 >Detector thread::DEBUG::2014-10-29 11:21:51,220::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54546 >Detector thread::DEBUG::2014-10-29 11:21:51,221::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54546) >Thread-136769::DEBUG::2014-10-29 11:21:51,260::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136769::DEBUG::2014-10-29 11:21:51,262::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136769::DEBUG::2014-10-29 11:21:51,279::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136769::DEBUG::2014-10-29 11:21:51,326::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '8', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '8', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:51,452::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:51,455::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136770::DEBUG::2014-10-29 11:21:51,458::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:51,460::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:51,462::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136771::DEBUG::2014-10-29 11:21:51,466::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136771::DEBUG::2014-10-29 11:21:51,468::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:21:53,905::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54548 >Detector thread::DEBUG::2014-10-29 11:21:53,905::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54548 >Detector thread::DEBUG::2014-10-29 11:21:53,906::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54548 >Detector thread::DEBUG::2014-10-29 11:21:53,906::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54548) >Thread-136772::DEBUG::2014-10-29 11:21:53,946::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136772::DEBUG::2014-10-29 11:21:53,947::task::595::Storage.TaskManager.Task::(_updateState) Task=`c2a219a3-982a-4aaa-8023-03d8481d5cc6`::moving from state init -> state preparing >Thread-136772::INFO::2014-10-29 11:21:53,947::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136772::DEBUG::2014-10-29 11:21:53,950::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:21:53,951::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:53,951::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:53,951::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:53,952::__init__::232::IOProcess::(_processLogs) (201593) Got request for method 'glob' >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:54,481::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:54,484::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136773::DEBUG::2014-10-29 11:21:54,488::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:54,491::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:54,492::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136774::DEBUG::2014-10-29 11:21:54,496::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136774::DEBUG::2014-10-29 11:21:54,498::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:21:54,777::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201593) Queuing response >Thread-136772::DEBUG::2014-10-29 11:21:54,777::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136772::DEBUG::2014-10-29 11:21:54,780::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136772::INFO::2014-10-29 11:21:54,782::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136772::DEBUG::2014-10-29 11:21:54,784::task::1191::Storage.TaskManager.Task::(prepare) Task=`c2a219a3-982a-4aaa-8023-03d8481d5cc6`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136772::DEBUG::2014-10-29 11:21:54,785::task::595::Storage.TaskManager.Task::(_updateState) Task=`c2a219a3-982a-4aaa-8023-03d8481d5cc6`::moving from state preparing -> state finished >Thread-136772::DEBUG::2014-10-29 11:21:54,787::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136772::DEBUG::2014-10-29 11:21:54,788::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136772::DEBUG::2014-10-29 11:21:54,790::task::993::Storage.TaskManager.Task::(_decref) Task=`c2a219a3-982a-4aaa-8023-03d8481d5cc6`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:21:54,841::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54549 >Detector thread::DEBUG::2014-10-29 11:21:54,842::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54549 >Detector thread::DEBUG::2014-10-29 11:21:54,842::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54549 >Detector thread::DEBUG::2014-10-29 11:21:54,842::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54549) >Thread-136775::DEBUG::2014-10-29 11:21:54,881::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136775::DEBUG::2014-10-29 11:21:54,882::task::595::Storage.TaskManager.Task::(_updateState) Task=`1777d22b-66a2-4362-a229-5ac9135d4100`::moving from state init -> state preparing >Thread-136775::INFO::2014-10-29 11:21:54,882::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136775::DEBUG::2014-10-29 11:21:54,882::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136775::DEBUG::2014-10-29 11:21:54,883::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136775::DEBUG::2014-10-29 11:21:54,883::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136775::DEBUG::2014-10-29 11:21:54,883::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136775::DEBUG::2014-10-29 11:21:54,883::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136775::DEBUG::2014-10-29 11:21:54,884::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136775::DEBUG::2014-10-29 11:21:54,976::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136775::DEBUG::2014-10-29 11:21:54,977::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136775::DEBUG::2014-10-29 11:21:55,162::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136775::DEBUG::2014-10-29 11:21:55,165::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136775::DEBUG::2014-10-29 11:21:55,165::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136775::DEBUG::2014-10-29 11:21:55,166::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136775::DEBUG::2014-10-29 11:21:55,166::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136775::DEBUG::2014-10-29 11:21:55,167::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136775::DEBUG::2014-10-29 11:21:55,167::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136775::DEBUG::2014-10-29 11:21:55,167::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:21:55,174::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:55,177::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:55,177::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:55,177::__init__::232::IOProcess::(_processLogs) (201594) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:55,178::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201594) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:55,180::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:55,180::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:55,181::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:55,181::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:55,181::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:55,182::__init__::232::IOProcess::(_processLogs) (201595) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:55,183::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201595) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:55,184::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:55,186::__init__::232::IOProcess::(_processLogs) (201596) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:21:55,188::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:55,190::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:55,191::__init__::232::IOProcess::(_processLogs) (201596) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:55,194::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:55,195::__init__::232::IOProcess::(_processLogs) (201597) Got request for method 'glob' >Thread-136775::DEBUG::2014-10-29 11:21:55,196::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:21:55,200::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201597) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:55,202::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:55,202::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:55,202::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:55,203::__init__::232::IOProcess::(_processLogs) (201598) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:21:55,203::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:55,203::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:55,204::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:55,204::__init__::232::IOProcess::(_processLogs) (201599) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:55,207::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201599) Queuing response >Thread-179::DEBUG::2014-10-29 11:21:55,209::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:21:55,227::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201598) Queuing response >Thread-136775::DEBUG::2014-10-29 11:21:55,228::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-179::DEBUG::2014-10-29 11:21:55,232::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00233998 s, 159 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:21:55,235::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:55,235::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:55,236::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:55,236::__init__::232::IOProcess::(_processLogs) (201600) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:21:55,236::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:55,237::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:55,237::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:55,237::__init__::232::IOProcess::(_processLogs) (201601) Got request for method 'statvfs' >Thread-136775::DEBUG::2014-10-29 11:21:55,238::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:21:55,238::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201600) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:55,240::__init__::232::IOProcess::(_processLogs) (201601) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:55,244::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:55,244::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:55,246::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:55,248::__init__::232::IOProcess::(_processLogs) (201602) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:55,248::__init__::232::IOProcess::(_processLogs) (201602) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:55,249::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:55,249::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:55,249::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:55,249::__init__::232::IOProcess::(_processLogs) (201603) Got request for method 'glob' >Thread-136775::DEBUG::2014-10-29 11:21:55,250::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:21:55,250::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201603) Queuing response >Thread-136775::INFO::2014-10-29 11:21:55,251::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136775::INFO::2014-10-29 11:21:55,252::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136775::INFO::2014-10-29 11:21:55,253::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:21:55,253::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:55,254::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:55,254::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:55,254::__init__::232::IOProcess::(_processLogs) (201604) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:21:55,255::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201604) Queuing response >Thread-136775::DEBUG::2014-10-29 11:21:55,255::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136775::DEBUG::2014-10-29 11:21:55,257::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`bd7e7da1-1341-4ab1-bd6a-799669d80656`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136775::DEBUG::2014-10-29 11:21:55,258::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136775::DEBUG::2014-10-29 11:21:55,258::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136775::DEBUG::2014-10-29 11:21:55,258::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`bd7e7da1-1341-4ab1-bd6a-799669d80656`::Granted request >Thread-136775::DEBUG::2014-10-29 11:21:55,259::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1777d22b-66a2-4362-a229-5ac9135d4100`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136775::DEBUG::2014-10-29 11:21:55,259::task::993::Storage.TaskManager.Task::(_decref) Task=`1777d22b-66a2-4362-a229-5ac9135d4100`::ref 1 aborting False >Thread-136775::INFO::2014-10-29 11:21:55,262::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136775::DEBUG::2014-10-29 11:21:55,263::task::1191::Storage.TaskManager.Task::(prepare) Task=`1777d22b-66a2-4362-a229-5ac9135d4100`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136775::DEBUG::2014-10-29 11:21:55,263::task::595::Storage.TaskManager.Task::(_updateState) Task=`1777d22b-66a2-4362-a229-5ac9135d4100`::moving from state preparing -> state finished >Thread-136775::DEBUG::2014-10-29 11:21:55,263::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136775::DEBUG::2014-10-29 11:21:55,263::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136775::DEBUG::2014-10-29 11:21:55,264::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136775::DEBUG::2014-10-29 11:21:55,264::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136775::DEBUG::2014-10-29 11:21:55,264::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136775::DEBUG::2014-10-29 11:21:55,265::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136775::DEBUG::2014-10-29 11:21:55,265::task::993::Storage.TaskManager.Task::(_decref) Task=`1777d22b-66a2-4362-a229-5ac9135d4100`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:21:55,298::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54550 >Detector thread::DEBUG::2014-10-29 11:21:55,298::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54550 >Detector thread::DEBUG::2014-10-29 11:21:55,299::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54550 >Detector thread::DEBUG::2014-10-29 11:21:55,299::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54550) >Thread-136780::DEBUG::2014-10-29 11:21:55,338::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136780::DEBUG::2014-10-29 11:21:55,338::task::595::Storage.TaskManager.Task::(_updateState) Task=`b2f9d036-f0b7-484f-92e6-4ce0a9dee8d4`::moving from state init -> state preparing >Thread-136780::INFO::2014-10-29 11:21:55,339::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136780::INFO::2014-10-29 11:21:55,340::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000417132', 'lastCheck': '9.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000405343', 'lastCheck': '9.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00233998', 'lastCheck': '0.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000631822', 'lastCheck': '9.8', 'valid': True}} >Thread-136780::DEBUG::2014-10-29 11:21:55,340::task::1191::Storage.TaskManager.Task::(prepare) Task=`b2f9d036-f0b7-484f-92e6-4ce0a9dee8d4`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000417132', 'lastCheck': '9.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000405343', 'lastCheck': '9.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00233998', 'lastCheck': '0.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000631822', 'lastCheck': '9.8', 'valid': True}} >Thread-136780::DEBUG::2014-10-29 11:21:55,340::task::595::Storage.TaskManager.Task::(_updateState) Task=`b2f9d036-f0b7-484f-92e6-4ce0a9dee8d4`::moving from state preparing -> state finished >Thread-136780::DEBUG::2014-10-29 11:21:55,341::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136780::DEBUG::2014-10-29 11:21:55,341::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136780::DEBUG::2014-10-29 11:21:55,341::task::993::Storage.TaskManager.Task::(_decref) Task=`b2f9d036-f0b7-484f-92e6-4ce0a9dee8d4`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:21:55,520::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:55,520::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:55,520::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:55,521::__init__::232::IOProcess::(_processLogs) (201605) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:55,658::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:55,658::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:55,658::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:55,659::__init__::232::IOProcess::(_processLogs) (201606) Got request for method 'statvfs' >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:55,789::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:55,792::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:21:55,793::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:21:55,844::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:55,846::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:55,847::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:55,847::__init__::232::IOProcess::(_processLogs) (201607) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:56,780::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201605) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:56,781::__init__::232::IOProcess::(_processLogs) (201607) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:56,782::__init__::232::IOProcess::(_processLogs) (201606) Queuing response >Thread-10269::DEBUG::2014-10-29 11:21:56,785::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:21:56,814::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000704875 s, 712 kB/s\n'; <rc> = 0 >Thread-178::DEBUG::2014-10-29 11:21:56,816::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:21:56,843::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-33::DEBUG::2014-10-29 11:21:56,844::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:21:56,846::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000515189 s, 986 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:21:56,864::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-33::DEBUG::2014-10-29 11:21:56,870::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000461491 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:21:56,871::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:56,875::__init__::232::IOProcess::(_processLogs) (201608) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:56,880::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201608) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:56,884::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:56,888::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:56,891::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:56,892::__init__::232::IOProcess::(_processLogs) (201609) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:56,892::__init__::232::IOProcess::(_processLogs) (201609) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:56,893::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:56,893::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:56,893::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:56,894::__init__::232::IOProcess::(_processLogs) (201610) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:21:56,895::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201610) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:56,897::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:56,897::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:56,897::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:56,897::__init__::232::IOProcess::(_processLogs) (201611) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:56,898::__init__::232::IOProcess::(_processLogs) (201611) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:56,899::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:56,900::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:56,901::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:56,901::__init__::232::IOProcess::(_processLogs) (201612) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:56,901::__init__::232::IOProcess::(_processLogs) (201612) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:56,902::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:56,903::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:56,904::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:56,904::__init__::232::IOProcess::(_processLogs) (201613) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:56,904::__init__::232::IOProcess::(_processLogs) (201613) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:56,904::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:56,905::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:56,906::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:56,906::__init__::232::IOProcess::(_processLogs) (201614) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:56,907::__init__::232::IOProcess::(_processLogs) (201614) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:56,907::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:56,908::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:56,908::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:56,909::__init__::232::IOProcess::(_processLogs) (201615) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:56,909::__init__::232::IOProcess::(_processLogs) (201615) Queuing response >Thread-17::DEBUG::2014-10-29 11:21:56,910::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:21:56,910::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:21:56,911::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:21:56,911::__init__::232::IOProcess::(_processLogs) (201616) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:21:56,912::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201616) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:57,512::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:57,515::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136781::DEBUG::2014-10-29 11:21:57,518::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:21:57,520::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:21:57,522::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136782::DEBUG::2014-10-29 11:21:57,525::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136782::DEBUG::2014-10-29 11:21:57,527::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:22:00,377::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54551 >Detector thread::DEBUG::2014-10-29 11:22:00,378::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54551 >Detector thread::DEBUG::2014-10-29 11:22:00,378::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54551 >Detector thread::DEBUG::2014-10-29 11:22:00,379::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54551) >Thread-136783::DEBUG::2014-10-29 11:22:00,418::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136783::DEBUG::2014-10-29 11:22:00,420::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136783::DEBUG::2014-10-29 11:22:00,440::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136783::DEBUG::2014-10-29 11:22:00,487::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '92', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '92', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:00,541::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:00,543::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136784::DEBUG::2014-10-29 11:22:00,547::task::595::Storage.TaskManager.Task::(_updateState) Task=`f49b5722-8190-4684-8f73-509cb90989e0`::moving from state init -> state preparing >Thread-136784::INFO::2014-10-29 11:22:00,547::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136784::INFO::2014-10-29 11:22:00,548::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515189', 'lastCheck': '3.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461491', 'lastCheck': '3.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00233998', 'lastCheck': '5.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000704875', 'lastCheck': '3.7', 'valid': True}} >Thread-136784::DEBUG::2014-10-29 11:22:00,548::task::1191::Storage.TaskManager.Task::(prepare) Task=`f49b5722-8190-4684-8f73-509cb90989e0`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515189', 'lastCheck': '3.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461491', 'lastCheck': '3.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00233998', 'lastCheck': '5.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000704875', 'lastCheck': '3.7', 'valid': True}} >Thread-136784::DEBUG::2014-10-29 11:22:00,548::task::595::Storage.TaskManager.Task::(_updateState) Task=`f49b5722-8190-4684-8f73-509cb90989e0`::moving from state preparing -> state finished >Thread-136784::DEBUG::2014-10-29 11:22:00,549::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136784::DEBUG::2014-10-29 11:22:00,549::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136784::DEBUG::2014-10-29 11:22:00,549::task::993::Storage.TaskManager.Task::(_decref) Task=`f49b5722-8190-4684-8f73-509cb90989e0`::ref 0 aborting False >Thread-136784::DEBUG::2014-10-29 11:22:00,583::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:00,605::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:00,607::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136785::DEBUG::2014-10-29 11:22:00,610::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136785::DEBUG::2014-10-29 11:22:00,612::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:00,800::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:00,801::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:00,803::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:22:00,972::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54552 >Detector thread::DEBUG::2014-10-29 11:22:00,973::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54552 >Detector thread::DEBUG::2014-10-29 11:22:00,973::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54552 >Detector thread::DEBUG::2014-10-29 11:22:00,974::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54552) >Thread-136786::DEBUG::2014-10-29 11:22:01,013::task::595::Storage.TaskManager.Task::(_updateState) Task=`123b7d5b-b959-4684-983c-75e9baaad7de`::moving from state init -> state preparing >Thread-136786::INFO::2014-10-29 11:22:01,013::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136786::INFO::2014-10-29 11:22:01,014::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515189', 'lastCheck': '4.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461491', 'lastCheck': '4.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00233998', 'lastCheck': '5.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000704875', 'lastCheck': '4.1', 'valid': True}} >Thread-136786::DEBUG::2014-10-29 11:22:01,014::task::1191::Storage.TaskManager.Task::(prepare) Task=`123b7d5b-b959-4684-983c-75e9baaad7de`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515189', 'lastCheck': '4.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000461491', 'lastCheck': '4.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00233998', 'lastCheck': '5.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000704875', 'lastCheck': '4.1', 'valid': True}} >Thread-136786::DEBUG::2014-10-29 11:22:01,014::task::595::Storage.TaskManager.Task::(_updateState) Task=`123b7d5b-b959-4684-983c-75e9baaad7de`::moving from state preparing -> state finished >Thread-136786::DEBUG::2014-10-29 11:22:01,014::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136786::DEBUG::2014-10-29 11:22:01,015::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136786::DEBUG::2014-10-29 11:22:01,015::task::993::Storage.TaskManager.Task::(_decref) Task=`123b7d5b-b959-4684-983c-75e9baaad7de`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:22:01,219::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54553 >Detector thread::DEBUG::2014-10-29 11:22:01,220::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54553 >Detector thread::DEBUG::2014-10-29 11:22:01,220::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54553 >Detector thread::DEBUG::2014-10-29 11:22:01,221::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54553) >Thread-136787::DEBUG::2014-10-29 11:22:01,260::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136787::DEBUG::2014-10-29 11:22:01,261::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136787::DEBUG::2014-10-29 11:22:01,262::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.75', 'elapsedTime': '514353', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '8978749', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '58995', 'readRate': '0.00', 'truesize': '6010880000', 'writeRate': '30828.20'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.57', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:03,660::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:03,665::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136788::DEBUG::2014-10-29 11:22:03,668::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:03,671::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:03,672::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136789::DEBUG::2014-10-29 11:22:03,675::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136789::DEBUG::2014-10-29 11:22:03,677::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:22:04,322::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >Thread-22::DEBUG::2014-10-29 11:22:04,727::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-17::DEBUG::2014-10-29 11:22:05,249::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:05,249::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:05,250::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:05,250::__init__::232::IOProcess::(_processLogs) (201617) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:05,253::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201617) Queuing response >Thread-179::DEBUG::2014-10-29 11:22:05,255::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:22:05,275::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000432874 s, 859 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:22:05,277::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:05,278::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:05,278::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:05,278::__init__::232::IOProcess::(_processLogs) (201618) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:05,280::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201618) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:05,810::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:05,812::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:05,814::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:06,697::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:06,699::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136790::DEBUG::2014-10-29 11:22:06,703::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:06,705::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:06,707::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136791::DEBUG::2014-10-29 11:22:06,710::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136791::DEBUG::2014-10-29 11:22:06,712::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:22:06,884::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:06,885::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:06,885::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:06,885::__init__::232::IOProcess::(_processLogs) (201619) Got request for method 'statvfs' >Thread-10269::DEBUG::2014-10-29 11:22:06,890::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:22:06,907::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201619) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:06,912::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:06,912::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:06,913::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:06,913::__init__::232::IOProcess::(_processLogs) (201620) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:06,914::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:06,914::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:06,914::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:06,915::__init__::232::IOProcess::(_processLogs) (201621) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:06,916::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201621) Queuing response >Thread-33::DEBUG::2014-10-29 11:22:06,918::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:22:06,940::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00376302 s, 133 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:22:06,946::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201620) Queuing response >Thread-33::DEBUG::2014-10-29 11:22:06,947::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00088935 s, 548 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:22:06,951::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:06,951::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:06,952::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:06,953::__init__::232::IOProcess::(_processLogs) (201622) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:06,953::__init__::232::IOProcess::(_processLogs) (201622) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:06,955::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:06,957::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-178::DEBUG::2014-10-29 11:22:06,958::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:22:06,983::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:06,988::__init__::232::IOProcess::(_processLogs) (201623) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:06,990::__init__::232::IOProcess::(_processLogs) (201623) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:06,993::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:06,994::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:06,995::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:06,996::__init__::232::IOProcess::(_processLogs) (201624) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:06,998::__init__::232::IOProcess::(_processLogs) (201624) Queuing response >Thread-178::DEBUG::2014-10-29 11:22:07,001::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.0185344 s, 27.4 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:22:07,008::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:07,008::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:07,008::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:07,009::__init__::232::IOProcess::(_processLogs) (201625) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:07,010::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201625) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:07,010::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:07,010::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:07,011::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:07,012::__init__::232::IOProcess::(_processLogs) (201626) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:07,013::__init__::232::IOProcess::(_processLogs) (201626) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:07,014::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:07,015::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:07,016::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:07,017::__init__::232::IOProcess::(_processLogs) (201627) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:07,017::__init__::232::IOProcess::(_processLogs) (201627) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:07,017::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:07,018::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:07,018::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:07,018::__init__::232::IOProcess::(_processLogs) (201628) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:07,018::__init__::232::IOProcess::(_processLogs) (201628) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:07,020::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:07,022::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:07,023::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:07,023::__init__::232::IOProcess::(_processLogs) (201629) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:07,023::__init__::232::IOProcess::(_processLogs) (201629) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:07,024::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:07,024::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:07,025::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:07,025::__init__::232::IOProcess::(_processLogs) (201630) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:07,026::__init__::232::IOProcess::(_processLogs) (201630) Queuing response >Detector thread::DEBUG::2014-10-29 11:22:07,273::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54558 >Detector thread::DEBUG::2014-10-29 11:22:07,274::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54558 >Detector thread::DEBUG::2014-10-29 11:22:07,274::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54558 >Detector thread::DEBUG::2014-10-29 11:22:07,275::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54558) >Thread-136792::DEBUG::2014-10-29 11:22:07,314::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136792::DEBUG::2014-10-29 11:22:07,315::task::595::Storage.TaskManager.Task::(_updateState) Task=`a823ba6e-d39e-4484-87d4-3cc064d1a77d`::moving from state init -> state preparing >Thread-136792::INFO::2014-10-29 11:22:07,316::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136792::DEBUG::2014-10-29 11:22:07,319::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:22:07,321::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:07,321::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-136792::DEBUG::2014-10-29 11:22:07,322::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:22:07,322::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-136792::DEBUG::2014-10-29 11:22:07,324::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-17::DEBUG::2014-10-29 11:22:07,325::__init__::232::IOProcess::(_processLogs) (201631) Got request for method 'glob' >Thread-136792::INFO::2014-10-29 11:22:07,326::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-17::DEBUG::2014-10-29 11:22:07,327::__init__::232::IOProcess::(_processLogs) (201631) Queuing response >Thread-136792::DEBUG::2014-10-29 11:22:07,329::task::1191::Storage.TaskManager.Task::(prepare) Task=`a823ba6e-d39e-4484-87d4-3cc064d1a77d`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136792::DEBUG::2014-10-29 11:22:07,329::task::595::Storage.TaskManager.Task::(_updateState) Task=`a823ba6e-d39e-4484-87d4-3cc064d1a77d`::moving from state preparing -> state finished >Thread-136792::DEBUG::2014-10-29 11:22:07,329::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136792::DEBUG::2014-10-29 11:22:07,330::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136792::DEBUG::2014-10-29 11:22:07,330::task::993::Storage.TaskManager.Task::(_decref) Task=`a823ba6e-d39e-4484-87d4-3cc064d1a77d`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:22:07,375::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54559 >Detector thread::DEBUG::2014-10-29 11:22:07,376::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54559 >Detector thread::DEBUG::2014-10-29 11:22:07,376::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54559 >Detector thread::DEBUG::2014-10-29 11:22:07,377::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54559) >Thread-136793::DEBUG::2014-10-29 11:22:07,415::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136793::DEBUG::2014-10-29 11:22:07,416::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c746215-63fb-41fc-94c4-bc5985918cc6`::moving from state init -> state preparing >Thread-136793::INFO::2014-10-29 11:22:07,416::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136793::DEBUG::2014-10-29 11:22:07,417::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136793::DEBUG::2014-10-29 11:22:07,417::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136793::DEBUG::2014-10-29 11:22:07,417::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136793::DEBUG::2014-10-29 11:22:07,417::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136793::DEBUG::2014-10-29 11:22:07,418::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136793::DEBUG::2014-10-29 11:22:07,418::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136793::DEBUG::2014-10-29 11:22:07,515::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136793::DEBUG::2014-10-29 11:22:07,516::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136793::DEBUG::2014-10-29 11:22:07,754::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136793::DEBUG::2014-10-29 11:22:07,755::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136793::DEBUG::2014-10-29 11:22:07,756::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136793::DEBUG::2014-10-29 11:22:07,756::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136793::DEBUG::2014-10-29 11:22:07,756::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136793::DEBUG::2014-10-29 11:22:07,757::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136793::DEBUG::2014-10-29 11:22:07,757::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136793::DEBUG::2014-10-29 11:22:07,758::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:22:07,763::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:07,767::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:07,768::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:07,769::__init__::232::IOProcess::(_processLogs) (201632) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:22:07,770::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201632) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:07,771::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:07,772::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:07,772::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:07,773::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:07,773::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:07,775::__init__::232::IOProcess::(_processLogs) (201633) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:22:07,777::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:07,778::__init__::232::IOProcess::(_processLogs) (201634) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:22:07,780::__init__::232::IOProcess::(_processLogs) (201633) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:07,782::__init__::232::IOProcess::(_processLogs) (201634) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:07,784::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:07,785::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-136793::DEBUG::2014-10-29 11:22:07,785::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:22:07,787::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:07,788::__init__::232::IOProcess::(_processLogs) (201635) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:22:07,788::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201635) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:07,791::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:07,792::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:07,793::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-136793::DEBUG::2014-10-29 11:22:07,794::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:22:07,795::__init__::232::IOProcess::(_processLogs) (201636) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:22:07,796::__init__::232::IOProcess::(_processLogs) (201636) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:07,797::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:07,797::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:07,797::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:07,798::__init__::232::IOProcess::(_processLogs) (201637) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:22:07,798::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201637) Queuing response >Thread-136793::DEBUG::2014-10-29 11:22:07,799::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:22:07,801::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:07,801::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:07,801::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:07,802::__init__::232::IOProcess::(_processLogs) (201638) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:07,802::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201638) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:07,804::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:07,804::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:07,804::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:07,804::__init__::232::IOProcess::(_processLogs) (201639) Got request for method 'glob' >Thread-136793::DEBUG::2014-10-29 11:22:07,805::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:22:07,805::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201639) Queuing response >Thread-136793::INFO::2014-10-29 11:22:07,806::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136793::INFO::2014-10-29 11:22:07,807::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136793::INFO::2014-10-29 11:22:07,808::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:22:07,808::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:07,809::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:07,809::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:07,809::__init__::232::IOProcess::(_processLogs) (201640) Got request for method 'readfile' >Thread-136793::DEBUG::2014-10-29 11:22:07,810::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:22:07,810::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201640) Queuing response >Thread-136793::DEBUG::2014-10-29 11:22:07,813::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`ff22373d-5899-49cc-8b47-436a15cf0cf5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136793::DEBUG::2014-10-29 11:22:07,813::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136793::DEBUG::2014-10-29 11:22:07,814::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136793::DEBUG::2014-10-29 11:22:07,814::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`ff22373d-5899-49cc-8b47-436a15cf0cf5`::Granted request >Thread-136793::DEBUG::2014-10-29 11:22:07,815::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9c746215-63fb-41fc-94c4-bc5985918cc6`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136793::DEBUG::2014-10-29 11:22:07,815::task::993::Storage.TaskManager.Task::(_decref) Task=`9c746215-63fb-41fc-94c4-bc5985918cc6`::ref 1 aborting False >Thread-136793::INFO::2014-10-29 11:22:07,818::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136793::DEBUG::2014-10-29 11:22:07,818::task::1191::Storage.TaskManager.Task::(prepare) Task=`9c746215-63fb-41fc-94c4-bc5985918cc6`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136793::DEBUG::2014-10-29 11:22:07,818::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c746215-63fb-41fc-94c4-bc5985918cc6`::moving from state preparing -> state finished >Thread-136793::DEBUG::2014-10-29 11:22:07,819::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136793::DEBUG::2014-10-29 11:22:07,819::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136793::DEBUG::2014-10-29 11:22:07,819::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136793::DEBUG::2014-10-29 11:22:07,820::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136793::DEBUG::2014-10-29 11:22:07,820::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136793::DEBUG::2014-10-29 11:22:07,820::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136793::DEBUG::2014-10-29 11:22:07,821::task::993::Storage.TaskManager.Task::(_decref) Task=`9c746215-63fb-41fc-94c4-bc5985918cc6`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:22:07,845::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54560 >Detector thread::DEBUG::2014-10-29 11:22:07,845::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54560 >Detector thread::DEBUG::2014-10-29 11:22:07,846::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54560 >Detector thread::DEBUG::2014-10-29 11:22:07,846::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54560) >Thread-136798::DEBUG::2014-10-29 11:22:07,886::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136798::DEBUG::2014-10-29 11:22:07,887::task::595::Storage.TaskManager.Task::(_updateState) Task=`4103c3f5-31a6-4c2b-8f7c-0b8e4c621ae6`::moving from state init -> state preparing >Thread-136798::INFO::2014-10-29 11:22:07,888::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136798::INFO::2014-10-29 11:22:07,888::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0185344', 'lastCheck': '0.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00088935', 'lastCheck': '0.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000432874', 'lastCheck': '2.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00376302', 'lastCheck': '0.9', 'valid': True}} >Thread-136798::DEBUG::2014-10-29 11:22:07,889::task::1191::Storage.TaskManager.Task::(prepare) Task=`4103c3f5-31a6-4c2b-8f7c-0b8e4c621ae6`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0185344', 'lastCheck': '0.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00088935', 'lastCheck': '0.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000432874', 'lastCheck': '2.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00376302', 'lastCheck': '0.9', 'valid': True}} >Thread-136798::DEBUG::2014-10-29 11:22:07,889::task::595::Storage.TaskManager.Task::(_updateState) Task=`4103c3f5-31a6-4c2b-8f7c-0b8e4c621ae6`::moving from state preparing -> state finished >Thread-136798::DEBUG::2014-10-29 11:22:07,889::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136798::DEBUG::2014-10-29 11:22:07,889::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136798::DEBUG::2014-10-29 11:22:07,890::task::993::Storage.TaskManager.Task::(_decref) Task=`4103c3f5-31a6-4c2b-8f7c-0b8e4c621ae6`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:09,743::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:09,747::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136799::DEBUG::2014-10-29 11:22:09,750::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:09,753::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:09,755::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136800::DEBUG::2014-10-29 11:22:09,759::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136800::DEBUG::2014-10-29 11:22:09,761::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:22:10,423::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54561 >Detector thread::DEBUG::2014-10-29 11:22:10,423::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54561 >Detector thread::DEBUG::2014-10-29 11:22:10,424::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54561 >Detector thread::DEBUG::2014-10-29 11:22:10,424::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54561) >Thread-136801::DEBUG::2014-10-29 11:22:10,463::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136801::DEBUG::2014-10-29 11:22:10,465::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136801::DEBUG::2014-10-29 11:22:10,465::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.25', 'elapsedTime': '514362', 'displayType': 'vnc', 'cpuSys': '0.99', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '8978749', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '58995', 'readRate': '0.00', 'truesize': '6010880000', 'writeRate': '30828.20'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.74', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:22:10,539::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54562 >Detector thread::DEBUG::2014-10-29 11:22:10,540::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54562 >Detector thread::DEBUG::2014-10-29 11:22:10,540::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54562 >Detector thread::DEBUG::2014-10-29 11:22:10,542::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54562) >Thread-136802::DEBUG::2014-10-29 11:22:10,581::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136802::DEBUG::2014-10-29 11:22:10,583::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136802::DEBUG::2014-10-29 11:22:10,611::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136802::DEBUG::2014-10-29 11:22:10,678::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '73', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '73', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:10,821::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:10,823::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:10,824::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:22:11,075::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54564 >Detector thread::DEBUG::2014-10-29 11:22:11,076::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54564 >Detector thread::DEBUG::2014-10-29 11:22:11,076::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54564 >Detector thread::DEBUG::2014-10-29 11:22:11,077::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54564) >Thread-136803::DEBUG::2014-10-29 11:22:11,116::task::595::Storage.TaskManager.Task::(_updateState) Task=`e739f100-6a4e-4d01-b8f1-0a05c1c0e87d`::moving from state init -> state preparing >Thread-136803::INFO::2014-10-29 11:22:11,117::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136803::INFO::2014-10-29 11:22:11,118::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0185344', 'lastCheck': '4.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00088935', 'lastCheck': '4.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000432874', 'lastCheck': '5.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00376302', 'lastCheck': '4.2', 'valid': True}} >Thread-136803::DEBUG::2014-10-29 11:22:11,118::task::1191::Storage.TaskManager.Task::(prepare) Task=`e739f100-6a4e-4d01-b8f1-0a05c1c0e87d`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0185344', 'lastCheck': '4.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00088935', 'lastCheck': '4.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000432874', 'lastCheck': '5.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00376302', 'lastCheck': '4.2', 'valid': True}} >Thread-136803::DEBUG::2014-10-29 11:22:11,118::task::595::Storage.TaskManager.Task::(_updateState) Task=`e739f100-6a4e-4d01-b8f1-0a05c1c0e87d`::moving from state preparing -> state finished >Thread-136803::DEBUG::2014-10-29 11:22:11,118::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136803::DEBUG::2014-10-29 11:22:11,119::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136803::DEBUG::2014-10-29 11:22:11,119::task::993::Storage.TaskManager.Task::(_decref) Task=`e739f100-6a4e-4d01-b8f1-0a05c1c0e87d`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:12,777::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:12,779::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136804::DEBUG::2014-10-29 11:22:12,782::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:12,784::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:12,786::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136805::DEBUG::2014-10-29 11:22:12,789::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136805::DEBUG::2014-10-29 11:22:12,791::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:22:15,285::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:15,285::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:15,286::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:15,286::__init__::232::IOProcess::(_processLogs) (201641) Got request for method 'statvfs' >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:15,803::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:15,806::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136806::DEBUG::2014-10-29 11:22:15,811::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b3c66c1-b1bc-41ba-9fbf-3d69fd122820`::moving from state init -> state preparing >Thread-136806::INFO::2014-10-29 11:22:15,811::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136806::INFO::2014-10-29 11:22:15,812::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0185344', 'lastCheck': '8.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00088935', 'lastCheck': '8.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000432874', 'lastCheck': '10.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00376302', 'lastCheck': '8.9', 'valid': True}} >Thread-136806::DEBUG::2014-10-29 11:22:15,812::task::1191::Storage.TaskManager.Task::(prepare) Task=`2b3c66c1-b1bc-41ba-9fbf-3d69fd122820`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0185344', 'lastCheck': '8.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00088935', 'lastCheck': '8.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000432874', 'lastCheck': '10.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00376302', 'lastCheck': '8.9', 'valid': True}} >Thread-136806::DEBUG::2014-10-29 11:22:15,812::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b3c66c1-b1bc-41ba-9fbf-3d69fd122820`::moving from state preparing -> state finished >Thread-136806::DEBUG::2014-10-29 11:22:15,813::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136806::DEBUG::2014-10-29 11:22:15,813::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136806::DEBUG::2014-10-29 11:22:15,813::task::993::Storage.TaskManager.Task::(_decref) Task=`2b3c66c1-b1bc-41ba-9fbf-3d69fd122820`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:15,826::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:15,828::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:15,829::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:22:16,776::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201641) Queuing response >Thread-179::DEBUG::2014-10-29 11:22:16,790::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:22:16,813::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000468574 s, 794 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:22:16,822::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:16,826::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:16,829::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:16,832::__init__::232::IOProcess::(_processLogs) (201642) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:16,844::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201642) Queuing response >Thread-136806::DEBUG::2014-10-29 11:22:16,865::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:16,889::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:16,894::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136807::DEBUG::2014-10-29 11:22:16,904::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136807::DEBUG::2014-10-29 11:22:16,922::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:22:16,957::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:16,959::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:16,960::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:16,962::__init__::232::IOProcess::(_processLogs) (201643) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:16,967::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201643) Queuing response >Thread-10269::DEBUG::2014-10-29 11:22:16,969::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:22:16,993::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00181435 s, 277 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:22:16,998::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:17,000::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:17,002::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:17,008::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201644) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:17,011::__init__::232::IOProcess::(_processLogs) (201644) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:17,025::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:17,026::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:17,028::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:17,030::__init__::232::IOProcess::(_processLogs) (201645) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:17,036::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201645) Queuing response >Thread-33::DEBUG::2014-10-29 11:22:17,038::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:22:17,039::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:17,056::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-33::DEBUG::2014-10-29 11:22:17,059::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00100669 s, 484 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:22:17,062::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-178::DEBUG::2014-10-29 11:22:17,062::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:22:17,077::__init__::232::IOProcess::(_processLogs) (201646) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:17,081::__init__::232::IOProcess::(_processLogs) (201646) Queuing response >Thread-178::DEBUG::2014-10-29 11:22:17,086::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000455168 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:22:17,088::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:17,092::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:17,093::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:17,095::__init__::232::IOProcess::(_processLogs) (201647) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:17,100::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201647) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:17,105::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:17,105::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:17,106::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:17,106::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:17,107::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:17,108::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:17,108::__init__::232::IOProcess::(_processLogs) (201648) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:17,108::__init__::232::IOProcess::(_processLogs) (201649) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:17,108::__init__::232::IOProcess::(_processLogs) (201649) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:17,109::__init__::232::IOProcess::(_processLogs) (201648) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:17,111::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:17,112::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:17,113::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:17,113::__init__::232::IOProcess::(_processLogs) (201650) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:17,113::__init__::232::IOProcess::(_processLogs) (201650) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:17,114::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:17,114::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:17,114::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:17,114::__init__::232::IOProcess::(_processLogs) (201651) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:17,115::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201651) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:17,116::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:17,117::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:17,117::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:17,118::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:17,120::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:17,120::__init__::232::IOProcess::(_processLogs) (201653) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:17,121::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:17,122::__init__::232::IOProcess::(_processLogs) (201652) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:17,122::__init__::232::IOProcess::(_processLogs) (201653) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:17,122::__init__::232::IOProcess::(_processLogs) (201652) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:17,123::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:17,123::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:17,123::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:17,124::__init__::232::IOProcess::(_processLogs) (201654) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:17,125::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201654) Queuing response >Detector thread::DEBUG::2014-10-29 11:22:18,570::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54569 >Detector thread::DEBUG::2014-10-29 11:22:18,571::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54569 >Detector thread::DEBUG::2014-10-29 11:22:18,571::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54569 >Detector thread::DEBUG::2014-10-29 11:22:18,572::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54569) >Thread-136808::DEBUG::2014-10-29 11:22:18,611::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136808::DEBUG::2014-10-29 11:22:18,612::task::595::Storage.TaskManager.Task::(_updateState) Task=`1744ca21-fa41-4340-ba85-8eb3ed192327`::moving from state init -> state preparing >Thread-136808::INFO::2014-10-29 11:22:18,612::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136808::DEBUG::2014-10-29 11:22:18,618::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:22:18,622::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:18,622::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:18,622::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:18,623::__init__::232::IOProcess::(_processLogs) (201655) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:22:18,625::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201655) Queuing response >Thread-136808::DEBUG::2014-10-29 11:22:18,625::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136808::DEBUG::2014-10-29 11:22:18,626::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136808::INFO::2014-10-29 11:22:18,626::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136808::DEBUG::2014-10-29 11:22:18,627::task::1191::Storage.TaskManager.Task::(prepare) Task=`1744ca21-fa41-4340-ba85-8eb3ed192327`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136808::DEBUG::2014-10-29 11:22:18,627::task::595::Storage.TaskManager.Task::(_updateState) Task=`1744ca21-fa41-4340-ba85-8eb3ed192327`::moving from state preparing -> state finished >Thread-136808::DEBUG::2014-10-29 11:22:18,627::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136808::DEBUG::2014-10-29 11:22:18,627::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136808::DEBUG::2014-10-29 11:22:18,628::task::993::Storage.TaskManager.Task::(_decref) Task=`1744ca21-fa41-4340-ba85-8eb3ed192327`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:22:18,677::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54570 >Detector thread::DEBUG::2014-10-29 11:22:18,678::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54570 >Detector thread::DEBUG::2014-10-29 11:22:18,678::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54570 >Detector thread::DEBUG::2014-10-29 11:22:18,679::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54570) >Thread-136809::DEBUG::2014-10-29 11:22:18,717::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136809::DEBUG::2014-10-29 11:22:18,717::task::595::Storage.TaskManager.Task::(_updateState) Task=`b485da32-8b9a-41e6-9674-643f7b8debfe`::moving from state init -> state preparing >Thread-136809::INFO::2014-10-29 11:22:18,718::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136809::DEBUG::2014-10-29 11:22:18,718::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136809::DEBUG::2014-10-29 11:22:18,718::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136809::DEBUG::2014-10-29 11:22:18,719::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136809::DEBUG::2014-10-29 11:22:18,719::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136809::DEBUG::2014-10-29 11:22:18,719::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136809::DEBUG::2014-10-29 11:22:18,720::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136809::DEBUG::2014-10-29 11:22:18,830::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136809::DEBUG::2014-10-29 11:22:18,831::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136809::DEBUG::2014-10-29 11:22:19,078::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136809::DEBUG::2014-10-29 11:22:19,080::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136809::DEBUG::2014-10-29 11:22:19,080::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136809::DEBUG::2014-10-29 11:22:19,081::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136809::DEBUG::2014-10-29 11:22:19,081::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136809::DEBUG::2014-10-29 11:22:19,081::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136809::DEBUG::2014-10-29 11:22:19,082::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136809::DEBUG::2014-10-29 11:22:19,082::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:22:19,090::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:19,092::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:19,092::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:19,092::__init__::232::IOProcess::(_processLogs) (201656) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:22:19,093::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201656) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:19,094::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:19,095::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:19,095::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:19,095::__init__::232::IOProcess::(_processLogs) (201657) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:22:19,096::__init__::232::IOProcess::(_processLogs) (201657) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:19,097::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:19,098::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:19,098::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:19,098::__init__::232::IOProcess::(_processLogs) (201658) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:22:19,100::__init__::232::IOProcess::(_processLogs) (201658) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:19,105::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:19,109::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:19,114::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-136809::DEBUG::2014-10-29 11:22:19,115::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:22:19,116::__init__::232::IOProcess::(_processLogs) (201659) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:22:19,119::__init__::232::IOProcess::(_processLogs) (201659) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:19,123::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:19,124::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:19,126::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:19,127::__init__::232::IOProcess::(_processLogs) (201660) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:22:19,130::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201660) Queuing response >Thread-136809::DEBUG::2014-10-29 11:22:19,131::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:22:19,135::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:19,136::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:19,138::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-136809::DEBUG::2014-10-29 11:22:19,139::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:22:19,140::__init__::232::IOProcess::(_processLogs) (201661) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:22:19,143::__init__::232::IOProcess::(_processLogs) (201661) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:19,147::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:19,147::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:19,148::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:19,149::__init__::232::IOProcess::(_processLogs) (201662) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:19,149::__init__::232::IOProcess::(_processLogs) (201662) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:19,150::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:19,150::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-136809::DEBUG::2014-10-29 11:22:19,151::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:22:19,151::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-136809::INFO::2014-10-29 11:22:19,152::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136809::INFO::2014-10-29 11:22:19,153::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:22:19,153::__init__::232::IOProcess::(_processLogs) (201663) Got request for method 'glob' >Thread-136809::INFO::2014-10-29 11:22:19,154::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:22:19,155::__init__::232::IOProcess::(_processLogs) (201663) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:19,157::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:19,157::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:19,157::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:19,157::__init__::232::IOProcess::(_processLogs) (201664) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:22:19,158::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201664) Queuing response >Thread-136809::DEBUG::2014-10-29 11:22:19,159::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136809::DEBUG::2014-10-29 11:22:19,161::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`b2305ed3-b614-487f-840f-c44b1c74bc30`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136809::DEBUG::2014-10-29 11:22:19,161::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136809::DEBUG::2014-10-29 11:22:19,162::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136809::DEBUG::2014-10-29 11:22:19,162::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`b2305ed3-b614-487f-840f-c44b1c74bc30`::Granted request >Thread-136809::DEBUG::2014-10-29 11:22:19,162::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b485da32-8b9a-41e6-9674-643f7b8debfe`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136809::DEBUG::2014-10-29 11:22:19,163::task::993::Storage.TaskManager.Task::(_decref) Task=`b485da32-8b9a-41e6-9674-643f7b8debfe`::ref 1 aborting False >Thread-136809::INFO::2014-10-29 11:22:19,165::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136809::DEBUG::2014-10-29 11:22:19,166::task::1191::Storage.TaskManager.Task::(prepare) Task=`b485da32-8b9a-41e6-9674-643f7b8debfe`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136809::DEBUG::2014-10-29 11:22:19,166::task::595::Storage.TaskManager.Task::(_updateState) Task=`b485da32-8b9a-41e6-9674-643f7b8debfe`::moving from state preparing -> state finished >Thread-136809::DEBUG::2014-10-29 11:22:19,166::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136809::DEBUG::2014-10-29 11:22:19,167::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136809::DEBUG::2014-10-29 11:22:19,167::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136809::DEBUG::2014-10-29 11:22:19,167::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136809::DEBUG::2014-10-29 11:22:19,168::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136809::DEBUG::2014-10-29 11:22:19,168::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136809::DEBUG::2014-10-29 11:22:19,168::task::993::Storage.TaskManager.Task::(_decref) Task=`b485da32-8b9a-41e6-9674-643f7b8debfe`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:22:19,201::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54571 >Detector thread::DEBUG::2014-10-29 11:22:19,202::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54571 >Detector thread::DEBUG::2014-10-29 11:22:19,202::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54571 >Detector thread::DEBUG::2014-10-29 11:22:19,202::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54571) >Thread-136814::DEBUG::2014-10-29 11:22:19,241::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136814::DEBUG::2014-10-29 11:22:19,241::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a2edb83-c9b3-468b-afab-35a0413197d2`::moving from state init -> state preparing >Thread-136814::INFO::2014-10-29 11:22:19,242::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136814::INFO::2014-10-29 11:22:19,243::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455168', 'lastCheck': '2.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100669', 'lastCheck': '2.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468574', 'lastCheck': '2.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00181435', 'lastCheck': '2.2', 'valid': True}} >Thread-136814::DEBUG::2014-10-29 11:22:19,243::task::1191::Storage.TaskManager.Task::(prepare) Task=`6a2edb83-c9b3-468b-afab-35a0413197d2`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455168', 'lastCheck': '2.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100669', 'lastCheck': '2.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468574', 'lastCheck': '2.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00181435', 'lastCheck': '2.2', 'valid': True}} >Thread-136814::DEBUG::2014-10-29 11:22:19,243::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a2edb83-c9b3-468b-afab-35a0413197d2`::moving from state preparing -> state finished >Thread-136814::DEBUG::2014-10-29 11:22:19,243::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136814::DEBUG::2014-10-29 11:22:19,244::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136814::DEBUG::2014-10-29 11:22:19,244::task::993::Storage.TaskManager.Task::(_decref) Task=`6a2edb83-c9b3-468b-afab-35a0413197d2`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:22:19,780::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:20,000::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:20,002::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136815::DEBUG::2014-10-29 11:22:20,006::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:20,009::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:20,011::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136816::DEBUG::2014-10-29 11:22:20,014::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136816::DEBUG::2014-10-29 11:22:20,016::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:22:20,642::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54572 >Detector thread::DEBUG::2014-10-29 11:22:20,642::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54572 >Detector thread::DEBUG::2014-10-29 11:22:20,643::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54572 >Detector thread::DEBUG::2014-10-29 11:22:20,643::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54572) >Thread-136817::DEBUG::2014-10-29 11:22:20,682::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136817::DEBUG::2014-10-29 11:22:20,683::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136817::DEBUG::2014-10-29 11:22:20,684::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.74', 'elapsedTime': '514373', 'displayType': 'vnc', 'cpuSys': '0.66', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '8978749', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '58995', 'readRate': '0.00', 'truesize': '6010880000', 'writeRate': '30828.20'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.95', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:22:20,729::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54573 >Detector thread::DEBUG::2014-10-29 11:22:20,730::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54573 >Detector thread::DEBUG::2014-10-29 11:22:20,731::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54573 >Detector thread::DEBUG::2014-10-29 11:22:20,731::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54573) >Thread-136818::DEBUG::2014-10-29 11:22:20,770::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136818::DEBUG::2014-10-29 11:22:20,772::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136818::DEBUG::2014-10-29 11:22:20,794::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:20,844::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:20,850::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136818::DEBUG::2014-10-29 11:22:20,851::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '56', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '56', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:20,857::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:22:21,211::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54575 >Detector thread::DEBUG::2014-10-29 11:22:21,212::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54575 >Detector thread::DEBUG::2014-10-29 11:22:21,212::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54575 >Detector thread::DEBUG::2014-10-29 11:22:21,213::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54575) >Thread-136819::DEBUG::2014-10-29 11:22:21,252::task::595::Storage.TaskManager.Task::(_updateState) Task=`2095f7a7-4c1a-471d-b7c7-e5201eeacabc`::moving from state init -> state preparing >Thread-136819::INFO::2014-10-29 11:22:21,252::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136819::INFO::2014-10-29 11:22:21,253::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455168', 'lastCheck': '4.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100669', 'lastCheck': '4.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468574', 'lastCheck': '4.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00181435', 'lastCheck': '4.2', 'valid': True}} >Thread-136819::DEBUG::2014-10-29 11:22:21,253::task::1191::Storage.TaskManager.Task::(prepare) Task=`2095f7a7-4c1a-471d-b7c7-e5201eeacabc`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455168', 'lastCheck': '4.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100669', 'lastCheck': '4.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000468574', 'lastCheck': '4.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00181435', 'lastCheck': '4.2', 'valid': True}} >Thread-136819::DEBUG::2014-10-29 11:22:21,254::task::595::Storage.TaskManager.Task::(_updateState) Task=`2095f7a7-4c1a-471d-b7c7-e5201eeacabc`::moving from state preparing -> state finished >Thread-136819::DEBUG::2014-10-29 11:22:21,254::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136819::DEBUG::2014-10-29 11:22:21,254::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136819::DEBUG::2014-10-29 11:22:21,254::task::993::Storage.TaskManager.Task::(_decref) Task=`2095f7a7-4c1a-471d-b7c7-e5201eeacabc`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:23,033::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:23,036::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136820::DEBUG::2014-10-29 11:22:23,039::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:23,041::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:23,043::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136821::DEBUG::2014-10-29 11:22:23,046::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136821::DEBUG::2014-10-29 11:22:23,048::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:25,865::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:25,866::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:25,868::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:26,062::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:26,064::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136822::DEBUG::2014-10-29 11:22:26,068::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:26,070::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:26,072::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136823::DEBUG::2014-10-29 11:22:26,075::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136823::DEBUG::2014-10-29 11:22:26,077::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:22:26,851::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:26,851::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:26,852::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:26,852::__init__::232::IOProcess::(_processLogs) (201665) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:26,853::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201665) Queuing response >Thread-179::DEBUG::2014-10-29 11:22:26,855::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:22:26,873::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000525438 s, 708 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:22:26,875::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:26,875::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:26,875::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:26,876::__init__::232::IOProcess::(_processLogs) (201666) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:26,876::__init__::232::IOProcess::(_processLogs) (201666) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:27,012::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:27,012::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:27,013::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:27,015::__init__::232::IOProcess::(_processLogs) (201667) Got request for method 'statvfs' >Thread-10269::DEBUG::2014-10-29 11:22:27,015::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:22:27,016::__init__::232::IOProcess::(_processLogs) (201667) Queuing response >Thread-10269::DEBUG::2014-10-29 11:22:27,033::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00043475 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:22:27,034::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:27,034::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:27,035::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:27,035::__init__::232::IOProcess::(_processLogs) (201668) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:27,037::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201668) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:27,122::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:27,122::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:27,123::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:27,123::__init__::232::IOProcess::(_processLogs) (201669) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:27,123::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201669) Queuing response >Thread-33::DEBUG::2014-10-29 11:22:27,125::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:22:27,143::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:27,144::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:27,144::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:27,144::__init__::232::IOProcess::(_processLogs) (201670) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:27,144::__init__::232::IOProcess::(_processLogs) (201670) Queuing response >Thread-33::DEBUG::2014-10-29 11:22:27,147::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00237895 s, 205 kB/s\n'; <rc> = 0 >Thread-178::DEBUG::2014-10-29 11:22:27,151::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:22:27,151::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:27,167::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-178::DEBUG::2014-10-29 11:22:27,171::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000740087 s, 686 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:22:27,171::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:27,177::__init__::232::IOProcess::(_processLogs) (201671) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:27,185::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201671) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:27,190::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:27,191::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:27,192::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:27,193::__init__::232::IOProcess::(_processLogs) (201672) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:27,201::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201672) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:27,202::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:27,203::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:27,204::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:27,204::__init__::232::IOProcess::(_processLogs) (201673) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:27,204::__init__::232::IOProcess::(_processLogs) (201673) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:27,205::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:27,206::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:27,206::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:27,207::__init__::232::IOProcess::(_processLogs) (201674) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:27,207::__init__::232::IOProcess::(_processLogs) (201674) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:27,208::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:27,209::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:27,209::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:27,209::__init__::232::IOProcess::(_processLogs) (201675) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:27,209::__init__::232::IOProcess::(_processLogs) (201675) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:27,210::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:27,211::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:27,212::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:27,212::__init__::232::IOProcess::(_processLogs) (201676) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:27,212::__init__::232::IOProcess::(_processLogs) (201676) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:27,213::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:27,214::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:27,215::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:27,215::__init__::232::IOProcess::(_processLogs) (201677) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:27,215::__init__::232::IOProcess::(_processLogs) (201677) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:27,216::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:27,216::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:27,217::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:27,218::__init__::232::IOProcess::(_processLogs) (201678) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:27,218::__init__::232::IOProcess::(_processLogs) (201678) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:29,091::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:29,095::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136824::DEBUG::2014-10-29 11:22:29,098::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:29,100::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:29,103::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136825::DEBUG::2014-10-29 11:22:29,107::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136825::DEBUG::2014-10-29 11:22:29,109::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:22:29,840::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54577 >Detector thread::DEBUG::2014-10-29 11:22:29,841::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54577 >Detector thread::DEBUG::2014-10-29 11:22:29,841::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54577 >Detector thread::DEBUG::2014-10-29 11:22:29,842::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54577) >Thread-136826::DEBUG::2014-10-29 11:22:29,884::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136826::DEBUG::2014-10-29 11:22:29,887::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ddb64f3-c4e3-46e4-8ed5-39d6ac504802`::moving from state init -> state preparing >Thread-136826::INFO::2014-10-29 11:22:29,888::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136826::DEBUG::2014-10-29 11:22:29,892::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:22:29,893::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:29,893::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:29,893::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:29,894::__init__::232::IOProcess::(_processLogs) (201679) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:22:29,895::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201679) Queuing response >Thread-136826::DEBUG::2014-10-29 11:22:29,895::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136826::DEBUG::2014-10-29 11:22:29,896::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136826::INFO::2014-10-29 11:22:29,897::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136826::DEBUG::2014-10-29 11:22:29,897::task::1191::Storage.TaskManager.Task::(prepare) Task=`9ddb64f3-c4e3-46e4-8ed5-39d6ac504802`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136826::DEBUG::2014-10-29 11:22:29,897::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ddb64f3-c4e3-46e4-8ed5-39d6ac504802`::moving from state preparing -> state finished >Thread-136826::DEBUG::2014-10-29 11:22:29,898::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136826::DEBUG::2014-10-29 11:22:29,898::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136826::DEBUG::2014-10-29 11:22:29,898::task::993::Storage.TaskManager.Task::(_decref) Task=`9ddb64f3-c4e3-46e4-8ed5-39d6ac504802`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:22:29,974::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54578 >Detector thread::DEBUG::2014-10-29 11:22:29,975::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54578 >Detector thread::DEBUG::2014-10-29 11:22:29,975::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54578 >Detector thread::DEBUG::2014-10-29 11:22:29,976::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54578) >Thread-136827::DEBUG::2014-10-29 11:22:30,014::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136827::DEBUG::2014-10-29 11:22:30,015::task::595::Storage.TaskManager.Task::(_updateState) Task=`b638991f-85dd-47e1-a25e-7452ce2ceb14`::moving from state init -> state preparing >Thread-136827::INFO::2014-10-29 11:22:30,016::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136827::DEBUG::2014-10-29 11:22:30,016::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136827::DEBUG::2014-10-29 11:22:30,016::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136827::DEBUG::2014-10-29 11:22:30,017::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136827::DEBUG::2014-10-29 11:22:30,017::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136827::DEBUG::2014-10-29 11:22:30,017::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136827::DEBUG::2014-10-29 11:22:30,018::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136827::DEBUG::2014-10-29 11:22:30,117::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136827::DEBUG::2014-10-29 11:22:30,118::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136827::DEBUG::2014-10-29 11:22:30,296::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136827::DEBUG::2014-10-29 11:22:30,297::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136827::DEBUG::2014-10-29 11:22:30,297::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136827::DEBUG::2014-10-29 11:22:30,297::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136827::DEBUG::2014-10-29 11:22:30,298::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136827::DEBUG::2014-10-29 11:22:30,298::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136827::DEBUG::2014-10-29 11:22:30,299::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136827::DEBUG::2014-10-29 11:22:30,299::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:22:30,305::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:30,305::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:30,305::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:30,305::__init__::232::IOProcess::(_processLogs) (201680) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:22:30,307::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:30,310::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:30,311::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:30,313::__init__::232::IOProcess::(_processLogs) (201681) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:22:30,313::__init__::232::IOProcess::(_processLogs) (201680) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:30,313::__init__::232::IOProcess::(_processLogs) (201681) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:30,314::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:30,316::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:30,320::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:30,323::__init__::232::IOProcess::(_processLogs) (201682) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:22:30,325::__init__::232::IOProcess::(_processLogs) (201682) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:30,328::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:30,329::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-136827::DEBUG::2014-10-29 11:22:30,330::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:22:30,333::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:30,334::__init__::232::IOProcess::(_processLogs) (201683) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:22:30,335::__init__::232::IOProcess::(_processLogs) (201683) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:30,335::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:30,336::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:30,336::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:30,336::__init__::232::IOProcess::(_processLogs) (201684) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:22:30,337::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201684) Queuing response >Detector thread::DEBUG::2014-10-29 11:22:30,340::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54579 >Detector thread::DEBUG::2014-10-29 11:22:30,340::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54579 >Detector thread::DEBUG::2014-10-29 11:22:30,341::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54579 >Detector thread::DEBUG::2014-10-29 11:22:30,341::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54579) >Thread-136827::DEBUG::2014-10-29 11:22:30,343::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:22:30,347::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:30,347::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:30,347::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:30,348::__init__::232::IOProcess::(_processLogs) (201685) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:22:30,348::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201685) Queuing response >Thread-136827::DEBUG::2014-10-29 11:22:30,349::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:22:30,350::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:30,351::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:30,352::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:30,353::__init__::232::IOProcess::(_processLogs) (201686) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:30,353::__init__::232::IOProcess::(_processLogs) (201686) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:30,353::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:30,354::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:30,354::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-136827::DEBUG::2014-10-29 11:22:30,354::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:22:30,356::__init__::232::IOProcess::(_processLogs) (201687) Got request for method 'glob' >Thread-136827::INFO::2014-10-29 11:22:30,356::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:22:30,357::__init__::232::IOProcess::(_processLogs) (201687) Queuing response >Thread-136827::INFO::2014-10-29 11:22:30,357::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136827::INFO::2014-10-29 11:22:30,359::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:22:30,359::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:30,360::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:30,360::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:30,360::__init__::232::IOProcess::(_processLogs) (201688) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:22:30,361::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201688) Queuing response >Thread-136827::DEBUG::2014-10-29 11:22:30,361::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136827::DEBUG::2014-10-29 11:22:30,364::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`aab0932f-9ece-419c-acfa-838dffee3b37`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136827::DEBUG::2014-10-29 11:22:30,364::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136827::DEBUG::2014-10-29 11:22:30,364::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136827::DEBUG::2014-10-29 11:22:30,365::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`aab0932f-9ece-419c-acfa-838dffee3b37`::Granted request >Thread-136827::DEBUG::2014-10-29 11:22:30,365::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b638991f-85dd-47e1-a25e-7452ce2ceb14`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136827::DEBUG::2014-10-29 11:22:30,366::task::993::Storage.TaskManager.Task::(_decref) Task=`b638991f-85dd-47e1-a25e-7452ce2ceb14`::ref 1 aborting False >Thread-136827::INFO::2014-10-29 11:22:30,368::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136827::DEBUG::2014-10-29 11:22:30,369::task::1191::Storage.TaskManager.Task::(prepare) Task=`b638991f-85dd-47e1-a25e-7452ce2ceb14`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136827::DEBUG::2014-10-29 11:22:30,369::task::595::Storage.TaskManager.Task::(_updateState) Task=`b638991f-85dd-47e1-a25e-7452ce2ceb14`::moving from state preparing -> state finished >Thread-136827::DEBUG::2014-10-29 11:22:30,369::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136827::DEBUG::2014-10-29 11:22:30,370::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136827::DEBUG::2014-10-29 11:22:30,370::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136827::DEBUG::2014-10-29 11:22:30,370::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136827::DEBUG::2014-10-29 11:22:30,370::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136827::DEBUG::2014-10-29 11:22:30,371::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136827::DEBUG::2014-10-29 11:22:30,371::task::993::Storage.TaskManager.Task::(_decref) Task=`b638991f-85dd-47e1-a25e-7452ce2ceb14`::ref 0 aborting False >Thread-136832::DEBUG::2014-10-29 11:22:30,381::task::595::Storage.TaskManager.Task::(_updateState) Task=`865c7f0d-cfb3-4d6b-a3e7-9a0bb517d2a3`::moving from state init -> state preparing >Thread-136832::INFO::2014-10-29 11:22:30,382::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136832::INFO::2014-10-29 11:22:30,382::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000740087', 'lastCheck': '3.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00237895', 'lastCheck': '3.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525438', 'lastCheck': '3.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00043475', 'lastCheck': '3.3', 'valid': True}} >Thread-136832::DEBUG::2014-10-29 11:22:30,383::task::1191::Storage.TaskManager.Task::(prepare) Task=`865c7f0d-cfb3-4d6b-a3e7-9a0bb517d2a3`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000740087', 'lastCheck': '3.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00237895', 'lastCheck': '3.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525438', 'lastCheck': '3.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00043475', 'lastCheck': '3.3', 'valid': True}} >Thread-136832::DEBUG::2014-10-29 11:22:30,383::task::595::Storage.TaskManager.Task::(_updateState) Task=`865c7f0d-cfb3-4d6b-a3e7-9a0bb517d2a3`::moving from state preparing -> state finished >Thread-136832::DEBUG::2014-10-29 11:22:30,383::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136832::DEBUG::2014-10-29 11:22:30,383::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136832::DEBUG::2014-10-29 11:22:30,384::task::993::Storage.TaskManager.Task::(_decref) Task=`865c7f0d-cfb3-4d6b-a3e7-9a0bb517d2a3`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:22:30,393::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54580 >Detector thread::DEBUG::2014-10-29 11:22:30,394::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54580 >Detector thread::DEBUG::2014-10-29 11:22:30,394::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54580 >Detector thread::DEBUG::2014-10-29 11:22:30,394::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54580) >Thread-136833::DEBUG::2014-10-29 11:22:30,433::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136833::DEBUG::2014-10-29 11:22:30,433::task::595::Storage.TaskManager.Task::(_updateState) Task=`1655c520-9d42-40d6-bf34-145c275ce136`::moving from state init -> state preparing >Thread-136833::INFO::2014-10-29 11:22:30,434::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136833::INFO::2014-10-29 11:22:30,434::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000740087', 'lastCheck': '3.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00237895', 'lastCheck': '3.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525438', 'lastCheck': '3.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00043475', 'lastCheck': '3.4', 'valid': True}} >Thread-136833::DEBUG::2014-10-29 11:22:30,435::task::1191::Storage.TaskManager.Task::(prepare) Task=`1655c520-9d42-40d6-bf34-145c275ce136`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000740087', 'lastCheck': '3.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00237895', 'lastCheck': '3.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525438', 'lastCheck': '3.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00043475', 'lastCheck': '3.4', 'valid': True}} >Thread-136833::DEBUG::2014-10-29 11:22:30,435::task::595::Storage.TaskManager.Task::(_updateState) Task=`1655c520-9d42-40d6-bf34-145c275ce136`::moving from state preparing -> state finished >Thread-136833::DEBUG::2014-10-29 11:22:30,435::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136833::DEBUG::2014-10-29 11:22:30,435::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136833::DEBUG::2014-10-29 11:22:30,436::task::993::Storage.TaskManager.Task::(_decref) Task=`1655c520-9d42-40d6-bf34-145c275ce136`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:22:30,835::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54581 >Detector thread::DEBUG::2014-10-29 11:22:30,835::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54581 >Detector thread::DEBUG::2014-10-29 11:22:30,836::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54581 >Detector thread::DEBUG::2014-10-29 11:22:30,836::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54581) >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:30,873::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:30,874::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136834::DEBUG::2014-10-29 11:22:30,875::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136834::DEBUG::2014-10-29 11:22:30,880::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:30,883::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136834::DEBUG::2014-10-29 11:22:30,885::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.74', 'elapsedTime': '514383', 'displayType': 'vnc', 'cpuSys': '0.66', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '8978749', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '58995', 'readRate': '0.00', 'truesize': '6010880000', 'writeRate': '30828.20'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.09', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:22:30,907::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54582 >Detector thread::DEBUG::2014-10-29 11:22:30,908::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54582 >Detector thread::DEBUG::2014-10-29 11:22:30,908::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54582 >Detector thread::DEBUG::2014-10-29 11:22:30,909::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54582) >Thread-136835::DEBUG::2014-10-29 11:22:30,949::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136835::DEBUG::2014-10-29 11:22:30,951::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136835::DEBUG::2014-10-29 11:22:30,971::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136835::DEBUG::2014-10-29 11:22:31,049::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '36', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '36', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:32,127::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:32,130::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136836::DEBUG::2014-10-29 11:22:32,133::task::595::Storage.TaskManager.Task::(_updateState) Task=`8709e28d-e451-450f-8048-c686415bb3e2`::moving from state init -> state preparing >Thread-136836::INFO::2014-10-29 11:22:32,134::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136836::INFO::2014-10-29 11:22:32,134::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000740087', 'lastCheck': '4.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00237895', 'lastCheck': '4.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525438', 'lastCheck': '5.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00043475', 'lastCheck': '5.1', 'valid': True}} >Thread-136836::DEBUG::2014-10-29 11:22:32,135::task::1191::Storage.TaskManager.Task::(prepare) Task=`8709e28d-e451-450f-8048-c686415bb3e2`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000740087', 'lastCheck': '4.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00237895', 'lastCheck': '4.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525438', 'lastCheck': '5.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00043475', 'lastCheck': '5.1', 'valid': True}} >Thread-136836::DEBUG::2014-10-29 11:22:32,135::task::595::Storage.TaskManager.Task::(_updateState) Task=`8709e28d-e451-450f-8048-c686415bb3e2`::moving from state preparing -> state finished >Thread-136836::DEBUG::2014-10-29 11:22:32,135::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136836::DEBUG::2014-10-29 11:22:32,136::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136836::DEBUG::2014-10-29 11:22:32,136::task::993::Storage.TaskManager.Task::(_decref) Task=`8709e28d-e451-450f-8048-c686415bb3e2`::ref 0 aborting False >Thread-136836::DEBUG::2014-10-29 11:22:32,157::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:32,179::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:32,181::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136837::DEBUG::2014-10-29 11:22:32,184::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136837::DEBUG::2014-10-29 11:22:32,186::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:22:34,356::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >Thread-22::DEBUG::2014-10-29 11:22:34,804::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:35,266::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:35,269::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136838::DEBUG::2014-10-29 11:22:35,273::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:35,275::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:35,277::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136839::DEBUG::2014-10-29 11:22:35,280::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136839::DEBUG::2014-10-29 11:22:35,282::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:35,894::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:35,896::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:35,897::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:22:36,880::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:36,881::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:36,882::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:36,882::__init__::232::IOProcess::(_processLogs) (201689) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:36,882::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201689) Queuing response >Thread-179::DEBUG::2014-10-29 11:22:36,884::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:22:36,902::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000998547 s, 373 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:22:36,904::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:36,904::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:36,905::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:36,905::__init__::232::IOProcess::(_processLogs) (201690) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:36,906::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201690) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:37,039::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:37,040::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:37,040::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:37,040::__init__::232::IOProcess::(_processLogs) (201691) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:37,041::__init__::232::IOProcess::(_processLogs) (201691) Queuing response >Thread-10269::DEBUG::2014-10-29 11:22:37,042::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:22:37,059::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000540473 s, 929 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:22:37,061::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:37,061::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:37,063::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:37,065::__init__::232::IOProcess::(_processLogs) (201692) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:37,065::__init__::232::IOProcess::(_processLogs) (201692) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:37,215::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:37,216::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:37,216::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:37,216::__init__::232::IOProcess::(_processLogs) (201693) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:37,218::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201693) Queuing response >Thread-33::DEBUG::2014-10-29 11:22:37,220::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:22:37,222::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:37,239::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-33::DEBUG::2014-10-29 11:22:37,241::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000414602 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:22:37,245::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:37,247::__init__::232::IOProcess::(_processLogs) (201694) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:22:37,247::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:22:37,248::__init__::232::IOProcess::(_processLogs) (201694) Queuing response >Thread-178::DEBUG::2014-10-29 11:22:37,270::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000669151 s, 759 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:22:37,270::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:37,273::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:37,279::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:37,283::__init__::232::IOProcess::(_processLogs) (201695) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:37,285::__init__::232::IOProcess::(_processLogs) (201695) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:37,292::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:37,294::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:37,296::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:37,296::__init__::232::IOProcess::(_processLogs) (201696) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:37,297::__init__::232::IOProcess::(_processLogs) (201696) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:37,297::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:37,298::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:37,299::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:37,299::__init__::232::IOProcess::(_processLogs) (201697) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:37,299::__init__::232::IOProcess::(_processLogs) (201697) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:37,300::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:37,300::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:37,301::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:37,302::__init__::232::IOProcess::(_processLogs) (201698) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:37,302::__init__::232::IOProcess::(_processLogs) (201698) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:37,302::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:37,302::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:37,304::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:37,304::__init__::232::IOProcess::(_processLogs) (201699) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:37,304::__init__::232::IOProcess::(_processLogs) (201699) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:37,305::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:37,305::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:37,305::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:37,305::__init__::232::IOProcess::(_processLogs) (201700) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:37,306::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201700) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:37,307::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:37,308::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:37,309::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:37,310::__init__::232::IOProcess::(_processLogs) (201701) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:37,310::__init__::232::IOProcess::(_processLogs) (201701) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:37,311::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:37,311::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:37,312::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:37,313::__init__::232::IOProcess::(_processLogs) (201702) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:37,314::__init__::232::IOProcess::(_processLogs) (201702) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:38,305::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:38,308::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136840::DEBUG::2014-10-29 11:22:38,311::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:38,313::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:38,315::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136841::DEBUG::2014-10-29 11:22:38,318::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136841::DEBUG::2014-10-29 11:22:38,320::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:22:40,450::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54584 >Detector thread::DEBUG::2014-10-29 11:22:40,451::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54584 >Detector thread::DEBUG::2014-10-29 11:22:40,451::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54584 >Detector thread::DEBUG::2014-10-29 11:22:40,452::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54584) >Thread-136842::DEBUG::2014-10-29 11:22:40,492::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba6c3ee8-d5d5-4c97-968f-c32b64b9044d`::moving from state init -> state preparing >Thread-136842::INFO::2014-10-29 11:22:40,492::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136842::INFO::2014-10-29 11:22:40,493::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669151', 'lastCheck': '3.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000414602', 'lastCheck': '3.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000998547', 'lastCheck': '3.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000540473', 'lastCheck': '3.4', 'valid': True}} >Thread-136842::DEBUG::2014-10-29 11:22:40,493::task::1191::Storage.TaskManager.Task::(prepare) Task=`ba6c3ee8-d5d5-4c97-968f-c32b64b9044d`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669151', 'lastCheck': '3.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000414602', 'lastCheck': '3.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000998547', 'lastCheck': '3.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000540473', 'lastCheck': '3.4', 'valid': True}} >Thread-136842::DEBUG::2014-10-29 11:22:40,494::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba6c3ee8-d5d5-4c97-968f-c32b64b9044d`::moving from state preparing -> state finished >Thread-136842::DEBUG::2014-10-29 11:22:40,494::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136842::DEBUG::2014-10-29 11:22:40,494::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136842::DEBUG::2014-10-29 11:22:40,495::task::993::Storage.TaskManager.Task::(_decref) Task=`ba6c3ee8-d5d5-4c97-968f-c32b64b9044d`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:40,905::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:40,907::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:40,909::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:22:41,021::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54586 >Detector thread::DEBUG::2014-10-29 11:22:41,022::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54586 >Detector thread::DEBUG::2014-10-29 11:22:41,022::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54586 >Detector thread::DEBUG::2014-10-29 11:22:41,023::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54586) >Detector thread::DEBUG::2014-10-29 11:22:41,050::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54587 >Detector thread::DEBUG::2014-10-29 11:22:41,050::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54587 >Detector thread::DEBUG::2014-10-29 11:22:41,051::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54587 >Detector thread::DEBUG::2014-10-29 11:22:41,051::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54587) >Thread-136843::DEBUG::2014-10-29 11:22:41,062::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136843::DEBUG::2014-10-29 11:22:41,062::task::595::Storage.TaskManager.Task::(_updateState) Task=`a80315d3-3805-4a84-8021-1534866570ec`::moving from state init -> state preparing >Thread-136843::INFO::2014-10-29 11:22:41,063::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136843::DEBUG::2014-10-29 11:22:41,069::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:22:41,073::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:41,073::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:41,073::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:41,073::__init__::232::IOProcess::(_processLogs) (201703) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:22:41,074::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201703) Queuing response >Thread-136843::DEBUG::2014-10-29 11:22:41,075::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136843::DEBUG::2014-10-29 11:22:41,075::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136843::INFO::2014-10-29 11:22:41,076::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136843::DEBUG::2014-10-29 11:22:41,076::task::1191::Storage.TaskManager.Task::(prepare) Task=`a80315d3-3805-4a84-8021-1534866570ec`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136843::DEBUG::2014-10-29 11:22:41,076::task::595::Storage.TaskManager.Task::(_updateState) Task=`a80315d3-3805-4a84-8021-1534866570ec`::moving from state preparing -> state finished >Thread-136843::DEBUG::2014-10-29 11:22:41,076::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136843::DEBUG::2014-10-29 11:22:41,077::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136843::DEBUG::2014-10-29 11:22:41,077::task::993::Storage.TaskManager.Task::(_decref) Task=`a80315d3-3805-4a84-8021-1534866570ec`::ref 0 aborting False >Thread-136844::DEBUG::2014-10-29 11:22:41,091::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136844::DEBUG::2014-10-29 11:22:41,092::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136844::DEBUG::2014-10-29 11:22:41,093::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.24', 'elapsedTime': '514393', 'displayType': 'vnc', 'cpuSys': '0.67', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '8978749', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '58995', 'readRate': '0.00', 'truesize': '6010880000', 'writeRate': '30828.20'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.29', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:22:41,099::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54588 >Detector thread::DEBUG::2014-10-29 11:22:41,100::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54588 >Detector thread::DEBUG::2014-10-29 11:22:41,100::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54588 >Detector thread::DEBUG::2014-10-29 11:22:41,101::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54588) >Thread-136845::DEBUG::2014-10-29 11:22:41,141::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Detector thread::DEBUG::2014-10-29 11:22:41,140::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54589 >Detector thread::DEBUG::2014-10-29 11:22:41,143::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54589 >Detector thread::DEBUG::2014-10-29 11:22:41,143::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54589 >Detector thread::DEBUG::2014-10-29 11:22:41,144::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54589) >Thread-136845::DEBUG::2014-10-29 11:22:41,150::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136845::DEBUG::2014-10-29 11:22:41,170::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136846::DEBUG::2014-10-29 11:22:41,183::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136846::DEBUG::2014-10-29 11:22:41,186::task::595::Storage.TaskManager.Task::(_updateState) Task=`623c0ddc-a16f-433d-9b95-60ac3cf9a927`::moving from state init -> state preparing >Thread-136846::INFO::2014-10-29 11:22:41,188::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136846::DEBUG::2014-10-29 11:22:41,190::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136846::DEBUG::2014-10-29 11:22:41,191::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136846::DEBUG::2014-10-29 11:22:41,192::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136846::DEBUG::2014-10-29 11:22:41,193::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136846::DEBUG::2014-10-29 11:22:41,195::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136846::DEBUG::2014-10-29 11:22:41,197::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136845::DEBUG::2014-10-29 11:22:41,250::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '16', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '16', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-136846::DEBUG::2014-10-29 11:22:41,281::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136846::DEBUG::2014-10-29 11:22:41,281::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:41,336::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:41,338::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136847::DEBUG::2014-10-29 11:22:41,342::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:41,345::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:41,347::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136848::DEBUG::2014-10-29 11:22:41,350::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136848::DEBUG::2014-10-29 11:22:41,353::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-136846::DEBUG::2014-10-29 11:22:41,500::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136846::DEBUG::2014-10-29 11:22:41,502::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136846::DEBUG::2014-10-29 11:22:41,503::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136846::DEBUG::2014-10-29 11:22:41,503::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136846::DEBUG::2014-10-29 11:22:41,503::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136846::DEBUG::2014-10-29 11:22:41,504::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136846::DEBUG::2014-10-29 11:22:41,504::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136846::DEBUG::2014-10-29 11:22:41,504::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:22:41,511::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:41,513::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:41,513::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:41,514::__init__::232::IOProcess::(_processLogs) (201704) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:22:41,515::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201704) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:41,516::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:41,516::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:41,517::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:41,517::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:41,517::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:41,518::__init__::232::IOProcess::(_processLogs) (201705) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:22:41,519::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201705) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:41,520::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:41,520::__init__::232::IOProcess::(_processLogs) (201706) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:22:41,520::__init__::232::IOProcess::(_processLogs) (201706) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:41,521::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:41,521::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:41,521::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:41,521::__init__::232::IOProcess::(_processLogs) (201707) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:22:41,522::__init__::232::IOProcess::(_processLogs) (201707) Queuing response >Thread-136846::DEBUG::2014-10-29 11:22:41,535::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:22:41,537::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:41,537::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:41,537::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:41,537::__init__::232::IOProcess::(_processLogs) (201708) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:22:41,538::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201708) Queuing response >Thread-136846::DEBUG::2014-10-29 11:22:41,539::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:22:41,540::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:41,540::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:41,540::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:41,540::__init__::232::IOProcess::(_processLogs) (201709) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:22:41,541::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201709) Queuing response >Thread-136846::DEBUG::2014-10-29 11:22:41,542::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:22:41,544::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:41,544::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:41,544::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:41,544::__init__::232::IOProcess::(_processLogs) (201710) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:41,545::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201710) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:41,546::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:41,546::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:41,547::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:41,547::__init__::232::IOProcess::(_processLogs) (201711) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:22:41,548::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201711) Queuing response >Thread-136846::DEBUG::2014-10-29 11:22:41,548::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-136846::INFO::2014-10-29 11:22:41,549::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136846::INFO::2014-10-29 11:22:41,549::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136846::INFO::2014-10-29 11:22:41,550::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:22:41,550::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:41,551::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:41,551::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:41,551::__init__::232::IOProcess::(_processLogs) (201712) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:22:41,552::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201712) Queuing response >Thread-136846::DEBUG::2014-10-29 11:22:41,552::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136846::DEBUG::2014-10-29 11:22:41,555::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`1f99a64a-66d3-4ed4-ae85-69b99a034493`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136846::DEBUG::2014-10-29 11:22:41,555::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136846::DEBUG::2014-10-29 11:22:41,555::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136846::DEBUG::2014-10-29 11:22:41,556::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`1f99a64a-66d3-4ed4-ae85-69b99a034493`::Granted request >Thread-136846::DEBUG::2014-10-29 11:22:41,556::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`623c0ddc-a16f-433d-9b95-60ac3cf9a927`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136846::DEBUG::2014-10-29 11:22:41,556::task::993::Storage.TaskManager.Task::(_decref) Task=`623c0ddc-a16f-433d-9b95-60ac3cf9a927`::ref 1 aborting False >Thread-136846::INFO::2014-10-29 11:22:41,559::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136846::DEBUG::2014-10-29 11:22:41,559::task::1191::Storage.TaskManager.Task::(prepare) Task=`623c0ddc-a16f-433d-9b95-60ac3cf9a927`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136846::DEBUG::2014-10-29 11:22:41,560::task::595::Storage.TaskManager.Task::(_updateState) Task=`623c0ddc-a16f-433d-9b95-60ac3cf9a927`::moving from state preparing -> state finished >Thread-136846::DEBUG::2014-10-29 11:22:41,560::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136846::DEBUG::2014-10-29 11:22:41,560::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136846::DEBUG::2014-10-29 11:22:41,561::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136846::DEBUG::2014-10-29 11:22:41,561::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136846::DEBUG::2014-10-29 11:22:41,561::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136846::DEBUG::2014-10-29 11:22:41,561::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136846::DEBUG::2014-10-29 11:22:41,562::task::993::Storage.TaskManager.Task::(_decref) Task=`623c0ddc-a16f-433d-9b95-60ac3cf9a927`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:22:41,590::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54591 >Detector thread::DEBUG::2014-10-29 11:22:41,590::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54591 >Detector thread::DEBUG::2014-10-29 11:22:41,591::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54591 >Detector thread::DEBUG::2014-10-29 11:22:41,591::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54591) >Thread-136853::DEBUG::2014-10-29 11:22:41,630::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136853::DEBUG::2014-10-29 11:22:41,631::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d0d30ba-8e15-46d3-a77e-6575b373691e`::moving from state init -> state preparing >Thread-136853::INFO::2014-10-29 11:22:41,631::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136853::INFO::2014-10-29 11:22:41,632::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669151', 'lastCheck': '4.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000414602', 'lastCheck': '4.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000998547', 'lastCheck': '4.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000540473', 'lastCheck': '4.6', 'valid': True}} >Thread-136853::DEBUG::2014-10-29 11:22:41,632::task::1191::Storage.TaskManager.Task::(prepare) Task=`1d0d30ba-8e15-46d3-a77e-6575b373691e`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669151', 'lastCheck': '4.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000414602', 'lastCheck': '4.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000998547', 'lastCheck': '4.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000540473', 'lastCheck': '4.6', 'valid': True}} >Thread-136853::DEBUG::2014-10-29 11:22:41,632::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d0d30ba-8e15-46d3-a77e-6575b373691e`::moving from state preparing -> state finished >Thread-136853::DEBUG::2014-10-29 11:22:41,632::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136853::DEBUG::2014-10-29 11:22:41,633::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136853::DEBUG::2014-10-29 11:22:41,633::task::993::Storage.TaskManager.Task::(_decref) Task=`1d0d30ba-8e15-46d3-a77e-6575b373691e`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:44,367::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:44,369::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136854::DEBUG::2014-10-29 11:22:44,372::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:44,375::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:44,377::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136855::DEBUG::2014-10-29 11:22:44,380::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136855::DEBUG::2014-10-29 11:22:44,383::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:45,916::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:45,918::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:45,920::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:22:46,912::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:46,914::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:46,916::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:46,917::__init__::232::IOProcess::(_processLogs) (201713) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:46,922::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201713) Queuing response >Thread-179::DEBUG::2014-10-29 11:22:46,924::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:22:46,958::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.0156996 s, 23.7 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:22:46,963::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:46,965::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:46,971::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:46,973::__init__::232::IOProcess::(_processLogs) (201714) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:46,976::__init__::232::IOProcess::(_processLogs) (201714) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:47,066::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:47,066::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:47,067::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:47,067::__init__::232::IOProcess::(_processLogs) (201715) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:47,068::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201715) Queuing response >Thread-10269::DEBUG::2014-10-29 11:22:47,070::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:22:47,085::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000514659 s, 975 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:22:47,087::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:47,088::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:47,088::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:47,088::__init__::232::IOProcess::(_processLogs) (201716) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:47,090::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201716) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:47,311::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:47,311::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:47,312::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:47,312::__init__::232::IOProcess::(_processLogs) (201717) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:47,313::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201717) Queuing response >Thread-33::DEBUG::2014-10-29 11:22:47,315::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:22:47,333::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-33::DEBUG::2014-10-29 11:22:47,336::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000533499 s, 913 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:22:47,336::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:47,338::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:47,339::__init__::232::IOProcess::(_processLogs) (201718) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:47,341::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201718) Queuing response >Thread-178::DEBUG::2014-10-29 11:22:47,342::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:22:47,343::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:47,361::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-178::DEBUG::2014-10-29 11:22:47,365::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000439144 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:22:47,366::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:47,371::__init__::232::IOProcess::(_processLogs) (201719) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:47,379::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201719) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:47,383::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:47,385::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:47,387::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:47,389::__init__::232::IOProcess::(_processLogs) (201720) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:47,396::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201720) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:47,397::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:47,397::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:47,398::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:47,399::__init__::232::IOProcess::(_processLogs) (201721) Got request for method 'access' >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:47,399::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-17::DEBUG::2014-10-29 11:22:47,401::__init__::232::IOProcess::(_processLogs) (201721) Queuing response >JsonRpcServer::DEBUG::2014-10-29 11:22:47,406::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:22:47,409::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:47,412::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:47,414::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:47,415::__init__::232::IOProcess::(_processLogs) (201722) Got request for method 'access' >Thread-136856::DEBUG::2014-10-29 11:22:47,418::task::595::Storage.TaskManager.Task::(_updateState) Task=`650d6aff-ba58-42b4-afb8-72bb98618399`::moving from state init -> state preparing >Thread-17::DEBUG::2014-10-29 11:22:47,420::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201722) Queuing response >Thread-136856::INFO::2014-10-29 11:22:47,422::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-17::DEBUG::2014-10-29 11:22:47,424::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-136856::INFO::2014-10-29 11:22:47,425::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669151', 'lastCheck': '10.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000414602', 'lastCheck': '10.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0156996', 'lastCheck': '0.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000514659', 'lastCheck': '0.3', 'valid': True}} >Thread-17::DEBUG::2014-10-29 11:22:47,425::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-136856::DEBUG::2014-10-29 11:22:47,427::task::1191::Storage.TaskManager.Task::(prepare) Task=`650d6aff-ba58-42b4-afb8-72bb98618399`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669151', 'lastCheck': '10.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000414602', 'lastCheck': '10.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0156996', 'lastCheck': '0.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000514659', 'lastCheck': '0.3', 'valid': True}} >Thread-17::DEBUG::2014-10-29 11:22:47,427::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-136856::DEBUG::2014-10-29 11:22:47,428::task::595::Storage.TaskManager.Task::(_updateState) Task=`650d6aff-ba58-42b4-afb8-72bb98618399`::moving from state preparing -> state finished >Thread-17::DEBUG::2014-10-29 11:22:47,428::__init__::232::IOProcess::(_processLogs) (201723) Got request for method 'access' >Thread-136856::DEBUG::2014-10-29 11:22:47,429::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17::DEBUG::2014-10-29 11:22:47,430::__init__::232::IOProcess::(_processLogs) (201723) Queuing response >Thread-136856::DEBUG::2014-10-29 11:22:47,430::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136856::DEBUG::2014-10-29 11:22:47,432::task::993::Storage.TaskManager.Task::(_decref) Task=`650d6aff-ba58-42b4-afb8-72bb98618399`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:22:47,436::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:47,438::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:47,440::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:47,442::__init__::232::IOProcess::(_processLogs) (201724) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:47,444::__init__::232::IOProcess::(_processLogs) (201724) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:47,445::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:47,445::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:47,445::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:47,445::__init__::232::IOProcess::(_processLogs) (201725) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:47,446::__init__::232::IOProcess::(_processLogs) (201725) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:47,446::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:47,447::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:47,447::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:47,447::__init__::232::IOProcess::(_processLogs) (201726) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:47,447::__init__::232::IOProcess::(_processLogs) (201726) Queuing response >Thread-136856::DEBUG::2014-10-29 11:22:47,487::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:47,509::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:47,511::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136857::DEBUG::2014-10-29 11:22:47,514::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136857::DEBUG::2014-10-29 11:22:47,516::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:22:49,808::task::595::Storage.TaskManager.Task::(_updateState) Task=`66847e95-eb52-4063-8923-580594501df4`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:22:49,808::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:22:49,809::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:49,809::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:49,809::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:49,810::__init__::232::IOProcess::(_processLogs) (201727) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:22:49,810::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201727) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:49,812::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:49,814::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-22::INFO::2014-10-29 11:22:49,814::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010888192', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:22:49,815::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-22::DEBUG::2014-10-29 11:22:49,816::task::1191::Storage.TaskManager.Task::(prepare) Task=`66847e95-eb52-4063-8923-580594501df4`::finished: {'truesize': '6010888192', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:22:49,817::__init__::232::IOProcess::(_processLogs) (201728) Got request for method 'stat' >Thread-22::DEBUG::2014-10-29 11:22:49,817::task::595::Storage.TaskManager.Task::(_updateState) Task=`66847e95-eb52-4063-8923-580594501df4`::moving from state preparing -> state finished >Thread-17::DEBUG::2014-10-29 11:22:49,818::__init__::232::IOProcess::(_processLogs) (201728) Queuing response >Thread-22::DEBUG::2014-10-29 11:22:49,819::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-10-29 11:22:49,819::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2014-10-29 11:22:49,819::task::993::Storage.TaskManager.Task::(_decref) Task=`66847e95-eb52-4063-8923-580594501df4`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:22:49,887::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Detector thread::DEBUG::2014-10-29 11:22:50,304::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54592 >Detector thread::DEBUG::2014-10-29 11:22:50,304::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54592 >Detector thread::DEBUG::2014-10-29 11:22:50,305::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54592 >Detector thread::DEBUG::2014-10-29 11:22:50,305::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54592) >Detector thread::DEBUG::2014-10-29 11:22:50,322::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54593 >Detector thread::DEBUG::2014-10-29 11:22:50,322::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54593 >Detector thread::DEBUG::2014-10-29 11:22:50,323::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54593 >Detector thread::DEBUG::2014-10-29 11:22:50,323::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54593) >Thread-136858::DEBUG::2014-10-29 11:22:50,344::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136858::DEBUG::2014-10-29 11:22:50,346::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136859::DEBUG::2014-10-29 11:22:50,363::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136858::DEBUG::2014-10-29 11:22:50,366::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136859::DEBUG::2014-10-29 11:22:50,368::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136859::DEBUG::2014-10-29 11:22:50,373::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.48', 'elapsedTime': '514402', 'displayType': 'vnc', 'cpuSys': '0.80', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '5744023', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '60327', 'readRate': '0.00', 'truesize': '6010888192', 'writeRate': '36402.23'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.56', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-136858::DEBUG::2014-10-29 11:22:50,441::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '97', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '97', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:22:50,557::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54595 >Detector thread::DEBUG::2014-10-29 11:22:50,557::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54595 >Detector thread::DEBUG::2014-10-29 11:22:50,558::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54595 >Detector thread::DEBUG::2014-10-29 11:22:50,558::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54595) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:50,577::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:50,579::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136861::DEBUG::2014-10-29 11:22:50,582::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:50,584::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:50,588::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136862::DEBUG::2014-10-29 11:22:50,591::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136862::DEBUG::2014-10-29 11:22:50,593::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-136860::DEBUG::2014-10-29 11:22:50,598::task::595::Storage.TaskManager.Task::(_updateState) Task=`968b7ed2-377c-4298-87bf-c340c2359e82`::moving from state init -> state preparing >Thread-136860::INFO::2014-10-29 11:22:50,598::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136860::INFO::2014-10-29 11:22:50,599::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000439144', 'lastCheck': '3.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533499', 'lastCheck': '3.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0156996', 'lastCheck': '3.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000514659', 'lastCheck': '3.5', 'valid': True}} >Thread-136860::DEBUG::2014-10-29 11:22:50,599::task::1191::Storage.TaskManager.Task::(prepare) Task=`968b7ed2-377c-4298-87bf-c340c2359e82`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000439144', 'lastCheck': '3.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533499', 'lastCheck': '3.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0156996', 'lastCheck': '3.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000514659', 'lastCheck': '3.5', 'valid': True}} >Thread-136860::DEBUG::2014-10-29 11:22:50,599::task::595::Storage.TaskManager.Task::(_updateState) Task=`968b7ed2-377c-4298-87bf-c340c2359e82`::moving from state preparing -> state finished >Thread-136860::DEBUG::2014-10-29 11:22:50,599::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136860::DEBUG::2014-10-29 11:22:50,600::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136860::DEBUG::2014-10-29 11:22:50,600::task::993::Storage.TaskManager.Task::(_decref) Task=`968b7ed2-377c-4298-87bf-c340c2359e82`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:50,927::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:50,928::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:50,929::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:22:52,192::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54597 >Detector thread::DEBUG::2014-10-29 11:22:52,193::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54597 >Detector thread::DEBUG::2014-10-29 11:22:52,193::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54597 >Detector thread::DEBUG::2014-10-29 11:22:52,194::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54597) >Thread-136863::DEBUG::2014-10-29 11:22:52,232::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136863::DEBUG::2014-10-29 11:22:52,233::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd4a5796-b247-4db2-8d9f-634c81bad175`::moving from state init -> state preparing >Thread-136863::INFO::2014-10-29 11:22:52,234::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136863::DEBUG::2014-10-29 11:22:52,237::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:22:52,237::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:52,238::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:52,238::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:52,238::__init__::232::IOProcess::(_processLogs) (201729) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:22:52,240::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201729) Queuing response >Thread-136863::DEBUG::2014-10-29 11:22:52,241::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136863::DEBUG::2014-10-29 11:22:52,241::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136863::INFO::2014-10-29 11:22:52,242::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136863::DEBUG::2014-10-29 11:22:52,242::task::1191::Storage.TaskManager.Task::(prepare) Task=`fd4a5796-b247-4db2-8d9f-634c81bad175`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136863::DEBUG::2014-10-29 11:22:52,242::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd4a5796-b247-4db2-8d9f-634c81bad175`::moving from state preparing -> state finished >Thread-136863::DEBUG::2014-10-29 11:22:52,243::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136863::DEBUG::2014-10-29 11:22:52,243::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136863::DEBUG::2014-10-29 11:22:52,243::task::993::Storage.TaskManager.Task::(_decref) Task=`fd4a5796-b247-4db2-8d9f-634c81bad175`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:22:52,297::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54598 >Detector thread::DEBUG::2014-10-29 11:22:52,297::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54598 >Detector thread::DEBUG::2014-10-29 11:22:52,298::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54598 >Detector thread::DEBUG::2014-10-29 11:22:52,298::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54598) >Thread-136864::DEBUG::2014-10-29 11:22:52,337::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136864::DEBUG::2014-10-29 11:22:52,337::task::595::Storage.TaskManager.Task::(_updateState) Task=`3faa4dbb-9e1b-4221-aa67-95f53c4e0fc0`::moving from state init -> state preparing >Thread-136864::INFO::2014-10-29 11:22:52,338::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136864::DEBUG::2014-10-29 11:22:52,338::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136864::DEBUG::2014-10-29 11:22:52,338::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136864::DEBUG::2014-10-29 11:22:52,339::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136864::DEBUG::2014-10-29 11:22:52,339::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136864::DEBUG::2014-10-29 11:22:52,339::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136864::DEBUG::2014-10-29 11:22:52,340::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136864::DEBUG::2014-10-29 11:22:52,432::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136864::DEBUG::2014-10-29 11:22:52,433::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136864::DEBUG::2014-10-29 11:22:52,620::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136864::DEBUG::2014-10-29 11:22:52,621::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136864::DEBUG::2014-10-29 11:22:52,621::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136864::DEBUG::2014-10-29 11:22:52,621::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136864::DEBUG::2014-10-29 11:22:52,622::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136864::DEBUG::2014-10-29 11:22:52,622::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136864::DEBUG::2014-10-29 11:22:52,623::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136864::DEBUG::2014-10-29 11:22:52,623::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:22:52,629::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:52,632::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:52,632::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:52,633::__init__::232::IOProcess::(_processLogs) (201730) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:22:52,634::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201730) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:52,635::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:52,635::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:52,636::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:52,636::__init__::232::IOProcess::(_processLogs) (201731) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:22:52,637::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201731) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:52,637::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:52,637::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:52,638::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:52,639::__init__::232::IOProcess::(_processLogs) (201732) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:22:52,644::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201732) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:52,648::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:52,650::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-136864::DEBUG::2014-10-29 11:22:52,650::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:22:52,652::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:52,653::__init__::232::IOProcess::(_processLogs) (201733) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:22:52,654::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201733) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:52,655::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:52,655::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:52,656::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:52,656::__init__::232::IOProcess::(_processLogs) (201734) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:22:52,657::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201734) Queuing response >Thread-136864::DEBUG::2014-10-29 11:22:52,657::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:22:52,659::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:52,659::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:52,660::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:52,660::__init__::232::IOProcess::(_processLogs) (201735) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:22:52,661::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201735) Queuing response >Thread-136864::DEBUG::2014-10-29 11:22:52,662::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:22:52,663::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:52,664::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:52,664::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:52,665::__init__::232::IOProcess::(_processLogs) (201736) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:52,665::__init__::232::IOProcess::(_processLogs) (201736) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:52,665::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:52,666::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:52,666::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:52,666::__init__::232::IOProcess::(_processLogs) (201737) Got request for method 'glob' >Thread-136864::DEBUG::2014-10-29 11:22:52,667::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:22:52,667::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201737) Queuing response >Thread-136864::INFO::2014-10-29 11:22:52,668::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136864::INFO::2014-10-29 11:22:52,669::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136864::INFO::2014-10-29 11:22:52,669::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:22:52,670::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:52,670::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:52,671::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:52,671::__init__::232::IOProcess::(_processLogs) (201738) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:22:52,672::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201738) Queuing response >Thread-136864::DEBUG::2014-10-29 11:22:52,672::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136864::DEBUG::2014-10-29 11:22:52,674::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`e083c01b-0bdb-446c-bf91-ce4646357c8c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136864::DEBUG::2014-10-29 11:22:52,675::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136864::DEBUG::2014-10-29 11:22:52,675::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136864::DEBUG::2014-10-29 11:22:52,675::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`e083c01b-0bdb-446c-bf91-ce4646357c8c`::Granted request >Thread-136864::DEBUG::2014-10-29 11:22:52,676::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3faa4dbb-9e1b-4221-aa67-95f53c4e0fc0`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136864::DEBUG::2014-10-29 11:22:52,676::task::993::Storage.TaskManager.Task::(_decref) Task=`3faa4dbb-9e1b-4221-aa67-95f53c4e0fc0`::ref 1 aborting False >Thread-136864::INFO::2014-10-29 11:22:52,679::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136864::DEBUG::2014-10-29 11:22:52,679::task::1191::Storage.TaskManager.Task::(prepare) Task=`3faa4dbb-9e1b-4221-aa67-95f53c4e0fc0`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136864::DEBUG::2014-10-29 11:22:52,679::task::595::Storage.TaskManager.Task::(_updateState) Task=`3faa4dbb-9e1b-4221-aa67-95f53c4e0fc0`::moving from state preparing -> state finished >Thread-136864::DEBUG::2014-10-29 11:22:52,680::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136864::DEBUG::2014-10-29 11:22:52,680::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136864::DEBUG::2014-10-29 11:22:52,680::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136864::DEBUG::2014-10-29 11:22:52,681::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136864::DEBUG::2014-10-29 11:22:52,681::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136864::DEBUG::2014-10-29 11:22:52,681::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136864::DEBUG::2014-10-29 11:22:52,682::task::993::Storage.TaskManager.Task::(_decref) Task=`3faa4dbb-9e1b-4221-aa67-95f53c4e0fc0`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:22:52,703::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54599 >Detector thread::DEBUG::2014-10-29 11:22:52,704::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54599 >Detector thread::DEBUG::2014-10-29 11:22:52,704::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54599 >Detector thread::DEBUG::2014-10-29 11:22:52,705::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54599) >Thread-136869::DEBUG::2014-10-29 11:22:52,744::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136869::DEBUG::2014-10-29 11:22:52,744::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd0eef47-12ab-4979-9f6c-efa2512ed2b3`::moving from state init -> state preparing >Thread-136869::INFO::2014-10-29 11:22:52,745::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136869::INFO::2014-10-29 11:22:52,745::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000439144', 'lastCheck': '5.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533499', 'lastCheck': '5.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0156996', 'lastCheck': '5.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000514659', 'lastCheck': '5.7', 'valid': True}} >Thread-136869::DEBUG::2014-10-29 11:22:52,746::task::1191::Storage.TaskManager.Task::(prepare) Task=`bd0eef47-12ab-4979-9f6c-efa2512ed2b3`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000439144', 'lastCheck': '5.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533499', 'lastCheck': '5.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0156996', 'lastCheck': '5.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000514659', 'lastCheck': '5.7', 'valid': True}} >Thread-136869::DEBUG::2014-10-29 11:22:52,746::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd0eef47-12ab-4979-9f6c-efa2512ed2b3`::moving from state preparing -> state finished >Thread-136869::DEBUG::2014-10-29 11:22:52,746::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136869::DEBUG::2014-10-29 11:22:52,746::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136869::DEBUG::2014-10-29 11:22:52,747::task::993::Storage.TaskManager.Task::(_decref) Task=`bd0eef47-12ab-4979-9f6c-efa2512ed2b3`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:53,619::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:53,622::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136870::DEBUG::2014-10-29 11:22:53,625::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:53,628::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:53,630::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136871::DEBUG::2014-10-29 11:22:53,633::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136871::DEBUG::2014-10-29 11:22:53,635::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:55,937::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:55,938::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:22:55,941::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:56,648::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:56,651::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136872::DEBUG::2014-10-29 11:22:56,654::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:56,657::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:56,658::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136873::DEBUG::2014-10-29 11:22:56,661::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136873::DEBUG::2014-10-29 11:22:56,664::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:22:56,976::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:56,978::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:56,979::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-179::DEBUG::2014-10-29 11:22:56,979::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:22:56,981::__init__::232::IOProcess::(_processLogs) (201739) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:56,997::__init__::232::IOProcess::(_processLogs) (201739) Queuing response >Thread-179::DEBUG::2014-10-29 11:22:56,998::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00108499 s, 343 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:22:57,000::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:57,000::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:57,000::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:57,000::__init__::232::IOProcess::(_processLogs) (201740) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:57,002::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201740) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:57,092::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:57,093::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:57,093::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:57,093::__init__::232::IOProcess::(_processLogs) (201741) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:57,095::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201741) Queuing response >Thread-10269::DEBUG::2014-10-29 11:22:57,097::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:22:57,113::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000506893 s, 990 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:22:57,115::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:57,116::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:57,116::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:57,116::__init__::232::IOProcess::(_processLogs) (201742) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:57,118::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201742) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:57,471::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:57,471::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:57,471::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:57,472::__init__::232::IOProcess::(_processLogs) (201743) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:57,472::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:57,472::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:57,472::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:57,473::__init__::232::IOProcess::(_processLogs) (201744) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:57,474::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201743) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:57,475::__init__::232::IOProcess::(_processLogs) (201744) Queuing response >Thread-33::DEBUG::2014-10-29 11:22:57,476::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:22:57,496::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:22:57,497::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000731199 s, 666 kB/s\n'; <rc> = 0 >Thread-178::DEBUG::2014-10-29 11:22:57,518::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000577561 s, 880 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:22:57,519::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:57,521::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:57,521::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:57,523::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201745) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:57,524::__init__::232::IOProcess::(_processLogs) (201745) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:57,526::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:57,526::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:57,527::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:57,527::__init__::232::IOProcess::(_processLogs) (201746) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:22:57,527::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:57,527::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:57,528::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:57,528::__init__::232::IOProcess::(_processLogs) (201747) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:57,528::__init__::232::IOProcess::(_processLogs) (201747) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:57,528::__init__::232::IOProcess::(_processLogs) (201746) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:57,531::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:57,532::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:57,533::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:57,533::__init__::232::IOProcess::(_processLogs) (201748) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:57,534::__init__::232::IOProcess::(_processLogs) (201748) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:57,534::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:57,534::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:57,535::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:57,536::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201749) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:57,537::__init__::232::IOProcess::(_processLogs) (201749) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:57,537::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:57,538::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:57,538::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:57,539::__init__::232::IOProcess::(_processLogs) (201750) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:57,540::__init__::232::IOProcess::(_processLogs) (201750) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:57,540::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:57,541::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:57,541::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:57,541::__init__::232::IOProcess::(_processLogs) (201751) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:57,541::__init__::232::IOProcess::(_processLogs) (201751) Queuing response >Thread-17::DEBUG::2014-10-29 11:22:57,543::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:22:57,544::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:22:57,544::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:22:57,545::__init__::232::IOProcess::(_processLogs) (201752) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:22:57,546::__init__::232::IOProcess::(_processLogs) (201752) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:59,677::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:59,680::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136874::DEBUG::2014-10-29 11:22:59,683::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:22:59,685::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:22:59,687::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136875::DEBUG::2014-10-29 11:22:59,690::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136875::DEBUG::2014-10-29 11:22:59,693::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:23:00,496::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54600 >Detector thread::DEBUG::2014-10-29 11:23:00,497::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54600 >Detector thread::DEBUG::2014-10-29 11:23:00,497::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54600 >Detector thread::DEBUG::2014-10-29 11:23:00,498::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54600) >Thread-136876::DEBUG::2014-10-29 11:23:00,536::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136876::DEBUG::2014-10-29 11:23:00,538::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136876::DEBUG::2014-10-29 11:23:00,557::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Detector thread::DEBUG::2014-10-29 11:23:00,561::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54601 >Detector thread::DEBUG::2014-10-29 11:23:00,564::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54601 >Detector thread::DEBUG::2014-10-29 11:23:00,566::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54601 >Detector thread::DEBUG::2014-10-29 11:23:00,569::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54601) >Thread-136877::DEBUG::2014-10-29 11:23:00,617::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136877::DEBUG::2014-10-29 11:23:00,622::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136876::DEBUG::2014-10-29 11:23:00,625::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '79', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '79', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-136877::DEBUG::2014-10-29 11:23:00,627::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.48', 'elapsedTime': '514413', 'displayType': 'vnc', 'cpuSys': '0.80', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '5744023', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '60327', 'readRate': '0.00', 'truesize': '6010888192', 'writeRate': '36402.23'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.73', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:23:00,656::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54602 >Detector thread::DEBUG::2014-10-29 11:23:00,663::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54602 >Detector thread::DEBUG::2014-10-29 11:23:00,664::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54602 >Detector thread::DEBUG::2014-10-29 11:23:00,665::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54602) >Thread-136878::DEBUG::2014-10-29 11:23:00,704::task::595::Storage.TaskManager.Task::(_updateState) Task=`5e363df1-e5e7-4ab4-86be-5a159871a34d`::moving from state init -> state preparing >Thread-136878::INFO::2014-10-29 11:23:00,705::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136878::INFO::2014-10-29 11:23:00,705::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000577561', 'lastCheck': '3.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731199', 'lastCheck': '3.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108499', 'lastCheck': '3.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000506893', 'lastCheck': '3.6', 'valid': True}} >Thread-136878::DEBUG::2014-10-29 11:23:00,706::task::1191::Storage.TaskManager.Task::(prepare) Task=`5e363df1-e5e7-4ab4-86be-5a159871a34d`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000577561', 'lastCheck': '3.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731199', 'lastCheck': '3.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108499', 'lastCheck': '3.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000506893', 'lastCheck': '3.6', 'valid': True}} >Thread-136878::DEBUG::2014-10-29 11:23:00,706::task::595::Storage.TaskManager.Task::(_updateState) Task=`5e363df1-e5e7-4ab4-86be-5a159871a34d`::moving from state preparing -> state finished >Thread-136878::DEBUG::2014-10-29 11:23:00,706::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136878::DEBUG::2014-10-29 11:23:00,706::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136878::DEBUG::2014-10-29 11:23:00,707::task::993::Storage.TaskManager.Task::(_decref) Task=`5e363df1-e5e7-4ab4-86be-5a159871a34d`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:00,948::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:00,949::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:00,950::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:02,721::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:02,723::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136879::DEBUG::2014-10-29 11:23:02,727::task::595::Storage.TaskManager.Task::(_updateState) Task=`de553e9f-eefe-497b-86f6-27402555af2d`::moving from state init -> state preparing >Thread-136879::INFO::2014-10-29 11:23:02,727::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136879::INFO::2014-10-29 11:23:02,728::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000577561', 'lastCheck': '5.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731199', 'lastCheck': '5.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108499', 'lastCheck': '5.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000506893', 'lastCheck': '5.6', 'valid': True}} >Thread-136879::DEBUG::2014-10-29 11:23:02,728::task::1191::Storage.TaskManager.Task::(prepare) Task=`de553e9f-eefe-497b-86f6-27402555af2d`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000577561', 'lastCheck': '5.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731199', 'lastCheck': '5.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108499', 'lastCheck': '5.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000506893', 'lastCheck': '5.6', 'valid': True}} >Thread-136879::DEBUG::2014-10-29 11:23:02,729::task::595::Storage.TaskManager.Task::(_updateState) Task=`de553e9f-eefe-497b-86f6-27402555af2d`::moving from state preparing -> state finished >Thread-136879::DEBUG::2014-10-29 11:23:02,729::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136879::DEBUG::2014-10-29 11:23:02,729::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136879::DEBUG::2014-10-29 11:23:02,729::task::993::Storage.TaskManager.Task::(_decref) Task=`de553e9f-eefe-497b-86f6-27402555af2d`::ref 0 aborting False >Thread-136879::DEBUG::2014-10-29 11:23:02,763::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:02,793::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:02,795::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136880::DEBUG::2014-10-29 11:23:02,798::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136880::DEBUG::2014-10-29 11:23:02,800::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:23:03,315::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54605 >Detector thread::DEBUG::2014-10-29 11:23:03,317::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54605 >Detector thread::DEBUG::2014-10-29 11:23:03,317::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54605 >Detector thread::DEBUG::2014-10-29 11:23:03,318::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54605) >Thread-136881::DEBUG::2014-10-29 11:23:03,356::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136881::DEBUG::2014-10-29 11:23:03,356::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c8c2de5-6e03-401a-aaae-8d9aa5420ddb`::moving from state init -> state preparing >Thread-136881::INFO::2014-10-29 11:23:03,357::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136881::DEBUG::2014-10-29 11:23:03,361::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:23:03,362::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:03,362::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:03,362::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:03,362::__init__::232::IOProcess::(_processLogs) (201753) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:03,363::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201753) Queuing response >Thread-136881::DEBUG::2014-10-29 11:23:03,364::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136881::DEBUG::2014-10-29 11:23:03,365::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136881::INFO::2014-10-29 11:23:03,365::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136881::DEBUG::2014-10-29 11:23:03,365::task::1191::Storage.TaskManager.Task::(prepare) Task=`9c8c2de5-6e03-401a-aaae-8d9aa5420ddb`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136881::DEBUG::2014-10-29 11:23:03,365::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c8c2de5-6e03-401a-aaae-8d9aa5420ddb`::moving from state preparing -> state finished >Thread-136881::DEBUG::2014-10-29 11:23:03,366::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136881::DEBUG::2014-10-29 11:23:03,366::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136881::DEBUG::2014-10-29 11:23:03,366::task::993::Storage.TaskManager.Task::(_decref) Task=`9c8c2de5-6e03-401a-aaae-8d9aa5420ddb`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:23:03,410::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54606 >Detector thread::DEBUG::2014-10-29 11:23:03,410::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54606 >Detector thread::DEBUG::2014-10-29 11:23:03,411::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54606 >Detector thread::DEBUG::2014-10-29 11:23:03,411::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54606) >Thread-136882::DEBUG::2014-10-29 11:23:03,451::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136882::DEBUG::2014-10-29 11:23:03,453::task::595::Storage.TaskManager.Task::(_updateState) Task=`a65d8848-45eb-4b0a-8f42-0e5baf8dcb20`::moving from state init -> state preparing >Thread-136882::INFO::2014-10-29 11:23:03,455::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136882::DEBUG::2014-10-29 11:23:03,457::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136882::DEBUG::2014-10-29 11:23:03,458::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136882::DEBUG::2014-10-29 11:23:03,459::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136882::DEBUG::2014-10-29 11:23:03,461::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136882::DEBUG::2014-10-29 11:23:03,462::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136882::DEBUG::2014-10-29 11:23:03,465::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136882::DEBUG::2014-10-29 11:23:03,561::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136882::DEBUG::2014-10-29 11:23:03,563::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136882::DEBUG::2014-10-29 11:23:03,744::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136882::DEBUG::2014-10-29 11:23:03,745::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136882::DEBUG::2014-10-29 11:23:03,745::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136882::DEBUG::2014-10-29 11:23:03,746::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136882::DEBUG::2014-10-29 11:23:03,746::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136882::DEBUG::2014-10-29 11:23:03,746::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136882::DEBUG::2014-10-29 11:23:03,747::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136882::DEBUG::2014-10-29 11:23:03,747::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:23:03,755::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:03,757::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:03,758::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:03,758::__init__::232::IOProcess::(_processLogs) (201754) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:03,759::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201754) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:03,760::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:03,760::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:03,761::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:03,761::__init__::232::IOProcess::(_processLogs) (201755) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:03,761::__init__::232::IOProcess::(_processLogs) (201755) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:03,763::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:03,764::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:03,764::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:03,764::__init__::232::IOProcess::(_processLogs) (201756) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:03,765::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201756) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:03,766::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:03,766::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:03,767::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:03,767::__init__::232::IOProcess::(_processLogs) (201757) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:03,768::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201757) Queuing response >Thread-136882::DEBUG::2014-10-29 11:23:03,780::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:23:03,781::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:03,781::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:03,781::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:03,781::__init__::232::IOProcess::(_processLogs) (201758) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:23:03,783::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201758) Queuing response >Thread-136882::DEBUG::2014-10-29 11:23:03,783::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:23:03,784::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:03,785::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:03,785::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:03,785::__init__::232::IOProcess::(_processLogs) (201759) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:23:03,786::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201759) Queuing response >Thread-136882::DEBUG::2014-10-29 11:23:03,786::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:23:03,788::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:03,789::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:03,789::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:03,790::__init__::232::IOProcess::(_processLogs) (201760) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:03,790::__init__::232::IOProcess::(_processLogs) (201760) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:03,791::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:03,791::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-136882::DEBUG::2014-10-29 11:23:03,792::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:23:03,792::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-136882::INFO::2014-10-29 11:23:03,793::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:23:03,794::__init__::232::IOProcess::(_processLogs) (201761) Got request for method 'glob' >Thread-136882::INFO::2014-10-29 11:23:03,794::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:23:03,795::__init__::232::IOProcess::(_processLogs) (201761) Queuing response >Thread-136882::INFO::2014-10-29 11:23:03,796::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:23:03,797::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:03,797::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:03,798::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:03,798::__init__::232::IOProcess::(_processLogs) (201762) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:23:03,799::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201762) Queuing response >Thread-136882::DEBUG::2014-10-29 11:23:03,799::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136882::DEBUG::2014-10-29 11:23:03,802::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`1070936a-f064-4c39-92b4-ca76c99e4974`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136882::DEBUG::2014-10-29 11:23:03,802::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136882::DEBUG::2014-10-29 11:23:03,802::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136882::DEBUG::2014-10-29 11:23:03,803::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`1070936a-f064-4c39-92b4-ca76c99e4974`::Granted request >Thread-136882::DEBUG::2014-10-29 11:23:03,804::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a65d8848-45eb-4b0a-8f42-0e5baf8dcb20`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136882::DEBUG::2014-10-29 11:23:03,804::task::993::Storage.TaskManager.Task::(_decref) Task=`a65d8848-45eb-4b0a-8f42-0e5baf8dcb20`::ref 1 aborting False >Thread-136882::INFO::2014-10-29 11:23:03,807::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136882::DEBUG::2014-10-29 11:23:03,807::task::1191::Storage.TaskManager.Task::(prepare) Task=`a65d8848-45eb-4b0a-8f42-0e5baf8dcb20`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136882::DEBUG::2014-10-29 11:23:03,808::task::595::Storage.TaskManager.Task::(_updateState) Task=`a65d8848-45eb-4b0a-8f42-0e5baf8dcb20`::moving from state preparing -> state finished >Thread-136882::DEBUG::2014-10-29 11:23:03,808::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136882::DEBUG::2014-10-29 11:23:03,808::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136882::DEBUG::2014-10-29 11:23:03,809::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136882::DEBUG::2014-10-29 11:23:03,809::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136882::DEBUG::2014-10-29 11:23:03,809::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136882::DEBUG::2014-10-29 11:23:03,809::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136882::DEBUG::2014-10-29 11:23:03,810::task::993::Storage.TaskManager.Task::(_decref) Task=`a65d8848-45eb-4b0a-8f42-0e5baf8dcb20`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:23:03,838::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54607 >Detector thread::DEBUG::2014-10-29 11:23:03,839::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54607 >Detector thread::DEBUG::2014-10-29 11:23:03,839::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54607 >Detector thread::DEBUG::2014-10-29 11:23:03,840::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54607) >Thread-136887::DEBUG::2014-10-29 11:23:03,879::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136887::DEBUG::2014-10-29 11:23:03,880::task::595::Storage.TaskManager.Task::(_updateState) Task=`928ef55f-2039-4d0a-a4c0-d465401ff272`::moving from state init -> state preparing >Thread-136887::INFO::2014-10-29 11:23:03,880::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136887::INFO::2014-10-29 11:23:03,881::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000577561', 'lastCheck': '6.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731199', 'lastCheck': '6.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108499', 'lastCheck': '6.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000506893', 'lastCheck': '6.8', 'valid': True}} >Thread-136887::DEBUG::2014-10-29 11:23:03,881::task::1191::Storage.TaskManager.Task::(prepare) Task=`928ef55f-2039-4d0a-a4c0-d465401ff272`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000577561', 'lastCheck': '6.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731199', 'lastCheck': '6.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108499', 'lastCheck': '6.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000506893', 'lastCheck': '6.8', 'valid': True}} >Thread-136887::DEBUG::2014-10-29 11:23:03,881::task::595::Storage.TaskManager.Task::(_updateState) Task=`928ef55f-2039-4d0a-a4c0-d465401ff272`::moving from state preparing -> state finished >Thread-136887::DEBUG::2014-10-29 11:23:03,881::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136887::DEBUG::2014-10-29 11:23:03,882::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136887::DEBUG::2014-10-29 11:23:03,882::task::993::Storage.TaskManager.Task::(_decref) Task=`928ef55f-2039-4d0a-a4c0-d465401ff272`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-10-29 11:23:04,388::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >Thread-22::DEBUG::2014-10-29 11:23:04,910::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:05,877::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:05,880::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136888::DEBUG::2014-10-29 11:23:05,884::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:05,886::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:05,888::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136889::DEBUG::2014-10-29 11:23:05,891::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136889::DEBUG::2014-10-29 11:23:05,894::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:05,956::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:05,957::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:05,961::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:23:07,017::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:07,019::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:07,020::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-179::DEBUG::2014-10-29 11:23:07,021::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:23:07,022::__init__::232::IOProcess::(_processLogs) (201763) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:07,037::__init__::232::IOProcess::(_processLogs) (201763) Queuing response >Thread-179::DEBUG::2014-10-29 11:23:07,039::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000450644 s, 825 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:23:07,040::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:07,041::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:07,041::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:07,041::__init__::232::IOProcess::(_processLogs) (201764) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:07,043::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201764) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:07,121::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:07,121::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:07,121::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:07,122::__init__::232::IOProcess::(_processLogs) (201765) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:07,123::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201765) Queuing response >Thread-10269::DEBUG::2014-10-29 11:23:07,125::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:23:07,144::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000425795 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:23:07,145::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:07,146::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:07,146::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:07,146::__init__::232::IOProcess::(_processLogs) (201766) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:07,148::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201766) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:07,541::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:07,542::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:07,543::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:07,544::__init__::232::IOProcess::(_processLogs) (201767) Got request for method 'statvfs' >Thread-33::DEBUG::2014-10-29 11:23:07,545::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:23:07,546::__init__::232::IOProcess::(_processLogs) (201767) Queuing response >Thread-178::DEBUG::2014-10-29 11:23:07,564::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 9b5dff8d-f9a0-4e5c-8800-3a988fc12016 >Thread-33::DEBUG::2014-10-29 11:23:07,568::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000569416 s, 855 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:23:07,573::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:07,576::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:07,579::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:07,579::__init__::232::IOProcess::(_processLogs) (201768) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:07,581::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201768) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:07,583::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:07,583::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:07,583::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:07,584::__init__::232::IOProcess::(_processLogs) (201769) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:07,584::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201769) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:07,586::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:07,588::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:07,589::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:07,591::__init__::232::IOProcess::(_processLogs) (201770) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:07,595::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201770) Queuing response >Thread-178::DEBUG::2014-10-29 11:23:07,598::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016 >Thread-17::DEBUG::2014-10-29 11:23:07,599::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:07,600::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:07,600::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:07,601::__init__::232::IOProcess::(_processLogs) (201771) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:07,602::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201771) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:07,603::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:07,604::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:07,605::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:07,605::__init__::232::IOProcess::(_processLogs) (201772) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:07,605::__init__::232::IOProcess::(_processLogs) (201772) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:07,606::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:07,607::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:07,607::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:07,607::__init__::232::IOProcess::(_processLogs) (201773) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:07,608::__init__::232::IOProcess::(_processLogs) (201773) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:07,608::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:07,608::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:07,609::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:07,609::__init__::232::IOProcess::(_processLogs) (201774) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:23:07,609::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:07,610::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:07,610::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:07,611::__init__::232::IOProcess::(_processLogs) (201775) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:07,611::__init__::232::IOProcess::(_processLogs) (201775) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:07,612::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:07,612::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:07,612::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:07,613::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201776) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:07,614::__init__::232::IOProcess::(_processLogs) (201776) Queuing response >Thread-178::DEBUG::2014-10-29 11:23:07,685::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:23:07,685::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201774) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:07,687::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:07,687::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:07,687::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:07,688::__init__::232::IOProcess::(_processLogs) (201777) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:23:07,689::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201777) Queuing response >Thread-178::DEBUG::2014-10-29 11:23:07,689::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nsednev_ovirt_3_5_HE_for_disks', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=Default', 'POOL_DOMAINS=9b5dff8d-f9a0-4e5c-8800-3a988fc12016:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=00000002-0002-0002-0002-000000000321', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_ovirt_3_5_HE_for_disks', 'ROLE=Master', 'SDUUID=9b5dff8d-f9a0-4e5c-8800-3a988fc12016', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=08256ef27d308c4f5bfe4a0974fd548f7d749489'] >Thread-17::DEBUG::2014-10-29 11:23:07,691::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:07,691::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:07,692::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:07,693::__init__::232::IOProcess::(_processLogs) (201778) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:07,693::__init__::232::IOProcess::(_processLogs) (201778) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:07,693::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:07,694::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:07,694::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:07,694::__init__::232::IOProcess::(_processLogs) (201779) Got request for method 'glob' >Thread-178::DEBUG::2014-10-29 11:23:07,695::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:23:07,695::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201779) Queuing response >Thread-178::INFO::2014-10-29 11:23:07,696::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9b5dff8d-f9a0-4e5c-8800-3a988fc12016_imageNS already registered >Thread-178::INFO::2014-10-29 11:23:07,697::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9b5dff8d-f9a0-4e5c-8800-3a988fc12016_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:23:07,698::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:07,698::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:07,699::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:07,700::__init__::232::IOProcess::(_processLogs) (201780) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:23:07,701::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:23:07,701::__init__::232::IOProcess::(_processLogs) (201780) Queuing response >Thread-178::DEBUG::2014-10-29 11:23:07,720::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000530351 s, 958 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:23:07,721::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:07,722::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:07,722::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:07,722::__init__::232::IOProcess::(_processLogs) (201781) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:07,723::__init__::232::IOProcess::(_processLogs) (201781) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:07,725::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:07,726::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:07,727::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:07,727::__init__::232::IOProcess::(_processLogs) (201782) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:07,727::__init__::232::IOProcess::(_processLogs) (201782) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:07,728::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:07,729::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:07,729::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:07,729::__init__::232::IOProcess::(_processLogs) (201783) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:07,730::__init__::232::IOProcess::(_processLogs) (201783) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:07,730::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:07,731::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:07,731::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:07,733::__init__::232::IOProcess::(_processLogs) (201784) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:07,733::__init__::232::IOProcess::(_processLogs) (201784) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:08,912::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:08,915::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136894::DEBUG::2014-10-29 11:23:08,918::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:08,920::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:08,922::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136895::DEBUG::2014-10-29 11:23:08,925::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136895::DEBUG::2014-10-29 11:23:08,928::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:23:10,713::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54608 >Detector thread::DEBUG::2014-10-29 11:23:10,714::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54608 >Detector thread::DEBUG::2014-10-29 11:23:10,714::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54608 >Detector thread::DEBUG::2014-10-29 11:23:10,715::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54608) >Thread-136896::DEBUG::2014-10-29 11:23:10,753::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136896::DEBUG::2014-10-29 11:23:10,755::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136896::DEBUG::2014-10-29 11:23:10,775::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Detector thread::DEBUG::2014-10-29 11:23:10,785::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54609 >Detector thread::DEBUG::2014-10-29 11:23:10,786::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54609 >Detector thread::DEBUG::2014-10-29 11:23:10,786::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54609 >Detector thread::DEBUG::2014-10-29 11:23:10,787::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54609) >Detector thread::DEBUG::2014-10-29 11:23:10,806::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54610 >Detector thread::DEBUG::2014-10-29 11:23:10,809::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54610 >Detector thread::DEBUG::2014-10-29 11:23:10,811::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54610 >Detector thread::DEBUG::2014-10-29 11:23:10,813::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54610) >Thread-136897::DEBUG::2014-10-29 11:23:10,832::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd48e841-4d6b-4f4a-bcd3-54064b8077fd`::moving from state init -> state preparing >Thread-136897::INFO::2014-10-29 11:23:10,834::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136897::INFO::2014-10-29 11:23:10,839::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000530351', 'lastCheck': '3.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569416', 'lastCheck': '3.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000450644', 'lastCheck': '3.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000425795', 'lastCheck': '3.7', 'valid': True}} >Thread-136897::DEBUG::2014-10-29 11:23:10,840::task::1191::Storage.TaskManager.Task::(prepare) Task=`dd48e841-4d6b-4f4a-bcd3-54064b8077fd`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000530351', 'lastCheck': '3.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569416', 'lastCheck': '3.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000450644', 'lastCheck': '3.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000425795', 'lastCheck': '3.7', 'valid': True}} >Thread-136897::DEBUG::2014-10-29 11:23:10,842::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd48e841-4d6b-4f4a-bcd3-54064b8077fd`::moving from state preparing -> state finished >Thread-136897::DEBUG::2014-10-29 11:23:10,844::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136898::DEBUG::2014-10-29 11:23:10,849::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136897::DEBUG::2014-10-29 11:23:10,850::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136897::DEBUG::2014-10-29 11:23:10,854::task::993::Storage.TaskManager.Task::(_decref) Task=`dd48e841-4d6b-4f4a-bcd3-54064b8077fd`::ref 0 aborting False >Thread-136898::DEBUG::2014-10-29 11:23:10,856::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136898::DEBUG::2014-10-29 11:23:10,880::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.60', 'elapsedTime': '514423', 'displayType': 'vnc', 'cpuSys': '0.46', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '5744023', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '60327', 'readRate': '0.00', 'truesize': '6010888192', 'writeRate': '36402.23'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.94', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-136896::DEBUG::2014-10-29 11:23:10,892::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '56', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '56', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:10,968::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:10,969::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:10,970::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:11,944::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:11,946::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136899::DEBUG::2014-10-29 11:23:11,950::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:11,952::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:11,954::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136900::DEBUG::2014-10-29 11:23:11,957::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136900::DEBUG::2014-10-29 11:23:11,959::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:23:14,444::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54613 >Detector thread::DEBUG::2014-10-29 11:23:14,445::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54613 >Detector thread::DEBUG::2014-10-29 11:23:14,445::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54613 >Detector thread::DEBUG::2014-10-29 11:23:14,446::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54613) >Thread-136901::DEBUG::2014-10-29 11:23:14,485::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136901::DEBUG::2014-10-29 11:23:14,488::task::595::Storage.TaskManager.Task::(_updateState) Task=`31134e47-210f-42a2-9b85-5f6eb8631064`::moving from state init -> state preparing >Thread-136901::INFO::2014-10-29 11:23:14,488::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136901::DEBUG::2014-10-29 11:23:14,491::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:23:14,492::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:14,492::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:14,492::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:14,493::__init__::232::IOProcess::(_processLogs) (201785) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:14,494::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201785) Queuing response >Thread-136901::DEBUG::2014-10-29 11:23:14,495::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136901::DEBUG::2014-10-29 11:23:14,495::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136901::INFO::2014-10-29 11:23:14,496::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136901::DEBUG::2014-10-29 11:23:14,496::task::1191::Storage.TaskManager.Task::(prepare) Task=`31134e47-210f-42a2-9b85-5f6eb8631064`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136901::DEBUG::2014-10-29 11:23:14,496::task::595::Storage.TaskManager.Task::(_updateState) Task=`31134e47-210f-42a2-9b85-5f6eb8631064`::moving from state preparing -> state finished >Thread-136901::DEBUG::2014-10-29 11:23:14,496::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136901::DEBUG::2014-10-29 11:23:14,497::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136901::DEBUG::2014-10-29 11:23:14,497::task::993::Storage.TaskManager.Task::(_decref) Task=`31134e47-210f-42a2-9b85-5f6eb8631064`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:23:14,540::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54614 >Detector thread::DEBUG::2014-10-29 11:23:14,541::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54614 >Detector thread::DEBUG::2014-10-29 11:23:14,541::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54614 >Detector thread::DEBUG::2014-10-29 11:23:14,542::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54614) >Thread-136902::DEBUG::2014-10-29 11:23:14,581::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136902::DEBUG::2014-10-29 11:23:14,582::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea0f5d86-0ec4-41e6-b7b5-7b95747c9d92`::moving from state init -> state preparing >Thread-136902::INFO::2014-10-29 11:23:14,582::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136902::DEBUG::2014-10-29 11:23:14,582::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136902::DEBUG::2014-10-29 11:23:14,583::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136902::DEBUG::2014-10-29 11:23:14,583::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136902::DEBUG::2014-10-29 11:23:14,583::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136902::DEBUG::2014-10-29 11:23:14,583::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136902::DEBUG::2014-10-29 11:23:14,584::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136902::DEBUG::2014-10-29 11:23:14,667::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136902::DEBUG::2014-10-29 11:23:14,668::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136902::DEBUG::2014-10-29 11:23:14,848::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136902::DEBUG::2014-10-29 11:23:14,849::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136902::DEBUG::2014-10-29 11:23:14,850::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136902::DEBUG::2014-10-29 11:23:14,850::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136902::DEBUG::2014-10-29 11:23:14,850::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136902::DEBUG::2014-10-29 11:23:14,851::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136902::DEBUG::2014-10-29 11:23:14,851::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136902::DEBUG::2014-10-29 11:23:14,852::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:23:14,857::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:14,861::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:14,861::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:14,863::__init__::232::IOProcess::(_processLogs) (201786) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:14,865::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201786) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:14,866::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:14,867::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:14,867::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:14,869::__init__::232::IOProcess::(_processLogs) (201787) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:14,872::__init__::232::IOProcess::(_processLogs) (201787) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:14,874::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:14,876::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:14,878::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:14,880::__init__::232::IOProcess::(_processLogs) (201788) Got request for method 'glob' >Thread-136902::DEBUG::2014-10-29 11:23:14,881::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:23:14,884::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201788) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:14,885::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:14,885::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:14,886::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:14,887::__init__::232::IOProcess::(_processLogs) (201789) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:14,887::__init__::232::IOProcess::(_processLogs) (201789) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:14,887::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:14,888::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:14,888::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:14,888::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201790) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:23:14,889::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201790) Queuing response >Thread-136902::DEBUG::2014-10-29 11:23:14,890::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:23:14,891::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:14,892::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:14,892::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:14,892::__init__::232::IOProcess::(_processLogs) (201791) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:23:14,893::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201791) Queuing response >Thread-136902::DEBUG::2014-10-29 11:23:14,894::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:23:14,895::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:14,896::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:14,896::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:14,897::__init__::232::IOProcess::(_processLogs) (201792) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:14,897::__init__::232::IOProcess::(_processLogs) (201792) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:14,898::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:14,898::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-136902::DEBUG::2014-10-29 11:23:14,899::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-136902::INFO::2014-10-29 11:23:14,899::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136902::INFO::2014-10-29 11:23:14,900::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136902::INFO::2014-10-29 11:23:14,900::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:23:14,899::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:14,901::__init__::232::IOProcess::(_processLogs) (201793) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:14,901::__init__::232::IOProcess::(_processLogs) (201793) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:14,901::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:14,902::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:14,902::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:14,902::__init__::232::IOProcess::(_processLogs) (201794) Got request for method 'readfile' >Thread-136902::DEBUG::2014-10-29 11:23:14,903::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:23:14,903::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201794) Queuing response >Thread-136902::DEBUG::2014-10-29 11:23:14,906::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`0a0fb054-e478-4fa6-8dfe-a51f774a9dc2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136902::DEBUG::2014-10-29 11:23:14,907::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136902::DEBUG::2014-10-29 11:23:14,907::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136902::DEBUG::2014-10-29 11:23:14,907::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`0a0fb054-e478-4fa6-8dfe-a51f774a9dc2`::Granted request >Thread-136902::DEBUG::2014-10-29 11:23:14,908::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ea0f5d86-0ec4-41e6-b7b5-7b95747c9d92`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136902::DEBUG::2014-10-29 11:23:14,908::task::993::Storage.TaskManager.Task::(_decref) Task=`ea0f5d86-0ec4-41e6-b7b5-7b95747c9d92`::ref 1 aborting False >Thread-136902::INFO::2014-10-29 11:23:14,911::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136902::DEBUG::2014-10-29 11:23:14,912::task::1191::Storage.TaskManager.Task::(prepare) Task=`ea0f5d86-0ec4-41e6-b7b5-7b95747c9d92`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136902::DEBUG::2014-10-29 11:23:14,912::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea0f5d86-0ec4-41e6-b7b5-7b95747c9d92`::moving from state preparing -> state finished >Thread-136902::DEBUG::2014-10-29 11:23:14,912::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136902::DEBUG::2014-10-29 11:23:14,912::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136902::DEBUG::2014-10-29 11:23:14,913::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136902::DEBUG::2014-10-29 11:23:14,913::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136902::DEBUG::2014-10-29 11:23:14,913::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136902::DEBUG::2014-10-29 11:23:14,914::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136902::DEBUG::2014-10-29 11:23:14,914::task::993::Storage.TaskManager.Task::(_decref) Task=`ea0f5d86-0ec4-41e6-b7b5-7b95747c9d92`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:23:14,936::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54615 >Detector thread::DEBUG::2014-10-29 11:23:14,937::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54615 >Detector thread::DEBUG::2014-10-29 11:23:14,937::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54615 >Detector thread::DEBUG::2014-10-29 11:23:14,938::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54615) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:14,974::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-136907::DEBUG::2014-10-29 11:23:14,977::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >JsonRpcServer::DEBUG::2014-10-29 11:23:14,979::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136907::DEBUG::2014-10-29 11:23:14,983::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f0cb5d0-119b-4431-b979-5c93e1b6fb0b`::moving from state init -> state preparing >Thread-136907::INFO::2014-10-29 11:23:14,985::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136907::INFO::2014-10-29 11:23:14,989::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000530351', 'lastCheck': '7.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569416', 'lastCheck': '7.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000450644', 'lastCheck': '7.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000425795', 'lastCheck': '7.8', 'valid': True}} >Thread-136908::DEBUG::2014-10-29 11:23:14,991::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-136907::DEBUG::2014-10-29 11:23:14,992::task::1191::Storage.TaskManager.Task::(prepare) Task=`3f0cb5d0-119b-4431-b979-5c93e1b6fb0b`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000530351', 'lastCheck': '7.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569416', 'lastCheck': '7.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000450644', 'lastCheck': '7.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000425795', 'lastCheck': '7.8', 'valid': True}} >Thread-136907::DEBUG::2014-10-29 11:23:14,994::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f0cb5d0-119b-4431-b979-5c93e1b6fb0b`::moving from state preparing -> state finished >Thread-136907::DEBUG::2014-10-29 11:23:14,995::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136907::DEBUG::2014-10-29 11:23:14,996::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136907::DEBUG::2014-10-29 11:23:14,996::task::993::Storage.TaskManager.Task::(_decref) Task=`3f0cb5d0-119b-4431-b979-5c93e1b6fb0b`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:14,998::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:15,003::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136909::DEBUG::2014-10-29 11:23:15,008::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136909::DEBUG::2014-10-29 11:23:15,011::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:15,978::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:15,980::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:15,981::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:23:17,050::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:17,051::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:17,055::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-179::DEBUG::2014-10-29 11:23:17,057::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:23:17,057::__init__::232::IOProcess::(_processLogs) (201795) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:17,073::__init__::232::IOProcess::(_processLogs) (201795) Queuing response >Thread-179::DEBUG::2014-10-29 11:23:17,075::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00063254 s, 588 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:23:17,076::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:17,077::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:17,077::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:17,077::__init__::232::IOProcess::(_processLogs) (201796) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:17,077::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201796) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:17,151::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:17,151::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:17,151::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:17,152::__init__::232::IOProcess::(_processLogs) (201797) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:17,153::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201797) Queuing response >Thread-10269::DEBUG::2014-10-29 11:23:17,153::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:23:17,170::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000523674 s, 959 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:23:17,172::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:17,173::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:17,173::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:17,173::__init__::232::IOProcess::(_processLogs) (201798) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:17,175::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201798) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:17,615::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:17,616::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:17,616::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:17,616::__init__::232::IOProcess::(_processLogs) (201799) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:17,618::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201799) Queuing response >Thread-33::DEBUG::2014-10-29 11:23:17,619::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:23:17,636::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00064232 s, 758 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:23:17,638::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:17,638::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:17,638::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:17,639::__init__::232::IOProcess::(_processLogs) (201800) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:17,640::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201800) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:17,642::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:17,643::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:17,643::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:17,643::__init__::232::IOProcess::(_processLogs) (201801) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:17,644::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201801) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:17,645::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:17,645::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:17,646::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:17,647::__init__::232::IOProcess::(_processLogs) (201802) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:17,647::__init__::232::IOProcess::(_processLogs) (201802) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:17,648::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:17,648::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:17,648::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:17,649::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201803) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:17,650::__init__::232::IOProcess::(_processLogs) (201803) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:17,734::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:17,734::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:17,735::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:17,737::__init__::232::IOProcess::(_processLogs) (201804) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:23:17,737::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:23:17,738::__init__::232::IOProcess::(_processLogs) (201804) Queuing response >Thread-178::DEBUG::2014-10-29 11:23:17,756::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000430118 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:23:17,757::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:17,758::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:17,758::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:17,758::__init__::232::IOProcess::(_processLogs) (201805) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:17,760::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201805) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:17,762::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:17,762::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:17,763::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:17,763::__init__::232::IOProcess::(_processLogs) (201806) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:17,764::__init__::232::IOProcess::(_processLogs) (201806) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:17,764::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:17,764::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:17,765::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:17,766::__init__::232::IOProcess::(_processLogs) (201807) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:17,766::__init__::232::IOProcess::(_processLogs) (201807) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:17,767::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:17,767::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:17,768::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:17,768::__init__::232::IOProcess::(_processLogs) (201808) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:17,770::__init__::232::IOProcess::(_processLogs) (201808) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:18,024::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:18,026::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136910::DEBUG::2014-10-29 11:23:18,030::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf96f238-ee63-4efa-8798-81f101de0ba2`::moving from state init -> state preparing >Thread-136910::INFO::2014-10-29 11:23:18,031::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136910::INFO::2014-10-29 11:23:18,031::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430118', 'lastCheck': '0.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00064232', 'lastCheck': '0.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063254', 'lastCheck': '0.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000523674', 'lastCheck': '0.9', 'valid': True}} >Thread-136910::DEBUG::2014-10-29 11:23:18,032::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf96f238-ee63-4efa-8798-81f101de0ba2`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430118', 'lastCheck': '0.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00064232', 'lastCheck': '0.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063254', 'lastCheck': '0.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000523674', 'lastCheck': '0.9', 'valid': True}} >Thread-136910::DEBUG::2014-10-29 11:23:18,032::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf96f238-ee63-4efa-8798-81f101de0ba2`::moving from state preparing -> state finished >Thread-136910::DEBUG::2014-10-29 11:23:18,032::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136910::DEBUG::2014-10-29 11:23:18,033::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136910::DEBUG::2014-10-29 11:23:18,033::task::993::Storage.TaskManager.Task::(_decref) Task=`cf96f238-ee63-4efa-8798-81f101de0ba2`::ref 0 aborting False >Thread-136910::DEBUG::2014-10-29 11:23:18,056::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:18,079::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:18,082::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136911::DEBUG::2014-10-29 11:23:18,085::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136911::DEBUG::2014-10-29 11:23:18,087::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:23:19,933::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Detector thread::DEBUG::2014-10-29 11:23:20,958::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54616 >Detector thread::DEBUG::2014-10-29 11:23:20,959::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54616 >Detector thread::DEBUG::2014-10-29 11:23:20,960::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54616 >Detector thread::DEBUG::2014-10-29 11:23:20,960::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54616) >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:20,989::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:20,990::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:23:20,991::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54617 >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:20,994::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:23:20,995::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54617 >Detector thread::DEBUG::2014-10-29 11:23:20,995::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54617 >Detector thread::DEBUG::2014-10-29 11:23:20,996::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54617) >Thread-136912::DEBUG::2014-10-29 11:23:20,999::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136912::DEBUG::2014-10-29 11:23:21,002::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136912::DEBUG::2014-10-29 11:23:21,021::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136913::DEBUG::2014-10-29 11:23:21,052::task::595::Storage.TaskManager.Task::(_updateState) Task=`0df4ecc4-a6ae-407f-86cd-750f43803b5b`::moving from state init -> state preparing >Thread-136913::INFO::2014-10-29 11:23:21,055::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136913::INFO::2014-10-29 11:23:21,060::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430118', 'lastCheck': '3.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00064232', 'lastCheck': '3.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063254', 'lastCheck': '4.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000523674', 'lastCheck': '3.9', 'valid': True}} >Thread-136913::DEBUG::2014-10-29 11:23:21,062::task::1191::Storage.TaskManager.Task::(prepare) Task=`0df4ecc4-a6ae-407f-86cd-750f43803b5b`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430118', 'lastCheck': '3.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00064232', 'lastCheck': '3.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063254', 'lastCheck': '4.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000523674', 'lastCheck': '3.9', 'valid': True}} >Thread-136913::DEBUG::2014-10-29 11:23:21,064::task::595::Storage.TaskManager.Task::(_updateState) Task=`0df4ecc4-a6ae-407f-86cd-750f43803b5b`::moving from state preparing -> state finished >Thread-136913::DEBUG::2014-10-29 11:23:21,065::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136913::DEBUG::2014-10-29 11:23:21,067::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136913::DEBUG::2014-10-29 11:23:21,070::task::993::Storage.TaskManager.Task::(_decref) Task=`0df4ecc4-a6ae-407f-86cd-750f43803b5b`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:23:21,092::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54618 >Detector thread::DEBUG::2014-10-29 11:23:21,098::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54618 >Detector thread::DEBUG::2014-10-29 11:23:21,101::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54618 >Detector thread::DEBUG::2014-10-29 11:23:21,105::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54618) >Thread-136912::DEBUG::2014-10-29 11:23:21,108::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '34', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '34', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-136914::DEBUG::2014-10-29 11:23:21,129::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136914::DEBUG::2014-10-29 11:23:21,130::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136914::DEBUG::2014-10-29 11:23:21,131::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.54', 'elapsedTime': '514433', 'displayType': 'vnc', 'cpuSys': '0.60', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '5744023', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '60327', 'readRate': '0.00', 'truesize': '6010888192', 'writeRate': '36402.23'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.22', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:21,137::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:21,139::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136915::DEBUG::2014-10-29 11:23:21,142::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:21,144::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:21,146::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136916::DEBUG::2014-10-29 11:23:21,149::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136916::DEBUG::2014-10-29 11:23:21,151::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:24,180::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:24,183::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136917::DEBUG::2014-10-29 11:23:24,186::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:24,188::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:24,190::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136918::DEBUG::2014-10-29 11:23:24,192::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136918::DEBUG::2014-10-29 11:23:24,195::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:23:25,566::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54621 >Detector thread::DEBUG::2014-10-29 11:23:25,567::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54621 >Detector thread::DEBUG::2014-10-29 11:23:25,568::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54621 >Detector thread::DEBUG::2014-10-29 11:23:25,568::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54621) >Thread-136919::DEBUG::2014-10-29 11:23:25,607::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136919::DEBUG::2014-10-29 11:23:25,607::task::595::Storage.TaskManager.Task::(_updateState) Task=`49da8f41-c8c7-4e92-b086-7e6e57602ca8`::moving from state init -> state preparing >Thread-136919::INFO::2014-10-29 11:23:25,608::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136919::DEBUG::2014-10-29 11:23:25,618::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:23:25,621::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:25,622::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:25,624::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-136919::DEBUG::2014-10-29 11:23:25,624::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136919::DEBUG::2014-10-29 11:23:25,627::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-17::DEBUG::2014-10-29 11:23:25,626::__init__::232::IOProcess::(_processLogs) (201809) Got request for method 'glob' >Thread-136919::INFO::2014-10-29 11:23:25,628::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136919::DEBUG::2014-10-29 11:23:25,629::task::1191::Storage.TaskManager.Task::(prepare) Task=`49da8f41-c8c7-4e92-b086-7e6e57602ca8`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-17::DEBUG::2014-10-29 11:23:25,630::__init__::232::IOProcess::(_processLogs) (201809) Queuing response >Thread-136919::DEBUG::2014-10-29 11:23:25,631::task::595::Storage.TaskManager.Task::(_updateState) Task=`49da8f41-c8c7-4e92-b086-7e6e57602ca8`::moving from state preparing -> state finished >Thread-136919::DEBUG::2014-10-29 11:23:25,633::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136919::DEBUG::2014-10-29 11:23:25,634::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136919::DEBUG::2014-10-29 11:23:25,635::task::993::Storage.TaskManager.Task::(_decref) Task=`49da8f41-c8c7-4e92-b086-7e6e57602ca8`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:23:25,679::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54622 >Detector thread::DEBUG::2014-10-29 11:23:25,680::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54622 >Detector thread::DEBUG::2014-10-29 11:23:25,680::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54622 >Detector thread::DEBUG::2014-10-29 11:23:25,681::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54622) >Thread-136920::DEBUG::2014-10-29 11:23:25,720::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136920::DEBUG::2014-10-29 11:23:25,721::task::595::Storage.TaskManager.Task::(_updateState) Task=`61b005e8-9c30-4042-af84-7b1d24ac4c65`::moving from state init -> state preparing >Thread-136920::INFO::2014-10-29 11:23:25,721::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136920::DEBUG::2014-10-29 11:23:25,721::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136920::DEBUG::2014-10-29 11:23:25,722::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136920::DEBUG::2014-10-29 11:23:25,722::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136920::DEBUG::2014-10-29 11:23:25,722::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136920::DEBUG::2014-10-29 11:23:25,722::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136920::DEBUG::2014-10-29 11:23:25,723::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136920::DEBUG::2014-10-29 11:23:25,815::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136920::DEBUG::2014-10-29 11:23:25,817::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:26,001::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:26,003::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:26,004::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136920::DEBUG::2014-10-29 11:23:26,013::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136920::DEBUG::2014-10-29 11:23:26,013::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136920::DEBUG::2014-10-29 11:23:26,014::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136920::DEBUG::2014-10-29 11:23:26,014::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136920::DEBUG::2014-10-29 11:23:26,015::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136920::DEBUG::2014-10-29 11:23:26,015::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136920::DEBUG::2014-10-29 11:23:26,015::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136920::DEBUG::2014-10-29 11:23:26,016::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:23:26,023::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:26,025::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:26,026::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:26,026::__init__::232::IOProcess::(_processLogs) (201810) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:26,027::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201810) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:26,029::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:26,029::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:26,030::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:26,030::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:26,030::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:26,030::__init__::232::IOProcess::(_processLogs) (201811) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:26,031::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:26,031::__init__::232::IOProcess::(_processLogs) (201812) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:26,031::__init__::232::IOProcess::(_processLogs) (201811) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:26,032::__init__::232::IOProcess::(_processLogs) (201812) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:26,033::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:26,035::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:26,036::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:26,038::__init__::232::IOProcess::(_processLogs) (201813) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:26,038::__init__::232::IOProcess::(_processLogs) (201813) Queuing response >Thread-136920::DEBUG::2014-10-29 11:23:26,042::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:23:26,043::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:26,043::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:26,044::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:26,044::__init__::232::IOProcess::(_processLogs) (201814) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:23:26,045::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201814) Queuing response >Thread-136920::DEBUG::2014-10-29 11:23:26,046::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:23:26,047::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:26,047::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:26,047::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:26,047::__init__::232::IOProcess::(_processLogs) (201815) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:23:26,048::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201815) Queuing response >Thread-136920::DEBUG::2014-10-29 11:23:26,049::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:23:26,051::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:26,051::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:26,052::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:26,052::__init__::232::IOProcess::(_processLogs) (201816) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:26,053::__init__::232::IOProcess::(_processLogs) (201816) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:26,053::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:26,053::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:26,054::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-136920::DEBUG::2014-10-29 11:23:26,054::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:23:26,055::__init__::232::IOProcess::(_processLogs) (201817) Got request for method 'glob' >Thread-136920::INFO::2014-10-29 11:23:26,056::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:23:26,057::__init__::232::IOProcess::(_processLogs) (201817) Queuing response >Thread-136920::INFO::2014-10-29 11:23:26,057::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136920::INFO::2014-10-29 11:23:26,058::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:23:26,059::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:26,059::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:26,060::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:26,060::__init__::232::IOProcess::(_processLogs) (201818) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:23:26,061::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201818) Queuing response >Thread-136920::DEBUG::2014-10-29 11:23:26,061::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136920::DEBUG::2014-10-29 11:23:26,063::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`2b331275-65bd-4e51-9d7b-3789b629b2c3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136920::DEBUG::2014-10-29 11:23:26,063::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136920::DEBUG::2014-10-29 11:23:26,064::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136920::DEBUG::2014-10-29 11:23:26,064::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`2b331275-65bd-4e51-9d7b-3789b629b2c3`::Granted request >Thread-136920::DEBUG::2014-10-29 11:23:26,065::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`61b005e8-9c30-4042-af84-7b1d24ac4c65`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136920::DEBUG::2014-10-29 11:23:26,065::task::993::Storage.TaskManager.Task::(_decref) Task=`61b005e8-9c30-4042-af84-7b1d24ac4c65`::ref 1 aborting False >Thread-136920::INFO::2014-10-29 11:23:26,068::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136920::DEBUG::2014-10-29 11:23:26,068::task::1191::Storage.TaskManager.Task::(prepare) Task=`61b005e8-9c30-4042-af84-7b1d24ac4c65`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136920::DEBUG::2014-10-29 11:23:26,068::task::595::Storage.TaskManager.Task::(_updateState) Task=`61b005e8-9c30-4042-af84-7b1d24ac4c65`::moving from state preparing -> state finished >Thread-136920::DEBUG::2014-10-29 11:23:26,069::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136920::DEBUG::2014-10-29 11:23:26,069::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136920::DEBUG::2014-10-29 11:23:26,069::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136920::DEBUG::2014-10-29 11:23:26,070::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136920::DEBUG::2014-10-29 11:23:26,070::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136920::DEBUG::2014-10-29 11:23:26,070::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136920::DEBUG::2014-10-29 11:23:26,070::task::993::Storage.TaskManager.Task::(_decref) Task=`61b005e8-9c30-4042-af84-7b1d24ac4c65`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:23:26,099::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54623 >Detector thread::DEBUG::2014-10-29 11:23:26,099::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54623 >Detector thread::DEBUG::2014-10-29 11:23:26,100::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54623 >Detector thread::DEBUG::2014-10-29 11:23:26,100::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54623) >Thread-136925::DEBUG::2014-10-29 11:23:26,139::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136925::DEBUG::2014-10-29 11:23:26,140::task::595::Storage.TaskManager.Task::(_updateState) Task=`9f21671b-f6eb-4eaf-8c7b-b2098a7a29e7`::moving from state init -> state preparing >Thread-136925::INFO::2014-10-29 11:23:26,140::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136925::INFO::2014-10-29 11:23:26,141::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430118', 'lastCheck': '8.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00064232', 'lastCheck': '8.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063254', 'lastCheck': '9.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000523674', 'lastCheck': '9.0', 'valid': True}} >Thread-136925::DEBUG::2014-10-29 11:23:26,141::task::1191::Storage.TaskManager.Task::(prepare) Task=`9f21671b-f6eb-4eaf-8c7b-b2098a7a29e7`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430118', 'lastCheck': '8.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00064232', 'lastCheck': '8.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063254', 'lastCheck': '9.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000523674', 'lastCheck': '9.0', 'valid': True}} >Thread-136925::DEBUG::2014-10-29 11:23:26,141::task::595::Storage.TaskManager.Task::(_updateState) Task=`9f21671b-f6eb-4eaf-8c7b-b2098a7a29e7`::moving from state preparing -> state finished >Thread-136925::DEBUG::2014-10-29 11:23:26,142::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136925::DEBUG::2014-10-29 11:23:26,142::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136925::DEBUG::2014-10-29 11:23:26,142::task::993::Storage.TaskManager.Task::(_decref) Task=`9f21671b-f6eb-4eaf-8c7b-b2098a7a29e7`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:23:27,093::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:27,093::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:27,096::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:27,097::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201819) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:27,097::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201819) Queuing response >Thread-179::DEBUG::2014-10-29 11:23:27,099::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:23:27,117::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000563661 s, 660 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:23:27,119::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:27,119::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:27,120::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:27,120::__init__::232::IOProcess::(_processLogs) (201820) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:27,121::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201820) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:27,178::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:27,178::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:27,181::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-10269::DEBUG::2014-10-29 11:23:27,182::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:23:27,199::__init__::232::IOProcess::(_processLogs) (201821) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:27,203::__init__::232::IOProcess::(_processLogs) (201821) Queuing response >Thread-10269::DEBUG::2014-10-29 11:23:27,204::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000738869 s, 679 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:23:27,206::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:27,207::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:27,207::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:27,207::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201822) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:27,208::__init__::232::IOProcess::(_processLogs) (201822) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:27,213::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:27,215::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136926::DEBUG::2014-10-29 11:23:27,219::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:27,222::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:27,224::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136927::DEBUG::2014-10-29 11:23:27,227::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136927::DEBUG::2014-10-29 11:23:27,229::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:23:27,651::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:27,652::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:27,652::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:27,652::__init__::232::IOProcess::(_processLogs) (201823) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:27,654::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201823) Queuing response >Thread-33::DEBUG::2014-10-29 11:23:27,655::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:23:27,673::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000488023 s, 998 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:23:27,675::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:27,676::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:27,676::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:27,676::__init__::232::IOProcess::(_processLogs) (201824) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:27,678::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201824) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:27,680::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:27,680::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:27,681::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:27,682::__init__::232::IOProcess::(_processLogs) (201825) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:27,682::__init__::232::IOProcess::(_processLogs) (201825) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:27,683::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:27,683::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:27,683::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:27,684::__init__::232::IOProcess::(_processLogs) (201826) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:27,685::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201826) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:27,686::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:27,686::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:27,686::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:27,686::__init__::232::IOProcess::(_processLogs) (201827) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:27,687::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201827) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:27,770::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:27,771::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:27,771::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:27,771::__init__::232::IOProcess::(_processLogs) (201828) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:27,772::__init__::232::IOProcess::(_processLogs) (201828) Queuing response >Thread-178::DEBUG::2014-10-29 11:23:27,773::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:23:27,792::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00178518 s, 285 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:23:27,794::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:27,794::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:27,795::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:27,795::__init__::232::IOProcess::(_processLogs) (201829) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:27,796::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201829) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:27,799::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:27,800::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:27,800::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:27,801::__init__::232::IOProcess::(_processLogs) (201830) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:27,801::__init__::232::IOProcess::(_processLogs) (201830) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:27,801::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:27,803::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:27,803::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:27,804::__init__::232::IOProcess::(_processLogs) (201831) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:27,804::__init__::232::IOProcess::(_processLogs) (201831) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:27,805::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:27,806::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:27,807::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:27,807::__init__::232::IOProcess::(_processLogs) (201832) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:27,808::__init__::232::IOProcess::(_processLogs) (201832) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:30,242::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:30,245::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136928::DEBUG::2014-10-29 11:23:30,248::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:30,251::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:30,253::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136929::DEBUG::2014-10-29 11:23:30,256::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136929::DEBUG::2014-10-29 11:23:30,259::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:23:30,291::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54624 >Detector thread::DEBUG::2014-10-29 11:23:30,292::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54624 >Detector thread::DEBUG::2014-10-29 11:23:30,292::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54624 >Detector thread::DEBUG::2014-10-29 11:23:30,292::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54624) >Thread-136930::DEBUG::2014-10-29 11:23:30,331::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136930::DEBUG::2014-10-29 11:23:30,332::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136930::DEBUG::2014-10-29 11:23:30,333::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.54', 'elapsedTime': '514442', 'displayType': 'vnc', 'cpuSys': '0.60', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '5744023', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '60327', 'readRate': '0.00', 'truesize': '6010888192', 'writeRate': '36402.23'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.40', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:31,012::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:31,015::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:31,016::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:23:31,160::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54626 >Detector thread::DEBUG::2014-10-29 11:23:31,160::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54626 >Detector thread::DEBUG::2014-10-29 11:23:31,161::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54626 >Detector thread::DEBUG::2014-10-29 11:23:31,161::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54626) >Thread-136931::DEBUG::2014-10-29 11:23:31,200::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136931::DEBUG::2014-10-29 11:23:31,202::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Detector thread::DEBUG::2014-10-29 11:23:31,219::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54627 >Detector thread::DEBUG::2014-10-29 11:23:31,220::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54627 >Detector thread::DEBUG::2014-10-29 11:23:31,220::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54627 >Detector thread::DEBUG::2014-10-29 11:23:31,221::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54627) >Thread-136931::DEBUG::2014-10-29 11:23:31,224::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136932::DEBUG::2014-10-29 11:23:31,255::task::595::Storage.TaskManager.Task::(_updateState) Task=`ecf9d1c4-f64d-4700-a1cf-3e636986060e`::moving from state init -> state preparing >Thread-136932::INFO::2014-10-29 11:23:31,257::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136932::INFO::2014-10-29 11:23:31,260::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00178518', 'lastCheck': '3.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488023', 'lastCheck': '3.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000563661', 'lastCheck': '4.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000738869', 'lastCheck': '4.0', 'valid': True}} >Thread-136932::DEBUG::2014-10-29 11:23:31,261::task::1191::Storage.TaskManager.Task::(prepare) Task=`ecf9d1c4-f64d-4700-a1cf-3e636986060e`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00178518', 'lastCheck': '3.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488023', 'lastCheck': '3.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000563661', 'lastCheck': '4.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000738869', 'lastCheck': '4.0', 'valid': True}} >Thread-136932::DEBUG::2014-10-29 11:23:31,263::task::595::Storage.TaskManager.Task::(_updateState) Task=`ecf9d1c4-f64d-4700-a1cf-3e636986060e`::moving from state preparing -> state finished >Thread-136932::DEBUG::2014-10-29 11:23:31,264::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136932::DEBUG::2014-10-29 11:23:31,265::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136932::DEBUG::2014-10-29 11:23:31,267::task::993::Storage.TaskManager.Task::(_decref) Task=`ecf9d1c4-f64d-4700-a1cf-3e636986060e`::ref 0 aborting False >Thread-136931::DEBUG::2014-10-29 11:23:31,311::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '10', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '10', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:33,270::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:33,273::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136933::DEBUG::2014-10-29 11:23:33,276::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d8ae211-d543-4426-a0bc-7ad908b64553`::moving from state init -> state preparing >Thread-136933::INFO::2014-10-29 11:23:33,277::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136933::INFO::2014-10-29 11:23:33,277::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00178518', 'lastCheck': '5.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488023', 'lastCheck': '5.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000563661', 'lastCheck': '6.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000738869', 'lastCheck': '6.1', 'valid': True}} >Thread-136933::DEBUG::2014-10-29 11:23:33,278::task::1191::Storage.TaskManager.Task::(prepare) Task=`2d8ae211-d543-4426-a0bc-7ad908b64553`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00178518', 'lastCheck': '5.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488023', 'lastCheck': '5.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000563661', 'lastCheck': '6.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000738869', 'lastCheck': '6.1', 'valid': True}} >Thread-136933::DEBUG::2014-10-29 11:23:33,278::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d8ae211-d543-4426-a0bc-7ad908b64553`::moving from state preparing -> state finished >Thread-136933::DEBUG::2014-10-29 11:23:33,278::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136933::DEBUG::2014-10-29 11:23:33,278::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136933::DEBUG::2014-10-29 11:23:33,279::task::993::Storage.TaskManager.Task::(_decref) Task=`2d8ae211-d543-4426-a0bc-7ad908b64553`::ref 0 aborting False >Thread-136933::DEBUG::2014-10-29 11:23:33,299::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:33,321::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:33,323::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136934::DEBUG::2014-10-29 11:23:33,326::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136934::DEBUG::2014-10-29 11:23:33,329::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:23:34,422::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >Thread-22::DEBUG::2014-10-29 11:23:34,955::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:36,022::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:36,024::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:36,025::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:36,381::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:36,384::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136935::DEBUG::2014-10-29 11:23:36,389::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:36,391::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:36,394::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136936::DEBUG::2014-10-29 11:23:36,397::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136936::DEBUG::2014-10-29 11:23:36,400::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:23:36,719::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54629 >Detector thread::DEBUG::2014-10-29 11:23:36,719::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54629 >Detector thread::DEBUG::2014-10-29 11:23:36,720::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54629 >Detector thread::DEBUG::2014-10-29 11:23:36,721::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54629) >Thread-136937::DEBUG::2014-10-29 11:23:36,760::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136937::DEBUG::2014-10-29 11:23:36,761::task::595::Storage.TaskManager.Task::(_updateState) Task=`b9b3fbb3-83fe-40d1-9f02-375369d20717`::moving from state init -> state preparing >Thread-136937::INFO::2014-10-29 11:23:36,761::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136937::DEBUG::2014-10-29 11:23:36,764::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:23:36,765::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:36,765::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:36,766::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:36,766::__init__::232::IOProcess::(_processLogs) (201833) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:36,767::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201833) Queuing response >Thread-136937::DEBUG::2014-10-29 11:23:36,768::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136937::DEBUG::2014-10-29 11:23:36,769::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136937::INFO::2014-10-29 11:23:36,769::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136937::DEBUG::2014-10-29 11:23:36,770::task::1191::Storage.TaskManager.Task::(prepare) Task=`b9b3fbb3-83fe-40d1-9f02-375369d20717`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136937::DEBUG::2014-10-29 11:23:36,770::task::595::Storage.TaskManager.Task::(_updateState) Task=`b9b3fbb3-83fe-40d1-9f02-375369d20717`::moving from state preparing -> state finished >Thread-136937::DEBUG::2014-10-29 11:23:36,770::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136937::DEBUG::2014-10-29 11:23:36,770::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136937::DEBUG::2014-10-29 11:23:36,771::task::993::Storage.TaskManager.Task::(_decref) Task=`b9b3fbb3-83fe-40d1-9f02-375369d20717`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:23:36,816::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54630 >Detector thread::DEBUG::2014-10-29 11:23:36,817::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54630 >Detector thread::DEBUG::2014-10-29 11:23:36,817::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54630 >Detector thread::DEBUG::2014-10-29 11:23:36,818::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54630) >Thread-136938::DEBUG::2014-10-29 11:23:36,857::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136938::DEBUG::2014-10-29 11:23:36,857::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c27d3cb-0334-4696-afd8-f49f9bd31e42`::moving from state init -> state preparing >Thread-136938::INFO::2014-10-29 11:23:36,858::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136938::DEBUG::2014-10-29 11:23:36,858::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136938::DEBUG::2014-10-29 11:23:36,858::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136938::DEBUG::2014-10-29 11:23:36,859::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136938::DEBUG::2014-10-29 11:23:36,859::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136938::DEBUG::2014-10-29 11:23:36,859::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136938::DEBUG::2014-10-29 11:23:36,860::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136938::DEBUG::2014-10-29 11:23:36,952::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136938::DEBUG::2014-10-29 11:23:36,953::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-17::DEBUG::2014-10-29 11:23:37,126::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:37,127::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:37,128::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:37,129::__init__::232::IOProcess::(_processLogs) (201834) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:37,130::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201834) Queuing response >Thread-136938::DEBUG::2014-10-29 11:23:37,133::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-179::DEBUG::2014-10-29 11:23:37,134::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-136938::DEBUG::2014-10-29 11:23:37,151::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136938::DEBUG::2014-10-29 11:23:37,152::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136938::DEBUG::2014-10-29 11:23:37,152::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136938::DEBUG::2014-10-29 11:23:37,153::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136938::DEBUG::2014-10-29 11:23:37,153::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136938::DEBUG::2014-10-29 11:23:37,153::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136938::DEBUG::2014-10-29 11:23:37,154::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-179::DEBUG::2014-10-29 11:23:37,163::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00060002 s, 620 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:23:37,163::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:37,167::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:37,167::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:37,168::__init__::232::IOProcess::(_processLogs) (201835) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:37,169::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201835) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:37,171::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:37,171::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:37,172::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:37,172::__init__::232::IOProcess::(_processLogs) (201836) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:37,173::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201836) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:37,175::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:37,177::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:37,179::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:37,181::__init__::232::IOProcess::(_processLogs) (201837) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:37,183::__init__::232::IOProcess::(_processLogs) (201837) Queuing response >Thread-136938::DEBUG::2014-10-29 11:23:37,185::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:23:37,189::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:37,189::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:37,189::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:37,190::__init__::232::IOProcess::(_processLogs) (201838) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:37,190::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201838) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:37,191::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:37,191::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:37,192::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:37,192::__init__::232::IOProcess::(_processLogs) (201839) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:37,193::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201839) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:37,195::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:37,195::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:37,195::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:37,196::__init__::232::IOProcess::(_processLogs) (201840) Got request for method 'touch' >Thread-136938::DEBUG::2014-10-29 11:23:37,198::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:23:37,198::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201840) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:37,201::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:37,201::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:37,201::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:37,202::__init__::232::IOProcess::(_processLogs) (201841) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:23:37,203::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201841) Queuing response >Thread-136938::DEBUG::2014-10-29 11:23:37,203::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:23:37,205::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:37,206::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:37,206::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:37,207::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201842) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:37,207::__init__::232::IOProcess::(_processLogs) (201842) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:37,208::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:37,208::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:37,208::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-136938::DEBUG::2014-10-29 11:23:37,209::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-136938::INFO::2014-10-29 11:23:37,209::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136938::INFO::2014-10-29 11:23:37,210::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136938::INFO::2014-10-29 11:23:37,212::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:23:37,211::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201843) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:37,214::__init__::232::IOProcess::(_processLogs) (201843) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:37,214::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:37,214::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:37,215::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:37,215::__init__::232::IOProcess::(_processLogs) (201844) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:37,216::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201844) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:37,218::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-10269::DEBUG::2014-10-29 11:23:37,218::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:23:37,219::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:37,235::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:37,236::__init__::232::IOProcess::(_processLogs) (201845) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:23:37,236::__init__::232::IOProcess::(_processLogs) (201845) Queuing response >Thread-136938::DEBUG::2014-10-29 11:23:37,238::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-10269::DEBUG::2014-10-29 11:23:37,242::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00169747 s, 296 kB/s\n'; <rc> = 0 >Thread-136938::DEBUG::2014-10-29 11:23:37,243::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`6dc41674-4dd1-4d81-8c50-eaf57c92bd5f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136938::DEBUG::2014-10-29 11:23:37,245::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-17::DEBUG::2014-10-29 11:23:37,247::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-136938::DEBUG::2014-10-29 11:23:37,248::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136938::DEBUG::2014-10-29 11:23:37,249::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`6dc41674-4dd1-4d81-8c50-eaf57c92bd5f`::Granted request >Thread-17::DEBUG::2014-10-29 11:23:37,249::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:37,252::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-136938::DEBUG::2014-10-29 11:23:37,253::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6c27d3cb-0334-4696-afd8-f49f9bd31e42`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-17::DEBUG::2014-10-29 11:23:37,254::__init__::232::IOProcess::(_processLogs) (201846) Got request for method 'statvfs' >Thread-136938::DEBUG::2014-10-29 11:23:37,255::task::993::Storage.TaskManager.Task::(_decref) Task=`6c27d3cb-0334-4696-afd8-f49f9bd31e42`::ref 1 aborting False >Thread-17::DEBUG::2014-10-29 11:23:37,261::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201846) Queuing response >Thread-136938::INFO::2014-10-29 11:23:37,266::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136938::DEBUG::2014-10-29 11:23:37,267::task::1191::Storage.TaskManager.Task::(prepare) Task=`6c27d3cb-0334-4696-afd8-f49f9bd31e42`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136938::DEBUG::2014-10-29 11:23:37,267::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c27d3cb-0334-4696-afd8-f49f9bd31e42`::moving from state preparing -> state finished >Thread-136938::DEBUG::2014-10-29 11:23:37,267::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136938::DEBUG::2014-10-29 11:23:37,268::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136938::DEBUG::2014-10-29 11:23:37,268::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136938::DEBUG::2014-10-29 11:23:37,268::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136938::DEBUG::2014-10-29 11:23:37,269::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136938::DEBUG::2014-10-29 11:23:37,269::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136938::DEBUG::2014-10-29 11:23:37,269::task::993::Storage.TaskManager.Task::(_decref) Task=`6c27d3cb-0334-4696-afd8-f49f9bd31e42`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:23:37,293::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54631 >Detector thread::DEBUG::2014-10-29 11:23:37,294::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54631 >Detector thread::DEBUG::2014-10-29 11:23:37,294::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54631 >Detector thread::DEBUG::2014-10-29 11:23:37,295::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54631) >Thread-136943::DEBUG::2014-10-29 11:23:37,333::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136943::DEBUG::2014-10-29 11:23:37,334::task::595::Storage.TaskManager.Task::(_updateState) Task=`51bdc7ac-6990-4fc5-b26f-afa4fa73f4fd`::moving from state init -> state preparing >Thread-136943::INFO::2014-10-29 11:23:37,334::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136943::INFO::2014-10-29 11:23:37,335::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00178518', 'lastCheck': '9.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488023', 'lastCheck': '9.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060002', 'lastCheck': '0.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00169747', 'lastCheck': '0.1', 'valid': True}} >Thread-136943::DEBUG::2014-10-29 11:23:37,335::task::1191::Storage.TaskManager.Task::(prepare) Task=`51bdc7ac-6990-4fc5-b26f-afa4fa73f4fd`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00178518', 'lastCheck': '9.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000488023', 'lastCheck': '9.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060002', 'lastCheck': '0.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00169747', 'lastCheck': '0.1', 'valid': True}} >Thread-136943::DEBUG::2014-10-29 11:23:37,335::task::595::Storage.TaskManager.Task::(_updateState) Task=`51bdc7ac-6990-4fc5-b26f-afa4fa73f4fd`::moving from state preparing -> state finished >Thread-136943::DEBUG::2014-10-29 11:23:37,335::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136943::DEBUG::2014-10-29 11:23:37,336::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136943::DEBUG::2014-10-29 11:23:37,336::task::993::Storage.TaskManager.Task::(_decref) Task=`51bdc7ac-6990-4fc5-b26f-afa4fa73f4fd`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:23:37,691::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:37,693::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:37,698::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-33::DEBUG::2014-10-29 11:23:37,700::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:23:37,700::__init__::232::IOProcess::(_processLogs) (201847) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:37,716::__init__::232::IOProcess::(_processLogs) (201847) Queuing response >Thread-33::DEBUG::2014-10-29 11:23:37,720::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000436912 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:23:37,722::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:37,722::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:37,723::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:37,723::__init__::232::IOProcess::(_processLogs) (201848) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:37,725::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201848) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:37,727::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:37,727::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:37,728::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:37,728::__init__::232::IOProcess::(_processLogs) (201849) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:37,729::__init__::232::IOProcess::(_processLogs) (201849) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:37,729::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:37,730::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:37,731::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:37,731::__init__::232::IOProcess::(_processLogs) (201850) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:37,731::__init__::232::IOProcess::(_processLogs) (201850) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:37,732::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:37,732::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:37,733::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:37,734::__init__::232::IOProcess::(_processLogs) (201851) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:37,735::__init__::232::IOProcess::(_processLogs) (201851) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:37,808::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:37,810::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-178::DEBUG::2014-10-29 11:23:37,811::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:23:37,811::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:37,830::__init__::232::IOProcess::(_processLogs) (201852) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:23:37,832::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000487421 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:23:37,833::__init__::232::IOProcess::(_processLogs) (201852) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:37,835::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:37,836::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:37,836::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:37,836::__init__::232::IOProcess::(_processLogs) (201853) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:37,836::__init__::232::IOProcess::(_processLogs) (201853) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:37,839::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:37,839::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:37,839::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:37,840::__init__::232::IOProcess::(_processLogs) (201854) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:37,840::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201854) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:37,841::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:37,841::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:37,842::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:37,842::__init__::232::IOProcess::(_processLogs) (201855) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:37,842::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201855) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:37,844::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:37,844::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:37,845::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:37,846::__init__::232::IOProcess::(_processLogs) (201856) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:37,847::__init__::232::IOProcess::(_processLogs) (201856) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:39,422::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:39,425::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136944::DEBUG::2014-10-29 11:23:39,428::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:39,431::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:39,433::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136945::DEBUG::2014-10-29 11:23:39,436::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136945::DEBUG::2014-10-29 11:23:39,438::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:23:40,365::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54632 >Detector thread::DEBUG::2014-10-29 11:23:40,366::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54632 >Detector thread::DEBUG::2014-10-29 11:23:40,366::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54632 >Detector thread::DEBUG::2014-10-29 11:23:40,367::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54632) >Detector thread::DEBUG::2014-10-29 11:23:40,384::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54633 >Detector thread::DEBUG::2014-10-29 11:23:40,385::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54633 >Detector thread::DEBUG::2014-10-29 11:23:40,385::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54633 >Detector thread::DEBUG::2014-10-29 11:23:40,386::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54633) >Thread-136946::DEBUG::2014-10-29 11:23:40,405::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136946::DEBUG::2014-10-29 11:23:40,407::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136946::DEBUG::2014-10-29 11:23:40,427::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136947::DEBUG::2014-10-29 11:23:40,432::task::595::Storage.TaskManager.Task::(_updateState) Task=`c8aa3fd3-5f9b-441f-8a7c-9941b69600be`::moving from state init -> state preparing >Thread-136947::INFO::2014-10-29 11:23:40,434::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136947::INFO::2014-10-29 11:23:40,438::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487421', 'lastCheck': '2.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436912', 'lastCheck': '2.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060002', 'lastCheck': '3.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00169747', 'lastCheck': '3.2', 'valid': True}} >Thread-136947::DEBUG::2014-10-29 11:23:40,439::task::1191::Storage.TaskManager.Task::(prepare) Task=`c8aa3fd3-5f9b-441f-8a7c-9941b69600be`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487421', 'lastCheck': '2.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436912', 'lastCheck': '2.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060002', 'lastCheck': '3.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00169747', 'lastCheck': '3.2', 'valid': True}} >Thread-136947::DEBUG::2014-10-29 11:23:40,441::task::595::Storage.TaskManager.Task::(_updateState) Task=`c8aa3fd3-5f9b-441f-8a7c-9941b69600be`::moving from state preparing -> state finished >Thread-136947::DEBUG::2014-10-29 11:23:40,443::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136947::DEBUG::2014-10-29 11:23:40,444::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136947::DEBUG::2014-10-29 11:23:40,446::task::993::Storage.TaskManager.Task::(_decref) Task=`c8aa3fd3-5f9b-441f-8a7c-9941b69600be`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:23:40,486::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54634 >Detector thread::DEBUG::2014-10-29 11:23:40,491::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54634 >Detector thread::DEBUG::2014-10-29 11:23:40,494::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54634 >Detector thread::DEBUG::2014-10-29 11:23:40,514::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54634) >Thread-136946::DEBUG::2014-10-29 11:23:40,525::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '90', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '90', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-136948::DEBUG::2014-10-29 11:23:40,538::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136948::DEBUG::2014-10-29 11:23:40,545::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136948::DEBUG::2014-10-29 11:23:40,551::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.97', 'elapsedTime': '514453', 'displayType': 'vnc', 'cpuSys': '0.87', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '5744023', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '60327', 'readRate': '0.00', 'truesize': '6010888192', 'writeRate': '36402.23'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.59', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:41,032::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:41,033::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:41,036::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:42,451::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:42,454::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136949::DEBUG::2014-10-29 11:23:42,458::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:42,462::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:42,464::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136950::DEBUG::2014-10-29 11:23:42,467::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136950::DEBUG::2014-10-29 11:23:42,470::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:45,487::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:45,490::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136951::DEBUG::2014-10-29 11:23:45,492::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:45,494::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:45,496::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136952::DEBUG::2014-10-29 11:23:45,499::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136952::DEBUG::2014-10-29 11:23:45,502::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:46,038::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:46,040::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:46,041::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:23:47,198::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:47,199::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:47,201::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-179::DEBUG::2014-10-29 11:23:47,203::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:23:47,203::__init__::232::IOProcess::(_processLogs) (201857) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:47,223::__init__::232::IOProcess::(_processLogs) (201857) Queuing response >Thread-179::DEBUG::2014-10-29 11:23:47,225::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00199466 s, 186 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:23:47,226::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:47,226::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:47,227::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:47,227::__init__::232::IOProcess::(_processLogs) (201858) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:47,228::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201858) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:47,264::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:47,266::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:47,266::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:47,266::__init__::232::IOProcess::(_processLogs) (201859) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:47,267::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201859) Queuing response >Thread-10269::DEBUG::2014-10-29 11:23:47,269::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:23:47,289::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000488335 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:23:47,291::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:47,292::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:47,292::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:47,292::__init__::232::IOProcess::(_processLogs) (201860) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:47,293::__init__::232::IOProcess::(_processLogs) (201860) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:47,737::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:47,739::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:47,740::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:47,742::__init__::232::IOProcess::(_processLogs) (201861) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:47,746::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201861) Queuing response >Thread-33::DEBUG::2014-10-29 11:23:47,748::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:23:47,771::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000816616 s, 596 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:23:47,773::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:47,773::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:47,775::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:47,776::__init__::232::IOProcess::(_processLogs) (201862) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:47,777::__init__::232::IOProcess::(_processLogs) (201862) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:47,777::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:47,777::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:47,778::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:47,779::__init__::232::IOProcess::(_processLogs) (201863) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:47,780::__init__::232::IOProcess::(_processLogs) (201863) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:47,780::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:47,781::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:47,782::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:47,782::__init__::232::IOProcess::(_processLogs) (201864) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:47,782::__init__::232::IOProcess::(_processLogs) (201864) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:47,783::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:47,784::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:47,784::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:47,784::__init__::232::IOProcess::(_processLogs) (201865) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:47,785::__init__::232::IOProcess::(_processLogs) (201865) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:47,847::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:47,848::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:47,848::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:47,848::__init__::232::IOProcess::(_processLogs) (201866) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:23:47,849::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:23:47,865::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201866) Queuing response >Thread-178::DEBUG::2014-10-29 11:23:47,869::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00057253 s, 887 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:23:47,871::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:47,871::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:47,871::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:47,872::__init__::232::IOProcess::(_processLogs) (201867) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:47,873::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201867) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:47,874::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:47,875::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:47,875::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:47,875::__init__::232::IOProcess::(_processLogs) (201868) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:47,876::__init__::232::IOProcess::(_processLogs) (201868) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:47,876::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:47,877::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:47,877::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:47,877::__init__::232::IOProcess::(_processLogs) (201869) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:47,878::__init__::232::IOProcess::(_processLogs) (201869) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:47,878::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:47,879::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:47,881::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:47,881::__init__::232::IOProcess::(_processLogs) (201870) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:47,881::__init__::232::IOProcess::(_processLogs) (201870) Queuing response >Detector thread::DEBUG::2014-10-29 11:23:47,931::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54637 >Detector thread::DEBUG::2014-10-29 11:23:47,932::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54637 >Detector thread::DEBUG::2014-10-29 11:23:47,932::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54637 >Detector thread::DEBUG::2014-10-29 11:23:47,933::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54637) >Thread-136953::DEBUG::2014-10-29 11:23:47,973::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136953::DEBUG::2014-10-29 11:23:47,974::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5439ecd-698c-490b-9106-7afaf68195e5`::moving from state init -> state preparing >Thread-136953::INFO::2014-10-29 11:23:47,975::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136953::DEBUG::2014-10-29 11:23:47,981::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:23:47,982::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:47,983::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:47,983::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:47,983::__init__::232::IOProcess::(_processLogs) (201871) Got request for method 'glob' >Thread-136953::DEBUG::2014-10-29 11:23:47,984::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:23:47,985::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201871) Queuing response >Thread-136953::DEBUG::2014-10-29 11:23:47,986::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136953::INFO::2014-10-29 11:23:47,987::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136953::DEBUG::2014-10-29 11:23:47,987::task::1191::Storage.TaskManager.Task::(prepare) Task=`c5439ecd-698c-490b-9106-7afaf68195e5`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136953::DEBUG::2014-10-29 11:23:47,988::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5439ecd-698c-490b-9106-7afaf68195e5`::moving from state preparing -> state finished >Thread-136953::DEBUG::2014-10-29 11:23:47,988::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136953::DEBUG::2014-10-29 11:23:47,988::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136953::DEBUG::2014-10-29 11:23:47,989::task::993::Storage.TaskManager.Task::(_decref) Task=`c5439ecd-698c-490b-9106-7afaf68195e5`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:23:48,032::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54638 >Detector thread::DEBUG::2014-10-29 11:23:48,033::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54638 >Detector thread::DEBUG::2014-10-29 11:23:48,033::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54638 >Detector thread::DEBUG::2014-10-29 11:23:48,033::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54638) >Thread-136954::DEBUG::2014-10-29 11:23:48,072::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136954::DEBUG::2014-10-29 11:23:48,073::task::595::Storage.TaskManager.Task::(_updateState) Task=`00ee7997-e17a-489e-bdf3-7c3f95ecf348`::moving from state init -> state preparing >Thread-136954::INFO::2014-10-29 11:23:48,073::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136954::DEBUG::2014-10-29 11:23:48,073::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136954::DEBUG::2014-10-29 11:23:48,074::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136954::DEBUG::2014-10-29 11:23:48,074::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136954::DEBUG::2014-10-29 11:23:48,074::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136954::DEBUG::2014-10-29 11:23:48,074::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136954::DEBUG::2014-10-29 11:23:48,075::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136954::DEBUG::2014-10-29 11:23:48,175::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136954::DEBUG::2014-10-29 11:23:48,175::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136954::DEBUG::2014-10-29 11:23:48,374::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136954::DEBUG::2014-10-29 11:23:48,375::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136954::DEBUG::2014-10-29 11:23:48,375::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136954::DEBUG::2014-10-29 11:23:48,375::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136954::DEBUG::2014-10-29 11:23:48,376::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136954::DEBUG::2014-10-29 11:23:48,376::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136954::DEBUG::2014-10-29 11:23:48,376::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136954::DEBUG::2014-10-29 11:23:48,377::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:23:48,384::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:48,386::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:48,387::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:48,387::__init__::232::IOProcess::(_processLogs) (201872) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:48,388::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201872) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:48,390::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:48,390::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:48,391::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:48,391::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:48,391::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:48,393::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:48,395::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:48,396::__init__::232::IOProcess::(_processLogs) (201873) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:48,397::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:48,397::__init__::232::IOProcess::(_processLogs) (201874) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:48,397::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:48,399::__init__::232::IOProcess::(_processLogs) (201875) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:48,401::__init__::232::IOProcess::(_processLogs) (201873) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:48,402::__init__::232::IOProcess::(_processLogs) (201874) Queuing response >Thread-136954::DEBUG::2014-10-29 11:23:48,404::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:23:48,404::__init__::232::IOProcess::(_processLogs) (201875) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:48,408::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:48,409::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:48,409::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:48,410::__init__::232::IOProcess::(_processLogs) (201876) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:23:48,411::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201876) Queuing response >Thread-136954::DEBUG::2014-10-29 11:23:48,412::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:23:48,414::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:48,414::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:48,414::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:48,415::__init__::232::IOProcess::(_processLogs) (201877) Got request for method 'readfile' >Thread-136954::DEBUG::2014-10-29 11:23:48,416::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:23:48,416::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201877) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:48,418::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:48,419::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:48,419::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:48,420::__init__::232::IOProcess::(_processLogs) (201878) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:48,420::__init__::232::IOProcess::(_processLogs) (201878) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:48,421::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:48,421::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-136954::DEBUG::2014-10-29 11:23:48,422::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:23:48,422::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-136954::INFO::2014-10-29 11:23:48,423::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136954::INFO::2014-10-29 11:23:48,424::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:23:48,424::__init__::232::IOProcess::(_processLogs) (201879) Got request for method 'glob' >Thread-136954::INFO::2014-10-29 11:23:48,425::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:23:48,426::__init__::232::IOProcess::(_processLogs) (201879) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:48,427::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:48,428::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:48,428::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:48,428::__init__::232::IOProcess::(_processLogs) (201880) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:23:48,429::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201880) Queuing response >Thread-136954::DEBUG::2014-10-29 11:23:48,429::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136954::DEBUG::2014-10-29 11:23:48,432::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`4f699351-557f-464f-9af1-9d9a16ba1fe5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136954::DEBUG::2014-10-29 11:23:48,432::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136954::DEBUG::2014-10-29 11:23:48,432::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136954::DEBUG::2014-10-29 11:23:48,433::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`4f699351-557f-464f-9af1-9d9a16ba1fe5`::Granted request >Thread-136954::DEBUG::2014-10-29 11:23:48,433::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`00ee7997-e17a-489e-bdf3-7c3f95ecf348`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136954::DEBUG::2014-10-29 11:23:48,434::task::993::Storage.TaskManager.Task::(_decref) Task=`00ee7997-e17a-489e-bdf3-7c3f95ecf348`::ref 1 aborting False >Thread-136954::INFO::2014-10-29 11:23:48,436::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136954::DEBUG::2014-10-29 11:23:48,436::task::1191::Storage.TaskManager.Task::(prepare) Task=`00ee7997-e17a-489e-bdf3-7c3f95ecf348`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136954::DEBUG::2014-10-29 11:23:48,437::task::595::Storage.TaskManager.Task::(_updateState) Task=`00ee7997-e17a-489e-bdf3-7c3f95ecf348`::moving from state preparing -> state finished >Thread-136954::DEBUG::2014-10-29 11:23:48,437::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136954::DEBUG::2014-10-29 11:23:48,437::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136954::DEBUG::2014-10-29 11:23:48,438::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136954::DEBUG::2014-10-29 11:23:48,438::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136954::DEBUG::2014-10-29 11:23:48,438::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136954::DEBUG::2014-10-29 11:23:48,438::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136954::DEBUG::2014-10-29 11:23:48,440::task::993::Storage.TaskManager.Task::(_decref) Task=`00ee7997-e17a-489e-bdf3-7c3f95ecf348`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:23:48,461::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54639 >Detector thread::DEBUG::2014-10-29 11:23:48,461::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54639 >Detector thread::DEBUG::2014-10-29 11:23:48,461::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54639 >Detector thread::DEBUG::2014-10-29 11:23:48,462::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54639) >Thread-136959::DEBUG::2014-10-29 11:23:48,501::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136959::DEBUG::2014-10-29 11:23:48,502::task::595::Storage.TaskManager.Task::(_updateState) Task=`c985a071-1221-4f8c-937e-f0085e395712`::moving from state init -> state preparing >Thread-136959::INFO::2014-10-29 11:23:48,502::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136959::INFO::2014-10-29 11:23:48,503::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057253', 'lastCheck': '0.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000816616', 'lastCheck': '0.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00199466', 'lastCheck': '1.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000488335', 'lastCheck': '1.2', 'valid': True}} >Thread-136959::DEBUG::2014-10-29 11:23:48,503::task::1191::Storage.TaskManager.Task::(prepare) Task=`c985a071-1221-4f8c-937e-f0085e395712`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057253', 'lastCheck': '0.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000816616', 'lastCheck': '0.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00199466', 'lastCheck': '1.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000488335', 'lastCheck': '1.2', 'valid': True}} >Thread-136959::DEBUG::2014-10-29 11:23:48,503::task::595::Storage.TaskManager.Task::(_updateState) Task=`c985a071-1221-4f8c-937e-f0085e395712`::moving from state preparing -> state finished >Thread-136959::DEBUG::2014-10-29 11:23:48,504::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136959::DEBUG::2014-10-29 11:23:48,504::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136959::DEBUG::2014-10-29 11:23:48,504::task::993::Storage.TaskManager.Task::(_decref) Task=`c985a071-1221-4f8c-937e-f0085e395712`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:48,517::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:48,519::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136960::DEBUG::2014-10-29 11:23:48,523::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff57f8eb-d412-41e2-85b4-e4a9f2af6017`::moving from state init -> state preparing >Thread-136960::INFO::2014-10-29 11:23:48,523::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136960::INFO::2014-10-29 11:23:48,524::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057253', 'lastCheck': '0.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000816616', 'lastCheck': '0.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00199466', 'lastCheck': '1.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000488335', 'lastCheck': '1.2', 'valid': True}} >Thread-136960::DEBUG::2014-10-29 11:23:48,524::task::1191::Storage.TaskManager.Task::(prepare) Task=`ff57f8eb-d412-41e2-85b4-e4a9f2af6017`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057253', 'lastCheck': '0.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000816616', 'lastCheck': '0.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00199466', 'lastCheck': '1.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000488335', 'lastCheck': '1.2', 'valid': True}} >Thread-136960::DEBUG::2014-10-29 11:23:48,524::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff57f8eb-d412-41e2-85b4-e4a9f2af6017`::moving from state preparing -> state finished >Thread-136960::DEBUG::2014-10-29 11:23:48,525::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136960::DEBUG::2014-10-29 11:23:48,525::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136960::DEBUG::2014-10-29 11:23:48,525::task::993::Storage.TaskManager.Task::(_decref) Task=`ff57f8eb-d412-41e2-85b4-e4a9f2af6017`::ref 0 aborting False >Thread-136960::DEBUG::2014-10-29 11:23:48,576::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:48,600::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:48,602::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136961::DEBUG::2014-10-29 11:23:48,606::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136961::DEBUG::2014-10-29 11:23:48,608::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:23:49,959::task::595::Storage.TaskManager.Task::(_updateState) Task=`dce64014-2950-40f0-a4eb-24fc72c51e8e`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:23:49,959::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:23:49,960::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:49,961::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:49,961::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:49,961::__init__::232::IOProcess::(_processLogs) (201881) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:23:49,962::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201881) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:49,964::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:49,964::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:49,964::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:49,965::__init__::232::IOProcess::(_processLogs) (201882) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:23:49,965::__init__::232::IOProcess::(_processLogs) (201882) Queuing response >Thread-22::INFO::2014-10-29 11:23:49,966::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010888192', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:23:49,966::task::1191::Storage.TaskManager.Task::(prepare) Task=`dce64014-2950-40f0-a4eb-24fc72c51e8e`::finished: {'truesize': '6010888192', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:23:49,967::task::595::Storage.TaskManager.Task::(_updateState) Task=`dce64014-2950-40f0-a4eb-24fc72c51e8e`::moving from state preparing -> state finished >Thread-22::DEBUG::2014-10-29 11:23:49,967::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-10-29 11:23:49,967::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2014-10-29 11:23:49,967::task::993::Storage.TaskManager.Task::(_decref) Task=`dce64014-2950-40f0-a4eb-24fc72c51e8e`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:23:50,038::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Detector thread::DEBUG::2014-10-29 11:23:50,600::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54640 >Detector thread::DEBUG::2014-10-29 11:23:50,601::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54640 >Detector thread::DEBUG::2014-10-29 11:23:50,601::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54640 >Detector thread::DEBUG::2014-10-29 11:23:50,602::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54640) >Detector thread::DEBUG::2014-10-29 11:23:50,617::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54641 >Detector thread::DEBUG::2014-10-29 11:23:50,618::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54641 >Detector thread::DEBUG::2014-10-29 11:23:50,618::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54641 >Detector thread::DEBUG::2014-10-29 11:23:50,618::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54641) >Thread-136962::DEBUG::2014-10-29 11:23:50,641::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1a8afb4-90c6-43a7-af05-61f86b6e01a7`::moving from state init -> state preparing >Thread-136962::INFO::2014-10-29 11:23:50,641::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136962::INFO::2014-10-29 11:23:50,642::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057253', 'lastCheck': '2.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000816616', 'lastCheck': '2.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00199466', 'lastCheck': '3.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000488335', 'lastCheck': '3.3', 'valid': True}} >Thread-136962::DEBUG::2014-10-29 11:23:50,642::task::1191::Storage.TaskManager.Task::(prepare) Task=`f1a8afb4-90c6-43a7-af05-61f86b6e01a7`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00057253', 'lastCheck': '2.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000816616', 'lastCheck': '2.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00199466', 'lastCheck': '3.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000488335', 'lastCheck': '3.3', 'valid': True}} >Thread-136962::DEBUG::2014-10-29 11:23:50,642::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1a8afb4-90c6-43a7-af05-61f86b6e01a7`::moving from state preparing -> state finished >Thread-136962::DEBUG::2014-10-29 11:23:50,643::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136962::DEBUG::2014-10-29 11:23:50,643::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136962::DEBUG::2014-10-29 11:23:50,643::task::993::Storage.TaskManager.Task::(_decref) Task=`f1a8afb4-90c6-43a7-af05-61f86b6e01a7`::ref 0 aborting False >Thread-136963::DEBUG::2014-10-29 11:23:50,657::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136963::DEBUG::2014-10-29 11:23:50,664::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136963::DEBUG::2014-10-29 11:23:50,685::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136963::DEBUG::2014-10-29 11:23:50,748::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '66', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '66', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:23:50,750::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54642 >Detector thread::DEBUG::2014-10-29 11:23:50,753::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54642 >Detector thread::DEBUG::2014-10-29 11:23:50,755::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54642 >Detector thread::DEBUG::2014-10-29 11:23:50,757::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54642) >Thread-136964::DEBUG::2014-10-29 11:23:50,790::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136964::DEBUG::2014-10-29 11:23:50,791::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136964::DEBUG::2014-10-29 11:23:50,792::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.37', 'elapsedTime': '514463', 'displayType': 'vnc', 'cpuSys': '0.67', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '4853981', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '129610', 'readRate': '0.00', 'truesize': '6010888192', 'writeRate': '33912.33'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.83', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:51,047::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:51,049::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:51,050::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:51,679::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:51,682::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136965::DEBUG::2014-10-29 11:23:51,686::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:51,689::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:51,691::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136966::DEBUG::2014-10-29 11:23:51,695::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136966::DEBUG::2014-10-29 11:23:51,697::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:54,714::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:54,717::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136967::DEBUG::2014-10-29 11:23:54,719::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:54,721::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:54,723::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136968::DEBUG::2014-10-29 11:23:54,726::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136968::DEBUG::2014-10-29 11:23:54,728::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:56,057::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:56,058::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:23:56,059::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:23:57,233::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:57,234::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:57,234::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:57,235::__init__::232::IOProcess::(_processLogs) (201883) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:57,236::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201883) Queuing response >Thread-179::DEBUG::2014-10-29 11:23:57,238::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:23:57,255::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000532761 s, 698 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:23:57,257::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:57,257::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:57,258::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:57,258::__init__::232::IOProcess::(_processLogs) (201884) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:57,260::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201884) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:57,295::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:57,295::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:57,296::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:57,296::__init__::232::IOProcess::(_processLogs) (201885) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:57,297::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201885) Queuing response >Thread-10269::DEBUG::2014-10-29 11:23:57,299::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:23:57,317::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.0005944 s, 845 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:23:57,319::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:57,319::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:57,321::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:57,322::__init__::232::IOProcess::(_processLogs) (201886) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:57,323::__init__::232::IOProcess::(_processLogs) (201886) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:57,743::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:57,746::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136969::DEBUG::2014-10-29 11:23:57,749::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:23:57,753::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:23:57,755::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136970::DEBUG::2014-10-29 11:23:57,758::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136970::DEBUG::2014-10-29 11:23:57,761::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:23:57,786::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:57,787::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:57,788::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:57,790::__init__::232::IOProcess::(_processLogs) (201887) Got request for method 'statvfs' >Thread-33::DEBUG::2014-10-29 11:23:57,790::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:23:57,791::__init__::232::IOProcess::(_processLogs) (201887) Queuing response >Thread-33::DEBUG::2014-10-29 11:23:57,811::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000496496 s, 981 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:23:57,820::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:57,822::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:57,823::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:57,824::__init__::232::IOProcess::(_processLogs) (201888) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:57,829::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201888) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:57,832::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:57,833::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:57,835::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:57,836::__init__::232::IOProcess::(_processLogs) (201889) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:57,839::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201889) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:57,840::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:57,840::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:57,840::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:57,841::__init__::232::IOProcess::(_processLogs) (201890) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:57,841::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201890) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:57,842::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:57,843::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:57,843::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:57,843::__init__::232::IOProcess::(_processLogs) (201891) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:57,844::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201891) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:57,881::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:57,882::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:57,882::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:57,882::__init__::232::IOProcess::(_processLogs) (201892) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:57,883::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201892) Queuing response >Thread-178::DEBUG::2014-10-29 11:23:57,885::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:23:57,901::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000502836 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:23:57,903::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:57,903::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:57,905::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:57,906::__init__::232::IOProcess::(_processLogs) (201893) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:23:57,906::__init__::232::IOProcess::(_processLogs) (201893) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:57,907::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:57,907::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:57,907::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:57,908::__init__::232::IOProcess::(_processLogs) (201894) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:57,908::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201894) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:57,910::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:57,910::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:57,910::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:57,910::__init__::232::IOProcess::(_processLogs) (201895) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:57,911::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201895) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:57,912::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:57,912::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:57,913::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:57,913::__init__::232::IOProcess::(_processLogs) (201896) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:57,914::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201896) Queuing response >Detector thread::DEBUG::2014-10-29 11:23:59,097::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54645 >Detector thread::DEBUG::2014-10-29 11:23:59,098::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54645 >Detector thread::DEBUG::2014-10-29 11:23:59,098::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54645 >Detector thread::DEBUG::2014-10-29 11:23:59,099::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54645) >Thread-136971::DEBUG::2014-10-29 11:23:59,138::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136971::DEBUG::2014-10-29 11:23:59,139::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc449649-7005-48ab-90b5-49033fbe5693`::moving from state init -> state preparing >Thread-136971::INFO::2014-10-29 11:23:59,140::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136971::DEBUG::2014-10-29 11:23:59,142::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:23:59,143::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:59,143::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:59,144::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:59,144::__init__::232::IOProcess::(_processLogs) (201897) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:59,145::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201897) Queuing response >Thread-136971::DEBUG::2014-10-29 11:23:59,146::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-136971::DEBUG::2014-10-29 11:23:59,147::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136971::INFO::2014-10-29 11:23:59,147::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136971::DEBUG::2014-10-29 11:23:59,147::task::1191::Storage.TaskManager.Task::(prepare) Task=`cc449649-7005-48ab-90b5-49033fbe5693`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136971::DEBUG::2014-10-29 11:23:59,148::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc449649-7005-48ab-90b5-49033fbe5693`::moving from state preparing -> state finished >Thread-136971::DEBUG::2014-10-29 11:23:59,148::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136971::DEBUG::2014-10-29 11:23:59,148::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136971::DEBUG::2014-10-29 11:23:59,148::task::993::Storage.TaskManager.Task::(_decref) Task=`cc449649-7005-48ab-90b5-49033fbe5693`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:23:59,192::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54646 >Detector thread::DEBUG::2014-10-29 11:23:59,192::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54646 >Detector thread::DEBUG::2014-10-29 11:23:59,193::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54646 >Detector thread::DEBUG::2014-10-29 11:23:59,193::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54646) >Thread-136972::DEBUG::2014-10-29 11:23:59,232::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136972::DEBUG::2014-10-29 11:23:59,232::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac17507a-258b-4820-989f-a30ae54067f9`::moving from state init -> state preparing >Thread-136972::INFO::2014-10-29 11:23:59,233::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136972::DEBUG::2014-10-29 11:23:59,233::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136972::DEBUG::2014-10-29 11:23:59,233::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136972::DEBUG::2014-10-29 11:23:59,234::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136972::DEBUG::2014-10-29 11:23:59,234::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136972::DEBUG::2014-10-29 11:23:59,234::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136972::DEBUG::2014-10-29 11:23:59,235::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136972::DEBUG::2014-10-29 11:23:59,327::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136972::DEBUG::2014-10-29 11:23:59,328::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136972::DEBUG::2014-10-29 11:23:59,501::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136972::DEBUG::2014-10-29 11:23:59,503::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136972::DEBUG::2014-10-29 11:23:59,503::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136972::DEBUG::2014-10-29 11:23:59,503::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136972::DEBUG::2014-10-29 11:23:59,504::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136972::DEBUG::2014-10-29 11:23:59,504::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136972::DEBUG::2014-10-29 11:23:59,505::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136972::DEBUG::2014-10-29 11:23:59,505::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:23:59,512::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:59,514::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:59,515::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:59,515::__init__::232::IOProcess::(_processLogs) (201898) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:59,516::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201898) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:59,517::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:59,518::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:59,519::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:59,519::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:59,519::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:59,520::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:59,520::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:59,520::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:59,520::__init__::232::IOProcess::(_processLogs) (201899) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:59,521::__init__::232::IOProcess::(_processLogs) (201900) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:59,521::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:59,521::__init__::232::IOProcess::(_processLogs) (201901) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:59,522::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201900) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:59,524::__init__::232::IOProcess::(_processLogs) (201901) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:59,524::__init__::232::IOProcess::(_processLogs) (201899) Queuing response >Thread-136972::DEBUG::2014-10-29 11:23:59,529::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:23:59,530::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:59,530::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:59,530::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:59,531::__init__::232::IOProcess::(_processLogs) (201902) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:23:59,532::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201902) Queuing response >Thread-136972::DEBUG::2014-10-29 11:23:59,533::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:23:59,534::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:59,534::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:59,534::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:59,535::__init__::232::IOProcess::(_processLogs) (201903) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:23:59,536::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201903) Queuing response >Thread-136972::DEBUG::2014-10-29 11:23:59,536::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:23:59,538::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:59,539::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:59,540::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:59,540::__init__::232::IOProcess::(_processLogs) (201904) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:23:59,540::__init__::232::IOProcess::(_processLogs) (201904) Queuing response >Thread-17::DEBUG::2014-10-29 11:23:59,541::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:59,541::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:59,541::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:59,541::__init__::232::IOProcess::(_processLogs) (201905) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:23:59,542::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201905) Queuing response >Thread-136972::DEBUG::2014-10-29 11:23:59,543::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-136972::INFO::2014-10-29 11:23:59,543::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136972::INFO::2014-10-29 11:23:59,544::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136972::INFO::2014-10-29 11:23:59,544::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:23:59,545::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:23:59,545::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:23:59,545::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:23:59,546::__init__::232::IOProcess::(_processLogs) (201906) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:23:59,546::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201906) Queuing response >Thread-136972::DEBUG::2014-10-29 11:23:59,547::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-136972::DEBUG::2014-10-29 11:23:59,549::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`acb05c10-2557-449e-8e88-1112fe3e8f51`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136972::DEBUG::2014-10-29 11:23:59,549::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136972::DEBUG::2014-10-29 11:23:59,550::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136972::DEBUG::2014-10-29 11:23:59,550::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`acb05c10-2557-449e-8e88-1112fe3e8f51`::Granted request >Thread-136972::DEBUG::2014-10-29 11:23:59,551::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ac17507a-258b-4820-989f-a30ae54067f9`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136972::DEBUG::2014-10-29 11:23:59,551::task::993::Storage.TaskManager.Task::(_decref) Task=`ac17507a-258b-4820-989f-a30ae54067f9`::ref 1 aborting False >Thread-136972::INFO::2014-10-29 11:23:59,554::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136972::DEBUG::2014-10-29 11:23:59,554::task::1191::Storage.TaskManager.Task::(prepare) Task=`ac17507a-258b-4820-989f-a30ae54067f9`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136972::DEBUG::2014-10-29 11:23:59,554::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac17507a-258b-4820-989f-a30ae54067f9`::moving from state preparing -> state finished >Thread-136972::DEBUG::2014-10-29 11:23:59,555::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136972::DEBUG::2014-10-29 11:23:59,555::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136972::DEBUG::2014-10-29 11:23:59,555::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136972::DEBUG::2014-10-29 11:23:59,556::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136972::DEBUG::2014-10-29 11:23:59,556::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136972::DEBUG::2014-10-29 11:23:59,556::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136972::DEBUG::2014-10-29 11:23:59,556::task::993::Storage.TaskManager.Task::(_decref) Task=`ac17507a-258b-4820-989f-a30ae54067f9`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:23:59,579::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54647 >Detector thread::DEBUG::2014-10-29 11:23:59,580::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54647 >Detector thread::DEBUG::2014-10-29 11:23:59,580::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54647 >Detector thread::DEBUG::2014-10-29 11:23:59,580::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54647) >Thread-136977::DEBUG::2014-10-29 11:23:59,619::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136977::DEBUG::2014-10-29 11:23:59,619::task::595::Storage.TaskManager.Task::(_updateState) Task=`7099163d-49fa-4a40-a9c5-729f323628e3`::moving from state init -> state preparing >Thread-136977::INFO::2014-10-29 11:23:59,620::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136977::INFO::2014-10-29 11:23:59,620::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502836', 'lastCheck': '1.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496496', 'lastCheck': '1.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532761', 'lastCheck': '2.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0005944', 'lastCheck': '2.3', 'valid': True}} >Thread-136977::DEBUG::2014-10-29 11:23:59,621::task::1191::Storage.TaskManager.Task::(prepare) Task=`7099163d-49fa-4a40-a9c5-729f323628e3`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502836', 'lastCheck': '1.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496496', 'lastCheck': '1.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532761', 'lastCheck': '2.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0005944', 'lastCheck': '2.3', 'valid': True}} >Thread-136977::DEBUG::2014-10-29 11:23:59,621::task::595::Storage.TaskManager.Task::(_updateState) Task=`7099163d-49fa-4a40-a9c5-729f323628e3`::moving from state preparing -> state finished >Thread-136977::DEBUG::2014-10-29 11:23:59,621::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136977::DEBUG::2014-10-29 11:23:59,621::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136977::DEBUG::2014-10-29 11:23:59,622::task::993::Storage.TaskManager.Task::(_decref) Task=`7099163d-49fa-4a40-a9c5-729f323628e3`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:24:00,742::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54648 >Detector thread::DEBUG::2014-10-29 11:24:00,743::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54648 >Detector thread::DEBUG::2014-10-29 11:24:00,743::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54648 >Detector thread::DEBUG::2014-10-29 11:24:00,744::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54648) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:00,774::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:00,777::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136979::DEBUG::2014-10-29 11:24:00,780::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:00,784::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-136978::DEBUG::2014-10-29 11:24:00,784::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c57f085-bbc6-4663-90b5-aae46c66064e`::moving from state init -> state preparing >Thread-136978::INFO::2014-10-29 11:24:00,786::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >JsonRpcServer::DEBUG::2014-10-29 11:24:00,790::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136978::INFO::2014-10-29 11:24:00,791::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502836', 'lastCheck': '2.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496496', 'lastCheck': '2.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532761', 'lastCheck': '3.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0005944', 'lastCheck': '3.5', 'valid': True}} >Thread-136978::DEBUG::2014-10-29 11:24:00,794::task::1191::Storage.TaskManager.Task::(prepare) Task=`7c57f085-bbc6-4663-90b5-aae46c66064e`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502836', 'lastCheck': '2.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496496', 'lastCheck': '2.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532761', 'lastCheck': '3.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0005944', 'lastCheck': '3.5', 'valid': True}} >Thread-136978::DEBUG::2014-10-29 11:24:00,796::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c57f085-bbc6-4663-90b5-aae46c66064e`::moving from state preparing -> state finished >Thread-136978::DEBUG::2014-10-29 11:24:00,798::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136980::DEBUG::2014-10-29 11:24:00,800::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136978::DEBUG::2014-10-29 11:24:00,800::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136978::DEBUG::2014-10-29 11:24:00,802::task::993::Storage.TaskManager.Task::(_decref) Task=`7c57f085-bbc6-4663-90b5-aae46c66064e`::ref 0 aborting False >Thread-136980::DEBUG::2014-10-29 11:24:00,806::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:24:00,810::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54649 >Detector thread::DEBUG::2014-10-29 11:24:00,814::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54649 >Detector thread::DEBUG::2014-10-29 11:24:00,815::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54649 >Detector thread::DEBUG::2014-10-29 11:24:00,816::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54649) >Thread-136981::DEBUG::2014-10-29 11:24:00,854::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136981::DEBUG::2014-10-29 11:24:00,856::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136981::DEBUG::2014-10-29 11:24:00,876::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-136981::DEBUG::2014-10-29 11:24:00,924::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '48', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '48', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:24:00,948::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54650 >Detector thread::DEBUG::2014-10-29 11:24:00,949::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54650 >Detector thread::DEBUG::2014-10-29 11:24:00,949::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54650 >Detector thread::DEBUG::2014-10-29 11:24:00,950::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54650) >Thread-136982::DEBUG::2014-10-29 11:24:00,989::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136982::DEBUG::2014-10-29 11:24:00,990::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136982::DEBUG::2014-10-29 11:24:00,991::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.37', 'elapsedTime': '514473', 'displayType': 'vnc', 'cpuSys': '0.67', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '4853981', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '129610', 'readRate': '0.00', 'truesize': '6010888192', 'writeRate': '33912.33'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.95', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:01,066::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:01,067::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:01,071::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:03,820::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:03,823::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136983::DEBUG::2014-10-29 11:24:03,827::task::595::Storage.TaskManager.Task::(_updateState) Task=`5fa200fb-5a1b-4363-9ba8-4d6479789d68`::moving from state init -> state preparing >Thread-136983::INFO::2014-10-29 11:24:03,828::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136983::INFO::2014-10-29 11:24:03,829::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502836', 'lastCheck': '5.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496496', 'lastCheck': '6.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532761', 'lastCheck': '6.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0005944', 'lastCheck': '6.5', 'valid': True}} >Thread-136983::DEBUG::2014-10-29 11:24:03,829::task::1191::Storage.TaskManager.Task::(prepare) Task=`5fa200fb-5a1b-4363-9ba8-4d6479789d68`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502836', 'lastCheck': '5.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496496', 'lastCheck': '6.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000532761', 'lastCheck': '6.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0005944', 'lastCheck': '6.5', 'valid': True}} >Thread-136983::DEBUG::2014-10-29 11:24:03,829::task::595::Storage.TaskManager.Task::(_updateState) Task=`5fa200fb-5a1b-4363-9ba8-4d6479789d68`::moving from state preparing -> state finished >Thread-136983::DEBUG::2014-10-29 11:24:03,829::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136983::DEBUG::2014-10-29 11:24:03,830::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136983::DEBUG::2014-10-29 11:24:03,830::task::993::Storage.TaskManager.Task::(_decref) Task=`5fa200fb-5a1b-4363-9ba8-4d6479789d68`::ref 0 aborting False >Thread-136983::DEBUG::2014-10-29 11:24:03,862::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:03,888::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:03,890::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136984::DEBUG::2014-10-29 11:24:03,893::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136984::DEBUG::2014-10-29 11:24:03,896::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:24:04,458::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >Thread-22::DEBUG::2014-10-29 11:24:05,060::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:06,076::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:06,077::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:06,079::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:06,981::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:06,985::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136985::DEBUG::2014-10-29 11:24:06,988::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:06,991::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:06,993::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136986::DEBUG::2014-10-29 11:24:06,996::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136986::DEBUG::2014-10-29 11:24:06,999::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:24:07,263::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:07,265::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:07,266::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:07,268::__init__::232::IOProcess::(_processLogs) (201907) Got request for method 'statvfs' >Thread-179::DEBUG::2014-10-29 11:24:07,268::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:24:07,269::__init__::232::IOProcess::(_processLogs) (201907) Queuing response >Thread-179::DEBUG::2014-10-29 11:24:07,288::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000436392 s, 852 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:24:07,289::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:07,290::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:07,290::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:07,290::__init__::232::IOProcess::(_processLogs) (201908) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:07,290::__init__::232::IOProcess::(_processLogs) (201908) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:07,323::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:07,324::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:07,324::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:07,324::__init__::232::IOProcess::(_processLogs) (201909) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:07,326::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201909) Queuing response >Thread-10269::DEBUG::2014-10-29 11:24:07,328::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:24:07,344::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000433625 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:24:07,346::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:07,347::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:07,347::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:07,347::__init__::232::IOProcess::(_processLogs) (201910) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:07,347::__init__::232::IOProcess::(_processLogs) (201910) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:07,846::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:07,846::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:07,846::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:07,847::__init__::232::IOProcess::(_processLogs) (201911) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:07,847::__init__::232::IOProcess::(_processLogs) (201911) Queuing response >Thread-33::DEBUG::2014-10-29 11:24:07,848::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:24:07,865::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000538161 s, 905 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:24:07,867::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:07,867::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:07,868::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:07,868::__init__::232::IOProcess::(_processLogs) (201912) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:07,870::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201912) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:07,871::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:07,872::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:07,873::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:07,873::__init__::232::IOProcess::(_processLogs) (201913) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:07,873::__init__::232::IOProcess::(_processLogs) (201913) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:07,874::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:07,875::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:07,875::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:07,876::__init__::232::IOProcess::(_processLogs) (201914) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:07,876::__init__::232::IOProcess::(_processLogs) (201914) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:07,876::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:07,877::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:07,878::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:07,879::__init__::232::IOProcess::(_processLogs) (201915) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:07,879::__init__::232::IOProcess::(_processLogs) (201915) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:07,915::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:07,916::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:07,917::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:07,919::__init__::232::IOProcess::(_processLogs) (201916) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:24:07,919::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:24:07,920::__init__::232::IOProcess::(_processLogs) (201916) Queuing response >Thread-178::DEBUG::2014-10-29 11:24:07,937::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000565135 s, 899 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:24:07,939::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:07,939::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:07,939::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:07,939::__init__::232::IOProcess::(_processLogs) (201917) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:07,941::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201917) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:07,943::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:07,943::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:07,944::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:07,944::__init__::232::IOProcess::(_processLogs) (201918) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:07,945::__init__::232::IOProcess::(_processLogs) (201918) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:07,945::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:07,946::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:07,947::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:07,947::__init__::232::IOProcess::(_processLogs) (201919) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:07,947::__init__::232::IOProcess::(_processLogs) (201919) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:07,948::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:07,948::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:07,949::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:07,950::__init__::232::IOProcess::(_processLogs) (201920) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:07,950::__init__::232::IOProcess::(_processLogs) (201920) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:10,031::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:10,035::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136987::DEBUG::2014-10-29 11:24:10,038::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:10,041::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:10,043::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136988::DEBUG::2014-10-29 11:24:10,046::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136988::DEBUG::2014-10-29 11:24:10,049::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:24:10,192::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54653 >Detector thread::DEBUG::2014-10-29 11:24:10,192::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54653 >Detector thread::DEBUG::2014-10-29 11:24:10,193::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54653 >Detector thread::DEBUG::2014-10-29 11:24:10,193::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54653) >Thread-136989::DEBUG::2014-10-29 11:24:10,233::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136989::DEBUG::2014-10-29 11:24:10,234::task::595::Storage.TaskManager.Task::(_updateState) Task=`e217fda2-c61c-48cf-b6d9-1dfa5a81f69a`::moving from state init -> state preparing >Thread-136989::INFO::2014-10-29 11:24:10,234::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-136989::DEBUG::2014-10-29 11:24:10,238::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:24:10,239::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:10,240::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:10,240::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:10,240::__init__::232::IOProcess::(_processLogs) (201921) Got request for method 'glob' >Thread-136989::DEBUG::2014-10-29 11:24:10,241::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:24:10,241::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201921) Queuing response >Thread-136989::DEBUG::2014-10-29 11:24:10,243::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-136989::INFO::2014-10-29 11:24:10,244::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136989::DEBUG::2014-10-29 11:24:10,244::task::1191::Storage.TaskManager.Task::(prepare) Task=`e217fda2-c61c-48cf-b6d9-1dfa5a81f69a`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-136989::DEBUG::2014-10-29 11:24:10,244::task::595::Storage.TaskManager.Task::(_updateState) Task=`e217fda2-c61c-48cf-b6d9-1dfa5a81f69a`::moving from state preparing -> state finished >Thread-136989::DEBUG::2014-10-29 11:24:10,245::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136989::DEBUG::2014-10-29 11:24:10,245::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136989::DEBUG::2014-10-29 11:24:10,245::task::993::Storage.TaskManager.Task::(_decref) Task=`e217fda2-c61c-48cf-b6d9-1dfa5a81f69a`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:24:10,291::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54654 >Detector thread::DEBUG::2014-10-29 11:24:10,292::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54654 >Detector thread::DEBUG::2014-10-29 11:24:10,292::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54654 >Detector thread::DEBUG::2014-10-29 11:24:10,293::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54654) >Thread-136990::DEBUG::2014-10-29 11:24:10,331::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136990::DEBUG::2014-10-29 11:24:10,332::task::595::Storage.TaskManager.Task::(_updateState) Task=`291dc979-91e1-4dad-b19d-799916ba068e`::moving from state init -> state preparing >Thread-136990::INFO::2014-10-29 11:24:10,332::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-136990::DEBUG::2014-10-29 11:24:10,332::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-136990::DEBUG::2014-10-29 11:24:10,332::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136990::DEBUG::2014-10-29 11:24:10,333::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-136990::DEBUG::2014-10-29 11:24:10,333::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-136990::DEBUG::2014-10-29 11:24:10,333::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-136990::DEBUG::2014-10-29 11:24:10,334::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-136990::DEBUG::2014-10-29 11:24:10,424::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-136990::DEBUG::2014-10-29 11:24:10,425::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-136990::DEBUG::2014-10-29 11:24:10,603::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-136990::DEBUG::2014-10-29 11:24:10,604::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136990::DEBUG::2014-10-29 11:24:10,604::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136990::DEBUG::2014-10-29 11:24:10,605::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136990::DEBUG::2014-10-29 11:24:10,605::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136990::DEBUG::2014-10-29 11:24:10,606::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-136990::DEBUG::2014-10-29 11:24:10,606::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-136990::DEBUG::2014-10-29 11:24:10,606::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:24:10,614::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:10,617::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:10,617::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:10,617::__init__::232::IOProcess::(_processLogs) (201922) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:24:10,618::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201922) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:10,620::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:10,620::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:10,621::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:10,621::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:10,621::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:10,621::__init__::232::IOProcess::(_processLogs) (201923) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:24:10,622::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201923) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:10,625::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:10,627::__init__::232::IOProcess::(_processLogs) (201924) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:24:10,629::__init__::232::IOProcess::(_processLogs) (201924) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:10,632::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:10,634::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-136990::DEBUG::2014-10-29 11:24:10,634::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:24:10,635::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:10,637::__init__::232::IOProcess::(_processLogs) (201925) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:24:10,637::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201925) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:10,639::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:10,640::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:10,640::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:10,640::__init__::232::IOProcess::(_processLogs) (201926) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:24:10,643::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201926) Queuing response >Thread-136990::DEBUG::2014-10-29 11:24:10,643::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:24:10,644::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:10,645::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:10,645::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:10,645::__init__::232::IOProcess::(_processLogs) (201927) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:24:10,646::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201927) Queuing response >Thread-136990::DEBUG::2014-10-29 11:24:10,646::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:24:10,649::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:10,649::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:10,650::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:10,650::__init__::232::IOProcess::(_processLogs) (201928) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:10,651::__init__::232::IOProcess::(_processLogs) (201928) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:10,651::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:10,651::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:10,652::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:10,652::__init__::232::IOProcess::(_processLogs) (201929) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:24:10,653::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201929) Queuing response >Thread-136990::DEBUG::2014-10-29 11:24:10,653::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-136990::INFO::2014-10-29 11:24:10,654::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-136990::INFO::2014-10-29 11:24:10,654::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-136990::INFO::2014-10-29 11:24:10,655::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:24:10,655::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:10,656::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:10,656::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:10,656::__init__::232::IOProcess::(_processLogs) (201930) Got request for method 'readfile' >Thread-136990::DEBUG::2014-10-29 11:24:10,657::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:24:10,657::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201930) Queuing response >Thread-136990::DEBUG::2014-10-29 11:24:10,660::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`ba6becee-e8eb-4b44-adb2-7f9dccfe5da4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-136990::DEBUG::2014-10-29 11:24:10,660::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-136990::DEBUG::2014-10-29 11:24:10,661::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-136990::DEBUG::2014-10-29 11:24:10,661::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`ba6becee-e8eb-4b44-adb2-7f9dccfe5da4`::Granted request >Thread-136990::DEBUG::2014-10-29 11:24:10,662::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`291dc979-91e1-4dad-b19d-799916ba068e`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-136990::DEBUG::2014-10-29 11:24:10,662::task::993::Storage.TaskManager.Task::(_decref) Task=`291dc979-91e1-4dad-b19d-799916ba068e`::ref 1 aborting False >Thread-136990::INFO::2014-10-29 11:24:10,665::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136990::DEBUG::2014-10-29 11:24:10,665::task::1191::Storage.TaskManager.Task::(prepare) Task=`291dc979-91e1-4dad-b19d-799916ba068e`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-136990::DEBUG::2014-10-29 11:24:10,665::task::595::Storage.TaskManager.Task::(_updateState) Task=`291dc979-91e1-4dad-b19d-799916ba068e`::moving from state preparing -> state finished >Thread-136990::DEBUG::2014-10-29 11:24:10,665::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-136990::DEBUG::2014-10-29 11:24:10,666::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136990::DEBUG::2014-10-29 11:24:10,666::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-136990::DEBUG::2014-10-29 11:24:10,667::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-136990::DEBUG::2014-10-29 11:24:10,667::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-136990::DEBUG::2014-10-29 11:24:10,667::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-136990::DEBUG::2014-10-29 11:24:10,667::task::993::Storage.TaskManager.Task::(_decref) Task=`291dc979-91e1-4dad-b19d-799916ba068e`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:24:10,688::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54655 >Detector thread::DEBUG::2014-10-29 11:24:10,689::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54655 >Detector thread::DEBUG::2014-10-29 11:24:10,689::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54655 >Detector thread::DEBUG::2014-10-29 11:24:10,690::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54655) >Thread-136995::DEBUG::2014-10-29 11:24:10,729::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136995::DEBUG::2014-10-29 11:24:10,730::task::595::Storage.TaskManager.Task::(_updateState) Task=`36e25ad5-0ba1-4358-b10a-fb3f5e76efd3`::moving from state init -> state preparing >Thread-136995::INFO::2014-10-29 11:24:10,730::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136995::INFO::2014-10-29 11:24:10,731::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565135', 'lastCheck': '2.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538161', 'lastCheck': '2.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436392', 'lastCheck': '3.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000433625', 'lastCheck': '3.4', 'valid': True}} >Thread-136995::DEBUG::2014-10-29 11:24:10,731::task::1191::Storage.TaskManager.Task::(prepare) Task=`36e25ad5-0ba1-4358-b10a-fb3f5e76efd3`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565135', 'lastCheck': '2.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538161', 'lastCheck': '2.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436392', 'lastCheck': '3.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000433625', 'lastCheck': '3.4', 'valid': True}} >Thread-136995::DEBUG::2014-10-29 11:24:10,731::task::595::Storage.TaskManager.Task::(_updateState) Task=`36e25ad5-0ba1-4358-b10a-fb3f5e76efd3`::moving from state preparing -> state finished >Thread-136995::DEBUG::2014-10-29 11:24:10,731::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136995::DEBUG::2014-10-29 11:24:10,732::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136995::DEBUG::2014-10-29 11:24:10,732::task::993::Storage.TaskManager.Task::(_decref) Task=`36e25ad5-0ba1-4358-b10a-fb3f5e76efd3`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:24:10,871::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54656 >Detector thread::DEBUG::2014-10-29 11:24:10,872::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54656 >Detector thread::DEBUG::2014-10-29 11:24:10,872::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54656 >Detector thread::DEBUG::2014-10-29 11:24:10,873::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54656) >Thread-136996::DEBUG::2014-10-29 11:24:10,913::task::595::Storage.TaskManager.Task::(_updateState) Task=`51c9800b-d30a-41d3-bb1a-ea4e06c82f37`::moving from state init -> state preparing >Thread-136996::INFO::2014-10-29 11:24:10,913::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136996::INFO::2014-10-29 11:24:10,914::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565135', 'lastCheck': '3.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538161', 'lastCheck': '3.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436392', 'lastCheck': '3.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000433625', 'lastCheck': '3.6', 'valid': True}} >Thread-136996::DEBUG::2014-10-29 11:24:10,914::task::1191::Storage.TaskManager.Task::(prepare) Task=`51c9800b-d30a-41d3-bb1a-ea4e06c82f37`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000565135', 'lastCheck': '3.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538161', 'lastCheck': '3.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436392', 'lastCheck': '3.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000433625', 'lastCheck': '3.6', 'valid': True}} >Thread-136996::DEBUG::2014-10-29 11:24:10,914::task::595::Storage.TaskManager.Task::(_updateState) Task=`51c9800b-d30a-41d3-bb1a-ea4e06c82f37`::moving from state preparing -> state finished >Thread-136996::DEBUG::2014-10-29 11:24:10,915::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136996::DEBUG::2014-10-29 11:24:10,915::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136996::DEBUG::2014-10-29 11:24:10,915::task::993::Storage.TaskManager.Task::(_decref) Task=`51c9800b-d30a-41d3-bb1a-ea4e06c82f37`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:24:10,983::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54657 >Detector thread::DEBUG::2014-10-29 11:24:10,984::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54657 >Detector thread::DEBUG::2014-10-29 11:24:10,984::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54657 >Detector thread::DEBUG::2014-10-29 11:24:10,985::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54657) >Thread-136997::DEBUG::2014-10-29 11:24:11,024::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-136997::DEBUG::2014-10-29 11:24:11,025::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-136997::DEBUG::2014-10-29 11:24:11,045::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:11,092::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:11,095::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136997::DEBUG::2014-10-29 11:24:11,097::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '31', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '31', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:11,105::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:24:11,147::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54658 >Detector thread::DEBUG::2014-10-29 11:24:11,148::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54658 >Detector thread::DEBUG::2014-10-29 11:24:11,148::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54658 >Detector thread::DEBUG::2014-10-29 11:24:11,149::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54658) >Thread-136998::DEBUG::2014-10-29 11:24:11,188::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-136998::DEBUG::2014-10-29 11:24:11,189::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-136998::DEBUG::2014-10-29 11:24:11,189::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.99', 'elapsedTime': '514483', 'displayType': 'vnc', 'cpuSys': '0.80', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '4853981', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '129610', 'readRate': '0.00', 'truesize': '6010888192', 'writeRate': '33912.33'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.13', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:13,063::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:13,066::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136999::DEBUG::2014-10-29 11:24:13,070::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:13,073::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:13,075::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137000::DEBUG::2014-10-29 11:24:13,078::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137000::DEBUG::2014-10-29 11:24:13,080::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:16,095::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:16,114::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:16,120::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137001::DEBUG::2014-10-29 11:24:16,129::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:16,135::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:16,138::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:16,147::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:16,147::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137002::DEBUG::2014-10-29 11:24:16,158::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137002::DEBUG::2014-10-29 11:24:16,173::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:24:17,295::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:17,297::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-179::DEBUG::2014-10-29 11:24:17,299::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:24:17,299::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:17,316::__init__::232::IOProcess::(_processLogs) (201931) Got request for method 'statvfs' >Thread-179::DEBUG::2014-10-29 11:24:17,319::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000627066 s, 593 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:24:17,319::__init__::232::IOProcess::(_processLogs) (201931) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:17,322::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:17,322::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:17,324::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:17,325::__init__::232::IOProcess::(_processLogs) (201932) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:17,325::__init__::232::IOProcess::(_processLogs) (201932) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:17,350::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:17,350::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:17,350::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:17,351::__init__::232::IOProcess::(_processLogs) (201933) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:17,352::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201933) Queuing response >Thread-10269::DEBUG::2014-10-29 11:24:17,353::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:24:17,369::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000496158 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:24:17,371::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:17,372::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:17,373::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:17,375::__init__::232::IOProcess::(_processLogs) (201934) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:17,376::__init__::232::IOProcess::(_processLogs) (201934) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:17,880::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:17,880::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:17,881::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:17,881::__init__::232::IOProcess::(_processLogs) (201935) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:17,881::__init__::232::IOProcess::(_processLogs) (201935) Queuing response >Thread-33::DEBUG::2014-10-29 11:24:17,883::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:24:17,899::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000501787 s, 971 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:24:17,901::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:17,901::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:17,902::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:17,902::__init__::232::IOProcess::(_processLogs) (201936) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:17,904::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201936) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:17,906::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:17,907::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:17,907::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:17,907::__init__::232::IOProcess::(_processLogs) (201937) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:17,909::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201937) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:17,910::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:17,910::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:17,910::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:17,911::__init__::232::IOProcess::(_processLogs) (201938) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:17,911::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201938) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:17,912::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:17,912::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:17,913::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:17,913::__init__::232::IOProcess::(_processLogs) (201939) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:17,914::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201939) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:17,951::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:17,951::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:17,952::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:17,952::__init__::232::IOProcess::(_processLogs) (201940) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:17,953::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201940) Queuing response >Thread-178::DEBUG::2014-10-29 11:24:17,954::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:24:17,972::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000419922 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:24:17,973::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:17,974::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:17,975::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:17,977::__init__::232::IOProcess::(_processLogs) (201941) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:17,977::__init__::232::IOProcess::(_processLogs) (201941) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:17,978::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:17,978::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:17,978::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:17,978::__init__::232::IOProcess::(_processLogs) (201942) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:17,979::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201942) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:17,980::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:17,980::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:17,981::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:17,981::__init__::232::IOProcess::(_processLogs) (201943) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:17,982::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201943) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:17,983::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:17,983::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:17,983::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:17,983::__init__::232::IOProcess::(_processLogs) (201944) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:17,984::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201944) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:19,188::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:19,191::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137003::DEBUG::2014-10-29 11:24:19,195::task::595::Storage.TaskManager.Task::(_updateState) Task=`d06f7f04-42db-4a79-8340-b9a7db4850ec`::moving from state init -> state preparing >Thread-137003::INFO::2014-10-29 11:24:19,195::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137003::INFO::2014-10-29 11:24:19,196::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000419922', 'lastCheck': '1.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000501787', 'lastCheck': '1.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627066', 'lastCheck': '1.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000496158', 'lastCheck': '1.8', 'valid': True}} >Thread-137003::DEBUG::2014-10-29 11:24:19,196::task::1191::Storage.TaskManager.Task::(prepare) Task=`d06f7f04-42db-4a79-8340-b9a7db4850ec`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000419922', 'lastCheck': '1.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000501787', 'lastCheck': '1.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627066', 'lastCheck': '1.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000496158', 'lastCheck': '1.8', 'valid': True}} >Thread-137003::DEBUG::2014-10-29 11:24:19,197::task::595::Storage.TaskManager.Task::(_updateState) Task=`d06f7f04-42db-4a79-8340-b9a7db4850ec`::moving from state preparing -> state finished >Thread-137003::DEBUG::2014-10-29 11:24:19,197::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137003::DEBUG::2014-10-29 11:24:19,197::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137003::DEBUG::2014-10-29 11:24:19,197::task::993::Storage.TaskManager.Task::(_decref) Task=`d06f7f04-42db-4a79-8340-b9a7db4850ec`::ref 0 aborting False >Thread-137003::DEBUG::2014-10-29 11:24:19,219::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:19,242::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:19,244::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137004::DEBUG::2014-10-29 11:24:19,247::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137004::DEBUG::2014-10-29 11:24:19,249::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:24:20,083::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Detector thread::DEBUG::2014-10-29 11:24:20,336::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54660 >Detector thread::DEBUG::2014-10-29 11:24:20,336::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54660 >Detector thread::DEBUG::2014-10-29 11:24:20,337::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54660 >Detector thread::DEBUG::2014-10-29 11:24:20,337::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54660) >Thread-137005::DEBUG::2014-10-29 11:24:20,376::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137005::DEBUG::2014-10-29 11:24:20,377::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137005::DEBUG::2014-10-29 11:24:20,378::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.95', 'elapsedTime': '514492', 'displayType': 'vnc', 'cpuSys': '1.26', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '4853981', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '129610', 'readRate': '0.00', 'truesize': '6010888192', 'writeRate': '33912.33'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.31', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:24:20,997::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54662 >Detector thread::DEBUG::2014-10-29 11:24:20,998::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54662 >Detector thread::DEBUG::2014-10-29 11:24:20,999::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54662 >Detector thread::DEBUG::2014-10-29 11:24:20,999::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54662) >Thread-137006::DEBUG::2014-10-29 11:24:21,039::task::595::Storage.TaskManager.Task::(_updateState) Task=`0ded7c07-b359-468a-9a2e-700376388781`::moving from state init -> state preparing >Thread-137006::INFO::2014-10-29 11:24:21,040::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137006::INFO::2014-10-29 11:24:21,040::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000419922', 'lastCheck': '3.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000501787', 'lastCheck': '3.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627066', 'lastCheck': '3.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000496158', 'lastCheck': '3.7', 'valid': True}} >Thread-137006::DEBUG::2014-10-29 11:24:21,040::task::1191::Storage.TaskManager.Task::(prepare) Task=`0ded7c07-b359-468a-9a2e-700376388781`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000419922', 'lastCheck': '3.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000501787', 'lastCheck': '3.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627066', 'lastCheck': '3.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000496158', 'lastCheck': '3.7', 'valid': True}} >Thread-137006::DEBUG::2014-10-29 11:24:21,041::task::595::Storage.TaskManager.Task::(_updateState) Task=`0ded7c07-b359-468a-9a2e-700376388781`::moving from state preparing -> state finished >Thread-137006::DEBUG::2014-10-29 11:24:21,041::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137006::DEBUG::2014-10-29 11:24:21,041::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137006::DEBUG::2014-10-29 11:24:21,041::task::993::Storage.TaskManager.Task::(_decref) Task=`0ded7c07-b359-468a-9a2e-700376388781`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:24:21,159::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54663 >Detector thread::DEBUG::2014-10-29 11:24:21,159::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54663 >Detector thread::DEBUG::2014-10-29 11:24:21,160::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54663 >Detector thread::DEBUG::2014-10-29 11:24:21,160::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54663) >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:21,165::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:21,167::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:21,168::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137007::DEBUG::2014-10-29 11:24:21,200::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137007::DEBUG::2014-10-29 11:24:21,202::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137007::DEBUG::2014-10-29 11:24:21,219::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137007::DEBUG::2014-10-29 11:24:21,277::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '13', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '13', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:24:21,315::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54665 >Detector thread::DEBUG::2014-10-29 11:24:21,316::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54665 >Detector thread::DEBUG::2014-10-29 11:24:21,316::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54665 >Detector thread::DEBUG::2014-10-29 11:24:21,317::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54665) >Thread-137008::DEBUG::2014-10-29 11:24:21,356::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137008::DEBUG::2014-10-29 11:24:21,357::task::595::Storage.TaskManager.Task::(_updateState) Task=`ebbffeb8-fe7b-48b9-aa0e-27e90874e967`::moving from state init -> state preparing >Thread-137008::INFO::2014-10-29 11:24:21,357::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137008::DEBUG::2014-10-29 11:24:21,360::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:24:21,361::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:21,361::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:21,361::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:21,362::__init__::232::IOProcess::(_processLogs) (201945) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:24:21,363::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201945) Queuing response >Thread-137008::DEBUG::2014-10-29 11:24:21,364::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137008::DEBUG::2014-10-29 11:24:21,365::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137008::INFO::2014-10-29 11:24:21,365::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137008::DEBUG::2014-10-29 11:24:21,365::task::1191::Storage.TaskManager.Task::(prepare) Task=`ebbffeb8-fe7b-48b9-aa0e-27e90874e967`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137008::DEBUG::2014-10-29 11:24:21,366::task::595::Storage.TaskManager.Task::(_updateState) Task=`ebbffeb8-fe7b-48b9-aa0e-27e90874e967`::moving from state preparing -> state finished >Thread-137008::DEBUG::2014-10-29 11:24:21,366::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137008::DEBUG::2014-10-29 11:24:21,366::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137008::DEBUG::2014-10-29 11:24:21,366::task::993::Storage.TaskManager.Task::(_decref) Task=`ebbffeb8-fe7b-48b9-aa0e-27e90874e967`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:24:21,410::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54666 >Detector thread::DEBUG::2014-10-29 11:24:21,411::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54666 >Detector thread::DEBUG::2014-10-29 11:24:21,411::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54666 >Detector thread::DEBUG::2014-10-29 11:24:21,412::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54666) >Thread-137009::DEBUG::2014-10-29 11:24:21,450::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137009::DEBUG::2014-10-29 11:24:21,451::task::595::Storage.TaskManager.Task::(_updateState) Task=`37b2b1f6-cc15-40e4-bef6-218053c5c582`::moving from state init -> state preparing >Thread-137009::INFO::2014-10-29 11:24:21,451::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137009::DEBUG::2014-10-29 11:24:21,452::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137009::DEBUG::2014-10-29 11:24:21,452::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137009::DEBUG::2014-10-29 11:24:21,452::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137009::DEBUG::2014-10-29 11:24:21,452::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137009::DEBUG::2014-10-29 11:24:21,453::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137009::DEBUG::2014-10-29 11:24:21,453::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137009::DEBUG::2014-10-29 11:24:21,534::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137009::DEBUG::2014-10-29 11:24:21,535::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137009::DEBUG::2014-10-29 11:24:21,703::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137009::DEBUG::2014-10-29 11:24:21,705::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137009::DEBUG::2014-10-29 11:24:21,705::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137009::DEBUG::2014-10-29 11:24:21,705::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137009::DEBUG::2014-10-29 11:24:21,706::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137009::DEBUG::2014-10-29 11:24:21,706::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137009::DEBUG::2014-10-29 11:24:21,706::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137009::DEBUG::2014-10-29 11:24:21,707::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:24:21,713::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:21,716::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:21,716::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:21,717::__init__::232::IOProcess::(_processLogs) (201946) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:24:21,718::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201946) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:21,719::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:21,719::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:21,720::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:21,720::__init__::232::IOProcess::(_processLogs) (201947) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:24:21,721::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201947) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:21,722::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:21,725::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:21,729::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:21,731::__init__::232::IOProcess::(_processLogs) (201948) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:24:21,733::__init__::232::IOProcess::(_processLogs) (201948) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:21,734::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-137009::DEBUG::2014-10-29 11:24:21,735::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:24:21,736::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:21,737::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:21,737::__init__::232::IOProcess::(_processLogs) (201949) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:24:21,737::__init__::232::IOProcess::(_processLogs) (201949) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:21,739::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:21,740::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:21,740::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:21,740::__init__::232::IOProcess::(_processLogs) (201950) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:24:21,741::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201950) Queuing response >Thread-137009::DEBUG::2014-10-29 11:24:21,742::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:24:21,743::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:21,743::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:21,744::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:21,744::__init__::232::IOProcess::(_processLogs) (201951) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:24:21,745::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201951) Queuing response >Thread-137009::DEBUG::2014-10-29 11:24:21,745::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:24:21,747::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:21,747::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:21,748::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:21,749::__init__::232::IOProcess::(_processLogs) (201952) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:21,749::__init__::232::IOProcess::(_processLogs) (201952) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:21,750::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:21,750::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:21,751::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-137009::DEBUG::2014-10-29 11:24:21,751::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:24:21,752::__init__::232::IOProcess::(_processLogs) (201953) Got request for method 'glob' >Thread-137009::INFO::2014-10-29 11:24:21,753::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137009::INFO::2014-10-29 11:24:21,755::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:24:21,755::__init__::232::IOProcess::(_processLogs) (201953) Queuing response >Thread-137009::INFO::2014-10-29 11:24:21,756::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:24:21,757::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:21,757::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:21,757::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:21,758::__init__::232::IOProcess::(_processLogs) (201954) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:24:21,758::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201954) Queuing response >Thread-137009::DEBUG::2014-10-29 11:24:21,759::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137009::DEBUG::2014-10-29 11:24:21,761::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`100be618-73f8-4d2c-a70c-8da298c963a5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137009::DEBUG::2014-10-29 11:24:21,761::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137009::DEBUG::2014-10-29 11:24:21,762::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137009::DEBUG::2014-10-29 11:24:21,762::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`100be618-73f8-4d2c-a70c-8da298c963a5`::Granted request >Thread-137009::DEBUG::2014-10-29 11:24:21,763::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`37b2b1f6-cc15-40e4-bef6-218053c5c582`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137009::DEBUG::2014-10-29 11:24:21,763::task::993::Storage.TaskManager.Task::(_decref) Task=`37b2b1f6-cc15-40e4-bef6-218053c5c582`::ref 1 aborting False >Thread-137009::INFO::2014-10-29 11:24:21,766::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137009::DEBUG::2014-10-29 11:24:21,766::task::1191::Storage.TaskManager.Task::(prepare) Task=`37b2b1f6-cc15-40e4-bef6-218053c5c582`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137009::DEBUG::2014-10-29 11:24:21,766::task::595::Storage.TaskManager.Task::(_updateState) Task=`37b2b1f6-cc15-40e4-bef6-218053c5c582`::moving from state preparing -> state finished >Thread-137009::DEBUG::2014-10-29 11:24:21,766::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137009::DEBUG::2014-10-29 11:24:21,767::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137009::DEBUG::2014-10-29 11:24:21,767::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137009::DEBUG::2014-10-29 11:24:21,767::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137009::DEBUG::2014-10-29 11:24:21,768::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137009::DEBUG::2014-10-29 11:24:21,768::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137009::DEBUG::2014-10-29 11:24:21,768::task::993::Storage.TaskManager.Task::(_decref) Task=`37b2b1f6-cc15-40e4-bef6-218053c5c582`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:24:21,791::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54667 >Detector thread::DEBUG::2014-10-29 11:24:21,792::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54667 >Detector thread::DEBUG::2014-10-29 11:24:21,792::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54667 >Detector thread::DEBUG::2014-10-29 11:24:21,793::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54667) >Thread-137014::DEBUG::2014-10-29 11:24:21,832::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137014::DEBUG::2014-10-29 11:24:21,833::task::595::Storage.TaskManager.Task::(_updateState) Task=`52a833d3-aa4b-4151-81c3-aa905be7abb6`::moving from state init -> state preparing >Thread-137014::INFO::2014-10-29 11:24:21,833::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137014::INFO::2014-10-29 11:24:21,834::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000419922', 'lastCheck': '3.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000501787', 'lastCheck': '3.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627066', 'lastCheck': '4.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000496158', 'lastCheck': '4.5', 'valid': True}} >Thread-137014::DEBUG::2014-10-29 11:24:21,834::task::1191::Storage.TaskManager.Task::(prepare) Task=`52a833d3-aa4b-4151-81c3-aa905be7abb6`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000419922', 'lastCheck': '3.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000501787', 'lastCheck': '3.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627066', 'lastCheck': '4.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000496158', 'lastCheck': '4.5', 'valid': True}} >Thread-137014::DEBUG::2014-10-29 11:24:21,834::task::595::Storage.TaskManager.Task::(_updateState) Task=`52a833d3-aa4b-4151-81c3-aa905be7abb6`::moving from state preparing -> state finished >Thread-137014::DEBUG::2014-10-29 11:24:21,835::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137014::DEBUG::2014-10-29 11:24:21,835::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137014::DEBUG::2014-10-29 11:24:21,835::task::993::Storage.TaskManager.Task::(_decref) Task=`52a833d3-aa4b-4151-81c3-aa905be7abb6`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:22,303::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:22,307::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137015::DEBUG::2014-10-29 11:24:22,311::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:22,314::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:22,316::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137016::DEBUG::2014-10-29 11:24:22,320::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137016::DEBUG::2014-10-29 11:24:22,322::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:25,339::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:25,341::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137017::DEBUG::2014-10-29 11:24:25,344::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:25,347::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:25,348::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137018::DEBUG::2014-10-29 11:24:25,352::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137018::DEBUG::2014-10-29 11:24:25,355::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:26,175::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:26,176::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:26,178::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:24:27,328::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:27,330::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-179::DEBUG::2014-10-29 11:24:27,332::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:24:27,332::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:27,348::__init__::232::IOProcess::(_processLogs) (201955) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:27,349::__init__::232::IOProcess::(_processLogs) (201955) Queuing response >Thread-179::DEBUG::2014-10-29 11:24:27,350::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00061563 s, 604 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:24:27,352::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:27,352::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:27,354::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:27,355::__init__::232::IOProcess::(_processLogs) (201956) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:27,355::__init__::232::IOProcess::(_processLogs) (201956) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:27,376::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:27,376::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:27,377::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:27,377::__init__::232::IOProcess::(_processLogs) (201957) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:27,378::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201957) Queuing response >Thread-10269::DEBUG::2014-10-29 11:24:27,379::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:24:27,397::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000491444 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:24:27,399::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:27,399::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:27,400::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:27,400::__init__::232::IOProcess::(_processLogs) (201958) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:27,400::__init__::232::IOProcess::(_processLogs) (201958) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:27,916::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:27,916::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:27,917::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:27,919::__init__::232::IOProcess::(_processLogs) (201959) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:27,920::__init__::232::IOProcess::(_processLogs) (201959) Queuing response >Thread-33::DEBUG::2014-10-29 11:24:27,920::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:24:27,937::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000520952 s, 935 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:24:27,939::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:27,939::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:27,940::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:27,940::__init__::232::IOProcess::(_processLogs) (201960) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:27,940::__init__::232::IOProcess::(_processLogs) (201960) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:27,942::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:27,943::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:27,944::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:27,944::__init__::232::IOProcess::(_processLogs) (201961) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:27,945::__init__::232::IOProcess::(_processLogs) (201961) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:27,945::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:27,946::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:27,947::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:27,947::__init__::232::IOProcess::(_processLogs) (201962) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:27,947::__init__::232::IOProcess::(_processLogs) (201962) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:27,948::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:27,948::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:27,949::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:27,950::__init__::232::IOProcess::(_processLogs) (201963) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:27,951::__init__::232::IOProcess::(_processLogs) (201963) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:27,986::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:27,987::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:27,988::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:27,989::__init__::232::IOProcess::(_processLogs) (201964) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:24:27,990::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:24:27,991::__init__::232::IOProcess::(_processLogs) (201964) Queuing response >Thread-178::DEBUG::2014-10-29 11:24:28,007::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000531852 s, 955 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:24:28,008::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:28,008::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:28,010::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:28,012::__init__::232::IOProcess::(_processLogs) (201965) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:28,012::__init__::232::IOProcess::(_processLogs) (201965) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:28,013::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:28,013::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:28,013::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:28,013::__init__::232::IOProcess::(_processLogs) (201966) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:28,014::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201966) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:28,015::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:28,015::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:28,016::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:28,016::__init__::232::IOProcess::(_processLogs) (201967) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:28,017::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201967) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:28,018::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:28,018::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:28,018::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:28,018::__init__::232::IOProcess::(_processLogs) (201968) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:28,019::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201968) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:28,368::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:28,370::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137019::DEBUG::2014-10-29 11:24:28,374::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:28,376::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:28,378::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137020::DEBUG::2014-10-29 11:24:28,381::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137020::DEBUG::2014-10-29 11:24:28,383::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:24:30,330::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54668 >Detector thread::DEBUG::2014-10-29 11:24:30,330::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54668 >Detector thread::DEBUG::2014-10-29 11:24:30,331::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54668 >Detector thread::DEBUG::2014-10-29 11:24:30,331::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54668) >Thread-137021::DEBUG::2014-10-29 11:24:30,370::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137021::DEBUG::2014-10-29 11:24:30,373::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137021::DEBUG::2014-10-29 11:24:30,392::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137021::DEBUG::2014-10-29 11:24:30,438::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '97', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '97', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:24:30,536::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54669 >Detector thread::DEBUG::2014-10-29 11:24:30,537::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54669 >Detector thread::DEBUG::2014-10-29 11:24:30,537::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54669 >Detector thread::DEBUG::2014-10-29 11:24:30,538::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54669) >Thread-137022::DEBUG::2014-10-29 11:24:30,577::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137022::DEBUG::2014-10-29 11:24:30,579::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137022::DEBUG::2014-10-29 11:24:30,579::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '3.95', 'elapsedTime': '514503', 'displayType': 'vnc', 'cpuSys': '1.26', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '4853981', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '129610', 'readRate': '0.00', 'truesize': '6010888192', 'writeRate': '33912.33'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.49', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:24:31,115::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54671 >Detector thread::DEBUG::2014-10-29 11:24:31,115::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54671 >Detector thread::DEBUG::2014-10-29 11:24:31,115::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54671 >Detector thread::DEBUG::2014-10-29 11:24:31,116::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54671) >Thread-137023::DEBUG::2014-10-29 11:24:31,156::task::595::Storage.TaskManager.Task::(_updateState) Task=`05eb97ce-255b-42e5-83e7-56cb530b3c30`::moving from state init -> state preparing >Thread-137023::INFO::2014-10-29 11:24:31,156::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137023::INFO::2014-10-29 11:24:31,157::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531852', 'lastCheck': '3.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520952', 'lastCheck': '3.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061563', 'lastCheck': '3.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000491444', 'lastCheck': '3.8', 'valid': True}} >Thread-137023::DEBUG::2014-10-29 11:24:31,157::task::1191::Storage.TaskManager.Task::(prepare) Task=`05eb97ce-255b-42e5-83e7-56cb530b3c30`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531852', 'lastCheck': '3.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520952', 'lastCheck': '3.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061563', 'lastCheck': '3.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000491444', 'lastCheck': '3.8', 'valid': True}} >Thread-137023::DEBUG::2014-10-29 11:24:31,158::task::595::Storage.TaskManager.Task::(_updateState) Task=`05eb97ce-255b-42e5-83e7-56cb530b3c30`::moving from state preparing -> state finished >Thread-137023::DEBUG::2014-10-29 11:24:31,158::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137023::DEBUG::2014-10-29 11:24:31,158::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137023::DEBUG::2014-10-29 11:24:31,158::task::993::Storage.TaskManager.Task::(_decref) Task=`05eb97ce-255b-42e5-83e7-56cb530b3c30`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:31,185::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:31,188::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:31,193::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:31,396::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:31,398::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137024::DEBUG::2014-10-29 11:24:31,402::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:31,404::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:31,406::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137025::DEBUG::2014-10-29 11:24:31,408::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137025::DEBUG::2014-10-29 11:24:31,411::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:24:32,448::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54673 >Detector thread::DEBUG::2014-10-29 11:24:32,450::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54673 >Detector thread::DEBUG::2014-10-29 11:24:32,450::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54673 >Detector thread::DEBUG::2014-10-29 11:24:32,451::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54673) >Thread-137026::DEBUG::2014-10-29 11:24:32,489::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137026::DEBUG::2014-10-29 11:24:32,490::task::595::Storage.TaskManager.Task::(_updateState) Task=`99724f1a-8a9a-4269-9680-05074856d66b`::moving from state init -> state preparing >Thread-137026::INFO::2014-10-29 11:24:32,491::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137026::DEBUG::2014-10-29 11:24:32,505::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:24:32,506::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:32,507::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:32,507::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:32,507::__init__::232::IOProcess::(_processLogs) (201969) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:24:32,508::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201969) Queuing response >Thread-137026::DEBUG::2014-10-29 11:24:32,509::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137026::DEBUG::2014-10-29 11:24:32,510::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137026::INFO::2014-10-29 11:24:32,510::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137026::DEBUG::2014-10-29 11:24:32,510::task::1191::Storage.TaskManager.Task::(prepare) Task=`99724f1a-8a9a-4269-9680-05074856d66b`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137026::DEBUG::2014-10-29 11:24:32,511::task::595::Storage.TaskManager.Task::(_updateState) Task=`99724f1a-8a9a-4269-9680-05074856d66b`::moving from state preparing -> state finished >Thread-137026::DEBUG::2014-10-29 11:24:32,511::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137026::DEBUG::2014-10-29 11:24:32,511::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137026::DEBUG::2014-10-29 11:24:32,511::task::993::Storage.TaskManager.Task::(_decref) Task=`99724f1a-8a9a-4269-9680-05074856d66b`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:24:32,557::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54674 >Detector thread::DEBUG::2014-10-29 11:24:32,558::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54674 >Detector thread::DEBUG::2014-10-29 11:24:32,558::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54674 >Detector thread::DEBUG::2014-10-29 11:24:32,558::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54674) >Thread-137027::DEBUG::2014-10-29 11:24:32,597::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137027::DEBUG::2014-10-29 11:24:32,597::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b6b60b0-9b8f-43c4-aa7a-e6056f8344dc`::moving from state init -> state preparing >Thread-137027::INFO::2014-10-29 11:24:32,598::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137027::DEBUG::2014-10-29 11:24:32,598::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137027::DEBUG::2014-10-29 11:24:32,598::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137027::DEBUG::2014-10-29 11:24:32,599::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137027::DEBUG::2014-10-29 11:24:32,599::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137027::DEBUG::2014-10-29 11:24:32,599::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137027::DEBUG::2014-10-29 11:24:32,600::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137027::DEBUG::2014-10-29 11:24:32,687::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137027::DEBUG::2014-10-29 11:24:32,688::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137027::DEBUG::2014-10-29 11:24:32,870::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137027::DEBUG::2014-10-29 11:24:32,871::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137027::DEBUG::2014-10-29 11:24:32,871::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137027::DEBUG::2014-10-29 11:24:32,872::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137027::DEBUG::2014-10-29 11:24:32,872::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137027::DEBUG::2014-10-29 11:24:32,872::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137027::DEBUG::2014-10-29 11:24:32,873::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137027::DEBUG::2014-10-29 11:24:32,873::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:24:32,879::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:32,883::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:32,883::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:32,883::__init__::232::IOProcess::(_processLogs) (201970) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:24:32,884::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201970) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:32,887::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:32,887::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:32,888::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:32,889::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:32,889::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:32,889::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:32,889::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:32,890::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:32,890::__init__::232::IOProcess::(_processLogs) (201971) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:24:32,890::__init__::232::IOProcess::(_processLogs) (201972) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:24:32,890::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:32,891::__init__::232::IOProcess::(_processLogs) (201973) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:24:32,891::__init__::232::IOProcess::(_processLogs) (201972) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:32,891::__init__::232::IOProcess::(_processLogs) (201971) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:32,892::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201973) Queuing response >Thread-137027::DEBUG::2014-10-29 11:24:32,897::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:24:32,898::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:32,899::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:32,899::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:32,899::__init__::232::IOProcess::(_processLogs) (201974) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:24:32,900::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201974) Queuing response >Thread-137027::DEBUG::2014-10-29 11:24:32,901::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:24:32,902::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:32,902::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:32,902::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:32,902::__init__::232::IOProcess::(_processLogs) (201975) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:24:32,903::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201975) Queuing response >Thread-137027::DEBUG::2014-10-29 11:24:32,904::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:24:32,906::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:32,906::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:32,907::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:32,908::__init__::232::IOProcess::(_processLogs) (201976) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:32,908::__init__::232::IOProcess::(_processLogs) (201976) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:32,908::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:32,909::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:32,909::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:32,909::__init__::232::IOProcess::(_processLogs) (201977) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:24:32,910::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201977) Queuing response >Thread-137027::DEBUG::2014-10-29 11:24:32,910::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-137027::INFO::2014-10-29 11:24:32,911::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137027::INFO::2014-10-29 11:24:32,911::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137027::INFO::2014-10-29 11:24:32,912::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:24:32,912::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:32,913::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:32,913::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:32,913::__init__::232::IOProcess::(_processLogs) (201978) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:24:32,914::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201978) Queuing response >Thread-137027::DEBUG::2014-10-29 11:24:32,915::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137027::DEBUG::2014-10-29 11:24:32,917::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`57d90e3e-dea9-48f3-992e-5fa0bc14d10a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137027::DEBUG::2014-10-29 11:24:32,917::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137027::DEBUG::2014-10-29 11:24:32,918::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137027::DEBUG::2014-10-29 11:24:32,918::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`57d90e3e-dea9-48f3-992e-5fa0bc14d10a`::Granted request >Thread-137027::DEBUG::2014-10-29 11:24:32,919::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2b6b60b0-9b8f-43c4-aa7a-e6056f8344dc`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137027::DEBUG::2014-10-29 11:24:32,919::task::993::Storage.TaskManager.Task::(_decref) Task=`2b6b60b0-9b8f-43c4-aa7a-e6056f8344dc`::ref 1 aborting False >Thread-137027::INFO::2014-10-29 11:24:32,922::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137027::DEBUG::2014-10-29 11:24:32,922::task::1191::Storage.TaskManager.Task::(prepare) Task=`2b6b60b0-9b8f-43c4-aa7a-e6056f8344dc`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137027::DEBUG::2014-10-29 11:24:32,922::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b6b60b0-9b8f-43c4-aa7a-e6056f8344dc`::moving from state preparing -> state finished >Thread-137027::DEBUG::2014-10-29 11:24:32,922::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137027::DEBUG::2014-10-29 11:24:32,923::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137027::DEBUG::2014-10-29 11:24:32,923::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137027::DEBUG::2014-10-29 11:24:32,923::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137027::DEBUG::2014-10-29 11:24:32,924::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137027::DEBUG::2014-10-29 11:24:32,924::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137027::DEBUG::2014-10-29 11:24:32,924::task::993::Storage.TaskManager.Task::(_decref) Task=`2b6b60b0-9b8f-43c4-aa7a-e6056f8344dc`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:24:32,945::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54675 >Detector thread::DEBUG::2014-10-29 11:24:32,946::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54675 >Detector thread::DEBUG::2014-10-29 11:24:32,946::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54675 >Detector thread::DEBUG::2014-10-29 11:24:32,947::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54675) >Thread-137032::DEBUG::2014-10-29 11:24:32,985::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137032::DEBUG::2014-10-29 11:24:32,985::task::595::Storage.TaskManager.Task::(_updateState) Task=`6018f246-6b1a-47f4-b970-f9c47407b837`::moving from state init -> state preparing >Thread-137032::INFO::2014-10-29 11:24:32,986::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137032::INFO::2014-10-29 11:24:32,986::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531852', 'lastCheck': '5.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520952', 'lastCheck': '5.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061563', 'lastCheck': '5.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000491444', 'lastCheck': '5.6', 'valid': True}} >Thread-137032::DEBUG::2014-10-29 11:24:32,987::task::1191::Storage.TaskManager.Task::(prepare) Task=`6018f246-6b1a-47f4-b970-f9c47407b837`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531852', 'lastCheck': '5.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520952', 'lastCheck': '5.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061563', 'lastCheck': '5.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000491444', 'lastCheck': '5.6', 'valid': True}} >Thread-137032::DEBUG::2014-10-29 11:24:32,987::task::595::Storage.TaskManager.Task::(_updateState) Task=`6018f246-6b1a-47f4-b970-f9c47407b837`::moving from state preparing -> state finished >Thread-137032::DEBUG::2014-10-29 11:24:32,987::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137032::DEBUG::2014-10-29 11:24:32,987::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137032::DEBUG::2014-10-29 11:24:32,988::task::993::Storage.TaskManager.Task::(_decref) Task=`6018f246-6b1a-47f4-b970-f9c47407b837`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:34,422::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:34,425::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137033::DEBUG::2014-10-29 11:24:34,429::task::595::Storage.TaskManager.Task::(_updateState) Task=`5dbf25a6-2ba3-4462-b646-2ba56d67c2d9`::moving from state init -> state preparing >Thread-137033::INFO::2014-10-29 11:24:34,429::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137033::INFO::2014-10-29 11:24:34,430::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531852', 'lastCheck': '6.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520952', 'lastCheck': '6.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061563', 'lastCheck': '7.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000491444', 'lastCheck': '7.0', 'valid': True}} >Thread-137033::DEBUG::2014-10-29 11:24:34,430::task::1191::Storage.TaskManager.Task::(prepare) Task=`5dbf25a6-2ba3-4462-b646-2ba56d67c2d9`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531852', 'lastCheck': '6.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520952', 'lastCheck': '6.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061563', 'lastCheck': '7.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000491444', 'lastCheck': '7.0', 'valid': True}} >Thread-137033::DEBUG::2014-10-29 11:24:34,430::task::595::Storage.TaskManager.Task::(_updateState) Task=`5dbf25a6-2ba3-4462-b646-2ba56d67c2d9`::moving from state preparing -> state finished >Thread-137033::DEBUG::2014-10-29 11:24:34,431::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137033::DEBUG::2014-10-29 11:24:34,431::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137033::DEBUG::2014-10-29 11:24:34,431::task::993::Storage.TaskManager.Task::(_decref) Task=`5dbf25a6-2ba3-4462-b646-2ba56d67c2d9`::ref 0 aborting False >Thread-137033::DEBUG::2014-10-29 11:24:34,453::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:34,476::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:34,478::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137034::DEBUG::2014-10-29 11:24:34,481::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137034::DEBUG::2014-10-29 11:24:34,483::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:24:34,492::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >Thread-22::DEBUG::2014-10-29 11:24:35,106::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:36,199::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:36,200::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:36,203::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:24:37,357::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:37,358::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:37,358::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:37,359::__init__::232::IOProcess::(_processLogs) (201979) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:37,360::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201979) Queuing response >Thread-179::DEBUG::2014-10-29 11:24:37,362::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:24:37,380::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000418448 s, 889 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:24:37,382::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:37,383::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:37,383::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:37,383::__init__::232::IOProcess::(_processLogs) (201980) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:37,385::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201980) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:37,403::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:37,403::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:37,404::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:37,404::__init__::232::IOProcess::(_processLogs) (201981) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:37,405::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201981) Queuing response >Thread-10269::DEBUG::2014-10-29 11:24:37,407::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:24:37,425::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000522171 s, 961 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:24:37,427::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:37,427::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:37,429::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:37,431::__init__::232::IOProcess::(_processLogs) (201982) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:37,431::__init__::232::IOProcess::(_processLogs) (201982) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:37,527::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:37,529::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137035::DEBUG::2014-10-29 11:24:37,533::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:37,535::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:37,537::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137036::DEBUG::2014-10-29 11:24:37,540::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137036::DEBUG::2014-10-29 11:24:37,543::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:24:37,951::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:37,952::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:37,953::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:37,954::__init__::232::IOProcess::(_processLogs) (201983) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:37,955::__init__::232::IOProcess::(_processLogs) (201983) Queuing response >Thread-33::DEBUG::2014-10-29 11:24:37,955::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:24:37,974::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000446611 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:24:37,976::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:37,977::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:37,977::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:37,977::__init__::232::IOProcess::(_processLogs) (201984) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:37,979::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201984) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:37,981::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:37,981::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:37,982::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:37,983::__init__::232::IOProcess::(_processLogs) (201985) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:37,983::__init__::232::IOProcess::(_processLogs) (201985) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:37,984::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:37,984::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:37,985::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:37,986::__init__::232::IOProcess::(_processLogs) (201986) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:37,986::__init__::232::IOProcess::(_processLogs) (201986) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:37,987::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:37,987::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:37,988::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:37,988::__init__::232::IOProcess::(_processLogs) (201987) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:37,990::__init__::232::IOProcess::(_processLogs) (201987) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:38,024::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:38,026::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:38,033::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:38,036::__init__::232::IOProcess::(_processLogs) (201988) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:24:38,036::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:24:38,038::__init__::232::IOProcess::(_processLogs) (201988) Queuing response >Thread-178::DEBUG::2014-10-29 11:24:38,060::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000506749 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:24:38,065::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:38,065::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:38,066::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:38,067::__init__::232::IOProcess::(_processLogs) (201989) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:38,071::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201989) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:38,073::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:38,074::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:38,075::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:38,075::__init__::232::IOProcess::(_processLogs) (201990) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:38,075::__init__::232::IOProcess::(_processLogs) (201990) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:38,076::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:38,077::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:38,077::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:38,077::__init__::232::IOProcess::(_processLogs) (201991) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:38,078::__init__::232::IOProcess::(_processLogs) (201991) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:38,078::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:38,079::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:38,080::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:38,081::__init__::232::IOProcess::(_processLogs) (201992) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:38,081::__init__::232::IOProcess::(_processLogs) (201992) Queuing response >Detector thread::DEBUG::2014-10-29 11:24:40,242::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54676 >Detector thread::DEBUG::2014-10-29 11:24:40,242::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54676 >Detector thread::DEBUG::2014-10-29 11:24:40,243::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54676 >Detector thread::DEBUG::2014-10-29 11:24:40,243::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54676) >Thread-137037::DEBUG::2014-10-29 11:24:40,283::task::595::Storage.TaskManager.Task::(_updateState) Task=`09da1a67-bf32-4f63-9bad-35f060929f24`::moving from state init -> state preparing >Thread-137037::INFO::2014-10-29 11:24:40,284::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137037::INFO::2014-10-29 11:24:40,284::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506749', 'lastCheck': '2.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446611', 'lastCheck': '2.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418448', 'lastCheck': '2.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000522171', 'lastCheck': '2.9', 'valid': True}} >Thread-137037::DEBUG::2014-10-29 11:24:40,285::task::1191::Storage.TaskManager.Task::(prepare) Task=`09da1a67-bf32-4f63-9bad-35f060929f24`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506749', 'lastCheck': '2.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446611', 'lastCheck': '2.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418448', 'lastCheck': '2.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000522171', 'lastCheck': '2.9', 'valid': True}} >Thread-137037::DEBUG::2014-10-29 11:24:40,285::task::595::Storage.TaskManager.Task::(_updateState) Task=`09da1a67-bf32-4f63-9bad-35f060929f24`::moving from state preparing -> state finished >Thread-137037::DEBUG::2014-10-29 11:24:40,285::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137037::DEBUG::2014-10-29 11:24:40,285::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137037::DEBUG::2014-10-29 11:24:40,286::task::993::Storage.TaskManager.Task::(_decref) Task=`09da1a67-bf32-4f63-9bad-35f060929f24`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:24:40,487::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54677 >Detector thread::DEBUG::2014-10-29 11:24:40,488::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54677 >Detector thread::DEBUG::2014-10-29 11:24:40,488::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54677 >Detector thread::DEBUG::2014-10-29 11:24:40,488::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54677) >Thread-137038::DEBUG::2014-10-29 11:24:40,527::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137038::DEBUG::2014-10-29 11:24:40,529::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137038::DEBUG::2014-10-29 11:24:40,548::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:40,562::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:40,571::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137039::DEBUG::2014-10-29 11:24:40,580::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:40,586::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:40,592::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137040::DEBUG::2014-10-29 11:24:40,601::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137040::DEBUG::2014-10-29 11:24:40,614::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-137038::DEBUG::2014-10-29 11:24:40,643::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '76', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '76', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:24:40,721::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54678 >Detector thread::DEBUG::2014-10-29 11:24:40,722::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54678 >Detector thread::DEBUG::2014-10-29 11:24:40,722::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54678 >Detector thread::DEBUG::2014-10-29 11:24:40,723::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54678) >Thread-137041::DEBUG::2014-10-29 11:24:40,761::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137041::DEBUG::2014-10-29 11:24:40,762::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137041::DEBUG::2014-10-29 11:24:40,763::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.47', 'elapsedTime': '514513', 'displayType': 'vnc', 'cpuSys': '0.47', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '4853981', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '129610', 'readRate': '0.00', 'truesize': '6010888192', 'writeRate': '33912.33'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.65', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:41,210::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:41,212::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:41,213::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:24:43,560::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54681 >Detector thread::DEBUG::2014-10-29 11:24:43,561::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54681 >Detector thread::DEBUG::2014-10-29 11:24:43,561::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54681 >Detector thread::DEBUG::2014-10-29 11:24:43,562::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54681) >Thread-137042::DEBUG::2014-10-29 11:24:43,601::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137042::DEBUG::2014-10-29 11:24:43,602::task::595::Storage.TaskManager.Task::(_updateState) Task=`ed915cf2-22cb-4896-b2f0-095d3dc19fe3`::moving from state init -> state preparing >Thread-137042::INFO::2014-10-29 11:24:43,603::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137042::DEBUG::2014-10-29 11:24:43,606::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:24:43,607::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:43,607::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:43,607::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:43,608::__init__::232::IOProcess::(_processLogs) (201993) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:24:43,609::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201993) Queuing response >Thread-137042::DEBUG::2014-10-29 11:24:43,610::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137042::DEBUG::2014-10-29 11:24:43,610::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137042::INFO::2014-10-29 11:24:43,611::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137042::DEBUG::2014-10-29 11:24:43,611::task::1191::Storage.TaskManager.Task::(prepare) Task=`ed915cf2-22cb-4896-b2f0-095d3dc19fe3`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137042::DEBUG::2014-10-29 11:24:43,611::task::595::Storage.TaskManager.Task::(_updateState) Task=`ed915cf2-22cb-4896-b2f0-095d3dc19fe3`::moving from state preparing -> state finished >Thread-137042::DEBUG::2014-10-29 11:24:43,612::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137042::DEBUG::2014-10-29 11:24:43,612::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137042::DEBUG::2014-10-29 11:24:43,612::task::993::Storage.TaskManager.Task::(_decref) Task=`ed915cf2-22cb-4896-b2f0-095d3dc19fe3`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:43,635::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:43,638::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137043::DEBUG::2014-10-29 11:24:43,641::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:43,644::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:43,646::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137044::DEBUG::2014-10-29 11:24:43,649::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137044::DEBUG::2014-10-29 11:24:43,651::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:24:43,658::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54682 >Detector thread::DEBUG::2014-10-29 11:24:43,658::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54682 >Detector thread::DEBUG::2014-10-29 11:24:43,659::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54682 >Detector thread::DEBUG::2014-10-29 11:24:43,659::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54682) >Thread-137045::DEBUG::2014-10-29 11:24:43,698::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137045::DEBUG::2014-10-29 11:24:43,699::task::595::Storage.TaskManager.Task::(_updateState) Task=`de4a3be9-93c4-47c2-9a68-d354512b94df`::moving from state init -> state preparing >Thread-137045::INFO::2014-10-29 11:24:43,699::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137045::DEBUG::2014-10-29 11:24:43,699::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137045::DEBUG::2014-10-29 11:24:43,700::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137045::DEBUG::2014-10-29 11:24:43,700::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137045::DEBUG::2014-10-29 11:24:43,700::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137045::DEBUG::2014-10-29 11:24:43,701::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137045::DEBUG::2014-10-29 11:24:43,701::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137045::DEBUG::2014-10-29 11:24:43,792::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137045::DEBUG::2014-10-29 11:24:43,793::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137045::DEBUG::2014-10-29 11:24:43,959::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137045::DEBUG::2014-10-29 11:24:43,960::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137045::DEBUG::2014-10-29 11:24:43,960::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137045::DEBUG::2014-10-29 11:24:43,961::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137045::DEBUG::2014-10-29 11:24:43,961::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137045::DEBUG::2014-10-29 11:24:43,962::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137045::DEBUG::2014-10-29 11:24:43,962::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137045::DEBUG::2014-10-29 11:24:43,962::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:24:43,970::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:43,972::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:43,972::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:43,973::__init__::232::IOProcess::(_processLogs) (201994) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:24:43,974::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201994) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:43,975::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:43,976::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:43,978::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:43,981::__init__::232::IOProcess::(_processLogs) (201995) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:24:43,983::__init__::232::IOProcess::(_processLogs) (201995) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:43,984::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:43,986::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:43,988::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-137045::DEBUG::2014-10-29 11:24:43,989::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:24:43,990::__init__::232::IOProcess::(_processLogs) (201996) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:24:43,992::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201996) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:43,993::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:43,994::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:43,995::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:43,995::__init__::232::IOProcess::(_processLogs) (201997) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:24:43,996::__init__::232::IOProcess::(_processLogs) (201997) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:43,996::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:43,997::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:43,997::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:43,997::__init__::232::IOProcess::(_processLogs) (201998) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:24:44,010::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201998) Queuing response >Thread-137045::DEBUG::2014-10-29 11:24:44,011::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:24:44,012::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:44,013::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:44,013::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:44,013::__init__::232::IOProcess::(_processLogs) (201999) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:24:44,013::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(201999) Queuing response >Thread-137045::DEBUG::2014-10-29 11:24:44,014::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:24:44,015::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:44,016::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:44,016::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:44,017::__init__::232::IOProcess::(_processLogs) (202000) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:44,017::__init__::232::IOProcess::(_processLogs) (202000) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:44,018::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:44,018::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:44,019::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-137045::DEBUG::2014-10-29 11:24:44,019::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:24:44,021::__init__::232::IOProcess::(_processLogs) (202001) Got request for method 'glob' >Thread-137045::INFO::2014-10-29 11:24:44,021::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137045::INFO::2014-10-29 11:24:44,022::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:24:44,022::__init__::232::IOProcess::(_processLogs) (202001) Queuing response >Thread-137045::INFO::2014-10-29 11:24:44,024::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:24:44,025::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:44,025::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:44,025::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:44,026::__init__::232::IOProcess::(_processLogs) (202002) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:24:44,027::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202002) Queuing response >Thread-137045::DEBUG::2014-10-29 11:24:44,027::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137045::DEBUG::2014-10-29 11:24:44,029::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`49a9c48f-4bbb-4420-8335-e16e170736e4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137045::DEBUG::2014-10-29 11:24:44,029::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137045::DEBUG::2014-10-29 11:24:44,030::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137045::DEBUG::2014-10-29 11:24:44,030::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`49a9c48f-4bbb-4420-8335-e16e170736e4`::Granted request >Thread-137045::DEBUG::2014-10-29 11:24:44,031::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`de4a3be9-93c4-47c2-9a68-d354512b94df`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137045::DEBUG::2014-10-29 11:24:44,031::task::993::Storage.TaskManager.Task::(_decref) Task=`de4a3be9-93c4-47c2-9a68-d354512b94df`::ref 1 aborting False >Thread-137045::INFO::2014-10-29 11:24:44,034::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137045::DEBUG::2014-10-29 11:24:44,034::task::1191::Storage.TaskManager.Task::(prepare) Task=`de4a3be9-93c4-47c2-9a68-d354512b94df`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137045::DEBUG::2014-10-29 11:24:44,034::task::595::Storage.TaskManager.Task::(_updateState) Task=`de4a3be9-93c4-47c2-9a68-d354512b94df`::moving from state preparing -> state finished >Thread-137045::DEBUG::2014-10-29 11:24:44,035::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137045::DEBUG::2014-10-29 11:24:44,035::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137045::DEBUG::2014-10-29 11:24:44,035::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137045::DEBUG::2014-10-29 11:24:44,036::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137045::DEBUG::2014-10-29 11:24:44,036::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137045::DEBUG::2014-10-29 11:24:44,036::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137045::DEBUG::2014-10-29 11:24:44,036::task::993::Storage.TaskManager.Task::(_decref) Task=`de4a3be9-93c4-47c2-9a68-d354512b94df`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:24:44,059::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54683 >Detector thread::DEBUG::2014-10-29 11:24:44,059::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54683 >Detector thread::DEBUG::2014-10-29 11:24:44,060::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54683 >Detector thread::DEBUG::2014-10-29 11:24:44,060::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54683) >Thread-137050::DEBUG::2014-10-29 11:24:44,101::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137050::DEBUG::2014-10-29 11:24:44,102::task::595::Storage.TaskManager.Task::(_updateState) Task=`c1611ccc-a3cc-456c-92ca-e1eb362ff769`::moving from state init -> state preparing >Thread-137050::INFO::2014-10-29 11:24:44,103::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137050::INFO::2014-10-29 11:24:44,106::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506749', 'lastCheck': '6.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446611', 'lastCheck': '6.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418448', 'lastCheck': '6.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000522171', 'lastCheck': '6.7', 'valid': True}} >Thread-137050::DEBUG::2014-10-29 11:24:44,107::task::1191::Storage.TaskManager.Task::(prepare) Task=`c1611ccc-a3cc-456c-92ca-e1eb362ff769`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506749', 'lastCheck': '6.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446611', 'lastCheck': '6.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418448', 'lastCheck': '6.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000522171', 'lastCheck': '6.7', 'valid': True}} >Thread-137050::DEBUG::2014-10-29 11:24:44,107::task::595::Storage.TaskManager.Task::(_updateState) Task=`c1611ccc-a3cc-456c-92ca-e1eb362ff769`::moving from state preparing -> state finished >Thread-137050::DEBUG::2014-10-29 11:24:44,108::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137050::DEBUG::2014-10-29 11:24:44,108::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137050::DEBUG::2014-10-29 11:24:44,109::task::993::Storage.TaskManager.Task::(_decref) Task=`c1611ccc-a3cc-456c-92ca-e1eb362ff769`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:46,223::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:46,229::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:46,234::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:46,678::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:46,683::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137051::DEBUG::2014-10-29 11:24:46,692::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:46,698::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:46,702::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137052::DEBUG::2014-10-29 11:24:46,711::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137052::DEBUG::2014-10-29 11:24:46,728::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:24:47,389::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:47,390::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:47,391::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-179::DEBUG::2014-10-29 11:24:47,392::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:24:47,393::__init__::232::IOProcess::(_processLogs) (202003) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:47,417::__init__::232::IOProcess::(_processLogs) (202003) Queuing response >Thread-179::DEBUG::2014-10-29 11:24:47,419::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000620799 s, 599 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:24:47,422::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:47,423::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:47,423::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:47,423::__init__::232::IOProcess::(_processLogs) (202004) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:47,423::__init__::232::IOProcess::(_processLogs) (202004) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:47,431::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:47,432::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:47,432::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:47,432::__init__::232::IOProcess::(_processLogs) (202005) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:47,433::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202005) Queuing response >Thread-10269::DEBUG::2014-10-29 11:24:47,439::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:24:47,459::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000508938 s, 986 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:24:47,461::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:47,462::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:47,462::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:47,462::__init__::232::IOProcess::(_processLogs) (202006) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:47,463::__init__::232::IOProcess::(_processLogs) (202006) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:47,991::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:47,993::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:47,994::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:47,995::__init__::232::IOProcess::(_processLogs) (202007) Got request for method 'statvfs' >Thread-33::DEBUG::2014-10-29 11:24:47,995::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:24:47,996::__init__::232::IOProcess::(_processLogs) (202007) Queuing response >Thread-33::DEBUG::2014-10-29 11:24:48,013::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000522104 s, 933 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:24:48,015::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:48,016::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:48,016::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:48,016::__init__::232::IOProcess::(_processLogs) (202008) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:48,016::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202008) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:48,018::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:48,019::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:48,020::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:48,020::__init__::232::IOProcess::(_processLogs) (202009) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:48,021::__init__::232::IOProcess::(_processLogs) (202009) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:48,021::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:48,022::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:48,023::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:48,023::__init__::232::IOProcess::(_processLogs) (202010) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:48,023::__init__::232::IOProcess::(_processLogs) (202010) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:48,024::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:48,025::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:48,025::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:48,027::__init__::232::IOProcess::(_processLogs) (202011) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:48,027::__init__::232::IOProcess::(_processLogs) (202011) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:48,082::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:48,082::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:48,083::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:48,083::__init__::232::IOProcess::(_processLogs) (202012) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:48,084::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202012) Queuing response >Thread-178::DEBUG::2014-10-29 11:24:48,086::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:24:48,103::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000484121 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:24:48,104::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:48,105::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:48,105::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:48,105::__init__::232::IOProcess::(_processLogs) (202013) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:48,106::__init__::232::IOProcess::(_processLogs) (202013) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:48,108::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:48,109::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:48,109::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:48,110::__init__::232::IOProcess::(_processLogs) (202014) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:48,110::__init__::232::IOProcess::(_processLogs) (202014) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:48,112::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:48,112::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:48,112::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:48,113::__init__::232::IOProcess::(_processLogs) (202015) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:48,113::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202015) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:48,114::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:48,115::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:48,116::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:48,117::__init__::232::IOProcess::(_processLogs) (202016) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:48,118::__init__::232::IOProcess::(_processLogs) (202016) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:49,743::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:49,745::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137053::DEBUG::2014-10-29 11:24:49,749::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b55fb3f-1791-4f85-8ad3-ded5ca63c525`::moving from state init -> state preparing >Thread-137053::INFO::2014-10-29 11:24:49,749::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137053::INFO::2014-10-29 11:24:49,750::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484121', 'lastCheck': '1.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522104', 'lastCheck': '1.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620799', 'lastCheck': '2.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000508938', 'lastCheck': '2.3', 'valid': True}} >Thread-137053::DEBUG::2014-10-29 11:24:49,750::task::1191::Storage.TaskManager.Task::(prepare) Task=`5b55fb3f-1791-4f85-8ad3-ded5ca63c525`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484121', 'lastCheck': '1.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522104', 'lastCheck': '1.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620799', 'lastCheck': '2.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000508938', 'lastCheck': '2.3', 'valid': True}} >Thread-137053::DEBUG::2014-10-29 11:24:49,751::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b55fb3f-1791-4f85-8ad3-ded5ca63c525`::moving from state preparing -> state finished >Thread-137053::DEBUG::2014-10-29 11:24:49,751::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137053::DEBUG::2014-10-29 11:24:49,751::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137053::DEBUG::2014-10-29 11:24:49,751::task::993::Storage.TaskManager.Task::(_decref) Task=`5b55fb3f-1791-4f85-8ad3-ded5ca63c525`::ref 0 aborting False >Thread-137053::DEBUG::2014-10-29 11:24:49,788::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:49,809::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:49,811::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137054::DEBUG::2014-10-29 11:24:49,815::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137054::DEBUG::2014-10-29 11:24:49,818::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:24:50,113::task::595::Storage.TaskManager.Task::(_updateState) Task=`51988764-b1c3-4912-94f7-22d1985d6f60`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:24:50,113::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:24:50,114::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:50,114::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:50,115::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:50,115::__init__::232::IOProcess::(_processLogs) (202017) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:24:50,116::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202017) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:50,117::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:50,118::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:50,118::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:50,118::__init__::232::IOProcess::(_processLogs) (202018) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:24:50,119::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202018) Queuing response >Thread-22::INFO::2014-10-29 11:24:50,120::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010888192', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:24:50,121::task::1191::Storage.TaskManager.Task::(prepare) Task=`51988764-b1c3-4912-94f7-22d1985d6f60`::finished: {'truesize': '6010888192', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:24:50,121::task::595::Storage.TaskManager.Task::(_updateState) Task=`51988764-b1c3-4912-94f7-22d1985d6f60`::moving from state preparing -> state finished >Thread-22::DEBUG::2014-10-29 11:24:50,121::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-10-29 11:24:50,121::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2014-10-29 11:24:50,122::task::993::Storage.TaskManager.Task::(_decref) Task=`51988764-b1c3-4912-94f7-22d1985d6f60`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:24:50,194::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Detector thread::DEBUG::2014-10-29 11:24:50,336::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54684 >Detector thread::DEBUG::2014-10-29 11:24:50,337::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54684 >Detector thread::DEBUG::2014-10-29 11:24:50,337::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54684 >Detector thread::DEBUG::2014-10-29 11:24:50,338::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54684) >Thread-137055::DEBUG::2014-10-29 11:24:50,378::task::595::Storage.TaskManager.Task::(_updateState) Task=`fdc63bc0-2956-4caa-a738-818a4350e920`::moving from state init -> state preparing >Thread-137055::INFO::2014-10-29 11:24:50,378::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137055::INFO::2014-10-29 11:24:50,379::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484121', 'lastCheck': '2.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522104', 'lastCheck': '2.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620799', 'lastCheck': '3.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000508938', 'lastCheck': '2.9', 'valid': True}} >Thread-137055::DEBUG::2014-10-29 11:24:50,379::task::1191::Storage.TaskManager.Task::(prepare) Task=`fdc63bc0-2956-4caa-a738-818a4350e920`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484121', 'lastCheck': '2.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522104', 'lastCheck': '2.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620799', 'lastCheck': '3.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000508938', 'lastCheck': '2.9', 'valid': True}} >Thread-137055::DEBUG::2014-10-29 11:24:50,379::task::595::Storage.TaskManager.Task::(_updateState) Task=`fdc63bc0-2956-4caa-a738-818a4350e920`::moving from state preparing -> state finished >Thread-137055::DEBUG::2014-10-29 11:24:50,380::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137055::DEBUG::2014-10-29 11:24:50,380::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137055::DEBUG::2014-10-29 11:24:50,380::task::993::Storage.TaskManager.Task::(_decref) Task=`fdc63bc0-2956-4caa-a738-818a4350e920`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:24:50,691::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54685 >Detector thread::DEBUG::2014-10-29 11:24:50,692::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54685 >Detector thread::DEBUG::2014-10-29 11:24:50,692::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54685 >Detector thread::DEBUG::2014-10-29 11:24:50,693::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54685) >Thread-137056::DEBUG::2014-10-29 11:24:50,732::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137056::DEBUG::2014-10-29 11:24:50,734::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137056::DEBUG::2014-10-29 11:24:50,753::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137056::DEBUG::2014-10-29 11:24:50,799::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '61', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '61', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:24:50,923::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54686 >Detector thread::DEBUG::2014-10-29 11:24:50,923::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54686 >Detector thread::DEBUG::2014-10-29 11:24:50,923::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54686 >Detector thread::DEBUG::2014-10-29 11:24:50,924::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54686) >Thread-137057::DEBUG::2014-10-29 11:24:50,963::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137057::DEBUG::2014-10-29 11:24:50,964::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137057::DEBUG::2014-10-29 11:24:50,965::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.91', 'elapsedTime': '514523', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '3251662', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '59148', 'readRate': '0.00', 'truesize': '6010888192', 'writeRate': '33909.24'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.85', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:51,241::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:51,243::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:51,245::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:52,859::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:52,862::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137058::DEBUG::2014-10-29 11:24:52,866::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:52,868::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:52,870::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137059::DEBUG::2014-10-29 11:24:52,874::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137059::DEBUG::2014-10-29 11:24:52,878::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:24:54,706::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54689 >Detector thread::DEBUG::2014-10-29 11:24:54,709::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54689 >Detector thread::DEBUG::2014-10-29 11:24:54,709::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54689 >Detector thread::DEBUG::2014-10-29 11:24:54,709::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54689) >Thread-137060::DEBUG::2014-10-29 11:24:54,747::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137060::DEBUG::2014-10-29 11:24:54,748::task::595::Storage.TaskManager.Task::(_updateState) Task=`446da9b0-8f40-4022-b844-53517e37b357`::moving from state init -> state preparing >Thread-137060::INFO::2014-10-29 11:24:54,748::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137060::DEBUG::2014-10-29 11:24:54,752::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:24:54,753::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:54,753::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:54,753::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:54,754::__init__::232::IOProcess::(_processLogs) (202019) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:24:54,754::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202019) Queuing response >Thread-137060::DEBUG::2014-10-29 11:24:54,755::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137060::DEBUG::2014-10-29 11:24:54,756::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137060::INFO::2014-10-29 11:24:54,756::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137060::DEBUG::2014-10-29 11:24:54,756::task::1191::Storage.TaskManager.Task::(prepare) Task=`446da9b0-8f40-4022-b844-53517e37b357`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137060::DEBUG::2014-10-29 11:24:54,757::task::595::Storage.TaskManager.Task::(_updateState) Task=`446da9b0-8f40-4022-b844-53517e37b357`::moving from state preparing -> state finished >Thread-137060::DEBUG::2014-10-29 11:24:54,757::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137060::DEBUG::2014-10-29 11:24:54,757::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137060::DEBUG::2014-10-29 11:24:54,757::task::993::Storage.TaskManager.Task::(_decref) Task=`446da9b0-8f40-4022-b844-53517e37b357`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:24:54,803::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54690 >Detector thread::DEBUG::2014-10-29 11:24:54,804::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54690 >Detector thread::DEBUG::2014-10-29 11:24:54,804::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54690 >Detector thread::DEBUG::2014-10-29 11:24:54,805::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54690) >Thread-137061::DEBUG::2014-10-29 11:24:54,843::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137061::DEBUG::2014-10-29 11:24:54,843::task::595::Storage.TaskManager.Task::(_updateState) Task=`1684dc1e-4320-4552-b22f-4a7924fba6b5`::moving from state init -> state preparing >Thread-137061::INFO::2014-10-29 11:24:54,844::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137061::DEBUG::2014-10-29 11:24:54,844::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137061::DEBUG::2014-10-29 11:24:54,844::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137061::DEBUG::2014-10-29 11:24:54,845::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137061::DEBUG::2014-10-29 11:24:54,845::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137061::DEBUG::2014-10-29 11:24:54,845::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137061::DEBUG::2014-10-29 11:24:54,846::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137061::DEBUG::2014-10-29 11:24:54,945::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137061::DEBUG::2014-10-29 11:24:54,945::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137061::DEBUG::2014-10-29 11:24:55,120::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137061::DEBUG::2014-10-29 11:24:55,121::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137061::DEBUG::2014-10-29 11:24:55,122::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137061::DEBUG::2014-10-29 11:24:55,122::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137061::DEBUG::2014-10-29 11:24:55,122::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137061::DEBUG::2014-10-29 11:24:55,123::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137061::DEBUG::2014-10-29 11:24:55,123::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137061::DEBUG::2014-10-29 11:24:55,124::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:24:55,131::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:55,134::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:55,134::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:55,134::__init__::232::IOProcess::(_processLogs) (202020) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:24:55,135::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202020) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:55,137::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:55,137::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:55,138::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:55,138::__init__::232::IOProcess::(_processLogs) (202021) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:24:55,138::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:55,138::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:55,138::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:55,139::__init__::232::IOProcess::(_processLogs) (202022) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:24:55,139::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:55,139::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:55,140::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:55,140::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202023) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:24:55,142::__init__::232::IOProcess::(_processLogs) (202021) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:55,144::__init__::232::IOProcess::(_processLogs) (202022) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:55,145::__init__::232::IOProcess::(_processLogs) (202023) Queuing response >Thread-137061::DEBUG::2014-10-29 11:24:55,152::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:24:55,153::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:55,154::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:55,154::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:55,154::__init__::232::IOProcess::(_processLogs) (202024) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:24:55,155::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202024) Queuing response >Thread-137061::DEBUG::2014-10-29 11:24:55,155::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:24:55,156::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:55,157::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:55,157::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:55,157::__init__::232::IOProcess::(_processLogs) (202025) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:24:55,158::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202025) Queuing response >Thread-137061::DEBUG::2014-10-29 11:24:55,158::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:24:55,160::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:55,161::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:55,162::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:55,162::__init__::232::IOProcess::(_processLogs) (202026) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:55,162::__init__::232::IOProcess::(_processLogs) (202026) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:55,163::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:55,163::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:55,163::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:55,164::__init__::232::IOProcess::(_processLogs) (202027) Got request for method 'glob' >Thread-137061::DEBUG::2014-10-29 11:24:55,164::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:24:55,164::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202027) Queuing response >Thread-137061::INFO::2014-10-29 11:24:55,165::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137061::INFO::2014-10-29 11:24:55,166::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137061::INFO::2014-10-29 11:24:55,167::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:24:55,167::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:55,168::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:55,168::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:55,168::__init__::232::IOProcess::(_processLogs) (202028) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:24:55,169::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202028) Queuing response >Thread-137061::DEBUG::2014-10-29 11:24:55,169::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137061::DEBUG::2014-10-29 11:24:55,171::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`0c6ba842-06fa-4b00-8bcd-2c415e8bda78`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137061::DEBUG::2014-10-29 11:24:55,172::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137061::DEBUG::2014-10-29 11:24:55,172::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137061::DEBUG::2014-10-29 11:24:55,172::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`0c6ba842-06fa-4b00-8bcd-2c415e8bda78`::Granted request >Thread-137061::DEBUG::2014-10-29 11:24:55,173::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1684dc1e-4320-4552-b22f-4a7924fba6b5`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137061::DEBUG::2014-10-29 11:24:55,173::task::993::Storage.TaskManager.Task::(_decref) Task=`1684dc1e-4320-4552-b22f-4a7924fba6b5`::ref 1 aborting False >Thread-137061::INFO::2014-10-29 11:24:55,176::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137061::DEBUG::2014-10-29 11:24:55,177::task::1191::Storage.TaskManager.Task::(prepare) Task=`1684dc1e-4320-4552-b22f-4a7924fba6b5`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137061::DEBUG::2014-10-29 11:24:55,177::task::595::Storage.TaskManager.Task::(_updateState) Task=`1684dc1e-4320-4552-b22f-4a7924fba6b5`::moving from state preparing -> state finished >Thread-137061::DEBUG::2014-10-29 11:24:55,177::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137061::DEBUG::2014-10-29 11:24:55,178::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137061::DEBUG::2014-10-29 11:24:55,178::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137061::DEBUG::2014-10-29 11:24:55,178::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137061::DEBUG::2014-10-29 11:24:55,179::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137061::DEBUG::2014-10-29 11:24:55,179::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137061::DEBUG::2014-10-29 11:24:55,179::task::993::Storage.TaskManager.Task::(_decref) Task=`1684dc1e-4320-4552-b22f-4a7924fba6b5`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:24:55,201::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54691 >Detector thread::DEBUG::2014-10-29 11:24:55,202::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54691 >Detector thread::DEBUG::2014-10-29 11:24:55,202::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54691 >Detector thread::DEBUG::2014-10-29 11:24:55,203::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54691) >Thread-137066::DEBUG::2014-10-29 11:24:55,242::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137066::DEBUG::2014-10-29 11:24:55,242::task::595::Storage.TaskManager.Task::(_updateState) Task=`f65ffbba-56ee-4b98-ac4e-19d58f4d10ad`::moving from state init -> state preparing >Thread-137066::INFO::2014-10-29 11:24:55,243::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137066::INFO::2014-10-29 11:24:55,243::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484121', 'lastCheck': '7.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522104', 'lastCheck': '7.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620799', 'lastCheck': '7.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000508938', 'lastCheck': '7.8', 'valid': True}} >Thread-137066::DEBUG::2014-10-29 11:24:55,244::task::1191::Storage.TaskManager.Task::(prepare) Task=`f65ffbba-56ee-4b98-ac4e-19d58f4d10ad`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000484121', 'lastCheck': '7.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522104', 'lastCheck': '7.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620799', 'lastCheck': '7.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000508938', 'lastCheck': '7.8', 'valid': True}} >Thread-137066::DEBUG::2014-10-29 11:24:55,244::task::595::Storage.TaskManager.Task::(_updateState) Task=`f65ffbba-56ee-4b98-ac4e-19d58f4d10ad`::moving from state preparing -> state finished >Thread-137066::DEBUG::2014-10-29 11:24:55,244::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137066::DEBUG::2014-10-29 11:24:55,245::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137066::DEBUG::2014-10-29 11:24:55,245::task::993::Storage.TaskManager.Task::(_decref) Task=`f65ffbba-56ee-4b98-ac4e-19d58f4d10ad`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:55,894::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:55,897::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137067::DEBUG::2014-10-29 11:24:55,900::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:55,902::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:55,904::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137068::DEBUG::2014-10-29 11:24:55,907::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137068::DEBUG::2014-10-29 11:24:55,909::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:56,251::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:56,252::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:24:56,255::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:24:57,428::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:57,429::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:57,429::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:57,429::__init__::232::IOProcess::(_processLogs) (202029) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:57,429::__init__::232::IOProcess::(_processLogs) (202029) Queuing response >Thread-179::DEBUG::2014-10-29 11:24:57,431::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:24:57,448::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000519636 s, 716 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:24:57,450::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:57,450::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:57,450::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:57,451::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202030) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:57,451::__init__::232::IOProcess::(_processLogs) (202030) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:57,472::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:57,473::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:57,473::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:57,473::__init__::232::IOProcess::(_processLogs) (202031) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:57,474::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202031) Queuing response >Thread-10269::DEBUG::2014-10-29 11:24:57,475::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:24:57,492::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000484338 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:24:57,494::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:57,494::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:57,495::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:57,495::__init__::232::IOProcess::(_processLogs) (202032) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:57,496::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202032) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:58,028::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:58,029::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:58,029::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:58,030::__init__::232::IOProcess::(_processLogs) (202033) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:58,031::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202033) Queuing response >Thread-33::DEBUG::2014-10-29 11:24:58,033::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:24:58,049::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000525592 s, 927 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:24:58,051::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:58,052::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:58,052::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:58,052::__init__::232::IOProcess::(_processLogs) (202034) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:58,052::__init__::232::IOProcess::(_processLogs) (202034) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:58,054::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:58,055::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:58,056::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:58,056::__init__::232::IOProcess::(_processLogs) (202035) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:58,057::__init__::232::IOProcess::(_processLogs) (202035) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:58,057::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:58,058::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:58,059::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:58,059::__init__::232::IOProcess::(_processLogs) (202036) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:58,060::__init__::232::IOProcess::(_processLogs) (202036) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:58,060::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:58,061::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:58,061::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:58,063::__init__::232::IOProcess::(_processLogs) (202037) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:58,063::__init__::232::IOProcess::(_processLogs) (202037) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:58,118::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:58,119::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:58,120::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:58,120::__init__::232::IOProcess::(_processLogs) (202038) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:58,120::__init__::232::IOProcess::(_processLogs) (202038) Queuing response >Thread-178::DEBUG::2014-10-29 11:24:58,121::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:24:58,137::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000521772 s, 974 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:24:58,139::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:58,139::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:58,139::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:58,140::__init__::232::IOProcess::(_processLogs) (202039) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:24:58,140::__init__::232::IOProcess::(_processLogs) (202039) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:58,142::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:58,143::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:58,144::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:58,144::__init__::232::IOProcess::(_processLogs) (202040) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:58,144::__init__::232::IOProcess::(_processLogs) (202040) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:58,145::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:58,146::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:58,147::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:58,147::__init__::232::IOProcess::(_processLogs) (202041) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:58,147::__init__::232::IOProcess::(_processLogs) (202041) Queuing response >Thread-17::DEBUG::2014-10-29 11:24:58,148::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:24:58,148::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:24:58,149::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:24:58,150::__init__::232::IOProcess::(_processLogs) (202042) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:24:58,150::__init__::232::IOProcess::(_processLogs) (202042) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:58,923::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:58,926::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137069::DEBUG::2014-10-29 11:24:58,930::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:24:58,932::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:24:58,934::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137070::DEBUG::2014-10-29 11:24:58,937::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137070::DEBUG::2014-10-29 11:24:58,940::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:25:00,438::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54692 >Detector thread::DEBUG::2014-10-29 11:25:00,439::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54692 >Detector thread::DEBUG::2014-10-29 11:25:00,439::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54692 >Detector thread::DEBUG::2014-10-29 11:25:00,440::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54692) >Thread-137071::DEBUG::2014-10-29 11:25:00,480::task::595::Storage.TaskManager.Task::(_updateState) Task=`758c4d58-55ef-4a5f-9489-6a3078268099`::moving from state init -> state preparing >Thread-137071::INFO::2014-10-29 11:25:00,480::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137071::INFO::2014-10-29 11:25:00,481::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521772', 'lastCheck': '2.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525592', 'lastCheck': '2.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519636', 'lastCheck': '3.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000484338', 'lastCheck': '3.0', 'valid': True}} >Thread-137071::DEBUG::2014-10-29 11:25:00,481::task::1191::Storage.TaskManager.Task::(prepare) Task=`758c4d58-55ef-4a5f-9489-6a3078268099`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521772', 'lastCheck': '2.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525592', 'lastCheck': '2.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519636', 'lastCheck': '3.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000484338', 'lastCheck': '3.0', 'valid': True}} >Thread-137071::DEBUG::2014-10-29 11:25:00,482::task::595::Storage.TaskManager.Task::(_updateState) Task=`758c4d58-55ef-4a5f-9489-6a3078268099`::moving from state preparing -> state finished >Thread-137071::DEBUG::2014-10-29 11:25:00,482::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137071::DEBUG::2014-10-29 11:25:00,482::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137071::DEBUG::2014-10-29 11:25:00,482::task::993::Storage.TaskManager.Task::(_decref) Task=`758c4d58-55ef-4a5f-9489-6a3078268099`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:25:00,839::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54693 >Detector thread::DEBUG::2014-10-29 11:25:00,840::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54693 >Detector thread::DEBUG::2014-10-29 11:25:00,840::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54693 >Detector thread::DEBUG::2014-10-29 11:25:00,840::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54693) >Thread-137072::DEBUG::2014-10-29 11:25:00,879::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137072::DEBUG::2014-10-29 11:25:00,881::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137072::DEBUG::2014-10-29 11:25:00,902::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137072::DEBUG::2014-10-29 11:25:00,950::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '46', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '46', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:25:01,114::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54694 >Detector thread::DEBUG::2014-10-29 11:25:01,115::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54694 >Detector thread::DEBUG::2014-10-29 11:25:01,115::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54694 >Detector thread::DEBUG::2014-10-29 11:25:01,116::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54694) >Thread-137073::DEBUG::2014-10-29 11:25:01,155::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137073::DEBUG::2014-10-29 11:25:01,156::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137073::DEBUG::2014-10-29 11:25:01,157::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.91', 'elapsedTime': '514533', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '3251662', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '59148', 'readRate': '0.00', 'truesize': '6010888192', 'writeRate': '33909.24'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.96', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:01,262::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:01,263::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:01,265::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:01,953::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:01,955::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137074::DEBUG::2014-10-29 11:25:01,959::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:01,965::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:01,966::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137075::DEBUG::2014-10-29 11:25:01,969::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137075::DEBUG::2014-10-29 11:25:01,971::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:25:04,524::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:04,984::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:04,987::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137076::DEBUG::2014-10-29 11:25:04,991::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b8ac42a-b875-4241-97ef-856a287c69db`::moving from state init -> state preparing >Thread-137076::INFO::2014-10-29 11:25:04,991::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137076::INFO::2014-10-29 11:25:04,992::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521772', 'lastCheck': '6.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525592', 'lastCheck': '6.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519636', 'lastCheck': '7.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000484338', 'lastCheck': '7.5', 'valid': True}} >Thread-137076::DEBUG::2014-10-29 11:25:04,992::task::1191::Storage.TaskManager.Task::(prepare) Task=`4b8ac42a-b875-4241-97ef-856a287c69db`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521772', 'lastCheck': '6.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525592', 'lastCheck': '6.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519636', 'lastCheck': '7.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000484338', 'lastCheck': '7.5', 'valid': True}} >Thread-137076::DEBUG::2014-10-29 11:25:04,993::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b8ac42a-b875-4241-97ef-856a287c69db`::moving from state preparing -> state finished >Thread-137076::DEBUG::2014-10-29 11:25:04,993::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137076::DEBUG::2014-10-29 11:25:04,993::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137076::DEBUG::2014-10-29 11:25:04,993::task::993::Storage.TaskManager.Task::(_decref) Task=`4b8ac42a-b875-4241-97ef-856a287c69db`::ref 0 aborting False >Thread-137076::DEBUG::2014-10-29 11:25:05,028::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:05,049::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:05,052::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137077::DEBUG::2014-10-29 11:25:05,055::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137077::DEBUG::2014-10-29 11:25:05,057::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:25:05,221::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Detector thread::DEBUG::2014-10-29 11:25:05,852::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54697 >Detector thread::DEBUG::2014-10-29 11:25:05,855::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54697 >Detector thread::DEBUG::2014-10-29 11:25:05,856::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54697 >Detector thread::DEBUG::2014-10-29 11:25:05,856::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54697) >Thread-137078::DEBUG::2014-10-29 11:25:05,893::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137078::DEBUG::2014-10-29 11:25:05,893::task::595::Storage.TaskManager.Task::(_updateState) Task=`46668394-7314-4365-8823-0d195a3a91ee`::moving from state init -> state preparing >Thread-137078::INFO::2014-10-29 11:25:05,894::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137078::DEBUG::2014-10-29 11:25:05,898::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:25:05,899::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:05,899::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:05,900::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:05,900::__init__::232::IOProcess::(_processLogs) (202043) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:25:05,902::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202043) Queuing response >Thread-137078::DEBUG::2014-10-29 11:25:05,903::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137078::DEBUG::2014-10-29 11:25:05,903::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137078::INFO::2014-10-29 11:25:05,903::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137078::DEBUG::2014-10-29 11:25:05,904::task::1191::Storage.TaskManager.Task::(prepare) Task=`46668394-7314-4365-8823-0d195a3a91ee`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137078::DEBUG::2014-10-29 11:25:05,904::task::595::Storage.TaskManager.Task::(_updateState) Task=`46668394-7314-4365-8823-0d195a3a91ee`::moving from state preparing -> state finished >Thread-137078::DEBUG::2014-10-29 11:25:05,904::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137078::DEBUG::2014-10-29 11:25:05,904::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137078::DEBUG::2014-10-29 11:25:05,905::task::993::Storage.TaskManager.Task::(_decref) Task=`46668394-7314-4365-8823-0d195a3a91ee`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:25:05,949::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54698 >Detector thread::DEBUG::2014-10-29 11:25:05,949::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54698 >Detector thread::DEBUG::2014-10-29 11:25:05,949::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54698 >Detector thread::DEBUG::2014-10-29 11:25:05,950::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54698) >Thread-137079::DEBUG::2014-10-29 11:25:05,989::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137079::DEBUG::2014-10-29 11:25:05,989::task::595::Storage.TaskManager.Task::(_updateState) Task=`55ba8834-db78-4ea4-8ef4-a59831e24a38`::moving from state init -> state preparing >Thread-137079::INFO::2014-10-29 11:25:05,990::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137079::DEBUG::2014-10-29 11:25:05,990::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137079::DEBUG::2014-10-29 11:25:05,990::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137079::DEBUG::2014-10-29 11:25:05,991::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137079::DEBUG::2014-10-29 11:25:05,991::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137079::DEBUG::2014-10-29 11:25:05,991::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137079::DEBUG::2014-10-29 11:25:05,992::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137079::DEBUG::2014-10-29 11:25:06,109::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137079::DEBUG::2014-10-29 11:25:06,110::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:06,272::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:06,274::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:06,277::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137079::DEBUG::2014-10-29 11:25:06,360::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137079::DEBUG::2014-10-29 11:25:06,361::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137079::DEBUG::2014-10-29 11:25:06,361::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137079::DEBUG::2014-10-29 11:25:06,362::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137079::DEBUG::2014-10-29 11:25:06,362::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137079::DEBUG::2014-10-29 11:25:06,362::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137079::DEBUG::2014-10-29 11:25:06,363::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137079::DEBUG::2014-10-29 11:25:06,363::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:25:06,371::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:06,373::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:06,375::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:06,375::__init__::232::IOProcess::(_processLogs) (202044) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:25:06,376::__init__::232::IOProcess::(_processLogs) (202044) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:06,377::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:06,377::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:06,378::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:06,378::__init__::232::IOProcess::(_processLogs) (202045) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:25:06,379::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202045) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:06,380::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:06,380::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:06,380::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:06,381::__init__::232::IOProcess::(_processLogs) (202046) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:25:06,382::__init__::232::IOProcess::(_processLogs) (202046) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:06,388::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:06,390::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:06,392::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:06,394::__init__::232::IOProcess::(_processLogs) (202047) Got request for method 'glob' >Thread-137079::DEBUG::2014-10-29 11:25:06,394::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:25:06,397::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202047) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:06,398::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:06,398::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:06,399::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:06,399::__init__::232::IOProcess::(_processLogs) (202048) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:25:06,400::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202048) Queuing response >Thread-137079::DEBUG::2014-10-29 11:25:06,401::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:25:06,402::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:06,402::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:06,403::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:06,403::__init__::232::IOProcess::(_processLogs) (202049) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:25:06,404::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202049) Queuing response >Thread-137079::DEBUG::2014-10-29 11:25:06,404::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:25:06,406::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:06,406::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:06,407::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:06,407::__init__::232::IOProcess::(_processLogs) (202050) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:06,408::__init__::232::IOProcess::(_processLogs) (202050) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:06,408::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:06,408::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:06,409::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:06,409::__init__::232::IOProcess::(_processLogs) (202051) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:25:06,410::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202051) Queuing response >Thread-137079::DEBUG::2014-10-29 11:25:06,410::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-137079::INFO::2014-10-29 11:25:06,412::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137079::INFO::2014-10-29 11:25:06,412::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137079::INFO::2014-10-29 11:25:06,412::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:25:06,413::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:06,413::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:06,414::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:06,414::__init__::232::IOProcess::(_processLogs) (202052) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:25:06,415::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202052) Queuing response >Thread-137079::DEBUG::2014-10-29 11:25:06,415::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137079::DEBUG::2014-10-29 11:25:06,418::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`1a955edd-14be-4065-905b-0369cc93f4e6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137079::DEBUG::2014-10-29 11:25:06,418::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137079::DEBUG::2014-10-29 11:25:06,419::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137079::DEBUG::2014-10-29 11:25:06,419::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`1a955edd-14be-4065-905b-0369cc93f4e6`::Granted request >Thread-137079::DEBUG::2014-10-29 11:25:06,420::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`55ba8834-db78-4ea4-8ef4-a59831e24a38`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137079::DEBUG::2014-10-29 11:25:06,420::task::993::Storage.TaskManager.Task::(_decref) Task=`55ba8834-db78-4ea4-8ef4-a59831e24a38`::ref 1 aborting False >Thread-137079::INFO::2014-10-29 11:25:06,423::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137079::DEBUG::2014-10-29 11:25:06,424::task::1191::Storage.TaskManager.Task::(prepare) Task=`55ba8834-db78-4ea4-8ef4-a59831e24a38`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137079::DEBUG::2014-10-29 11:25:06,424::task::595::Storage.TaskManager.Task::(_updateState) Task=`55ba8834-db78-4ea4-8ef4-a59831e24a38`::moving from state preparing -> state finished >Thread-137079::DEBUG::2014-10-29 11:25:06,424::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137079::DEBUG::2014-10-29 11:25:06,424::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137079::DEBUG::2014-10-29 11:25:06,425::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137079::DEBUG::2014-10-29 11:25:06,425::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137079::DEBUG::2014-10-29 11:25:06,425::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137079::DEBUG::2014-10-29 11:25:06,426::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137079::DEBUG::2014-10-29 11:25:06,426::task::993::Storage.TaskManager.Task::(_decref) Task=`55ba8834-db78-4ea4-8ef4-a59831e24a38`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:25:06,449::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54699 >Detector thread::DEBUG::2014-10-29 11:25:06,449::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54699 >Detector thread::DEBUG::2014-10-29 11:25:06,450::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54699 >Detector thread::DEBUG::2014-10-29 11:25:06,450::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54699) >Thread-137084::DEBUG::2014-10-29 11:25:06,489::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137084::DEBUG::2014-10-29 11:25:06,490::task::595::Storage.TaskManager.Task::(_updateState) Task=`cdf15a2b-2c0a-4850-9b50-59331566e962`::moving from state init -> state preparing >Thread-137084::INFO::2014-10-29 11:25:06,490::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137084::INFO::2014-10-29 11:25:06,491::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521772', 'lastCheck': '8.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525592', 'lastCheck': '8.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519636', 'lastCheck': '9.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000484338', 'lastCheck': '9.0', 'valid': True}} >Thread-137084::DEBUG::2014-10-29 11:25:06,491::task::1191::Storage.TaskManager.Task::(prepare) Task=`cdf15a2b-2c0a-4850-9b50-59331566e962`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521772', 'lastCheck': '8.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525592', 'lastCheck': '8.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519636', 'lastCheck': '9.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000484338', 'lastCheck': '9.0', 'valid': True}} >Thread-137084::DEBUG::2014-10-29 11:25:06,491::task::595::Storage.TaskManager.Task::(_updateState) Task=`cdf15a2b-2c0a-4850-9b50-59331566e962`::moving from state preparing -> state finished >Thread-137084::DEBUG::2014-10-29 11:25:06,491::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137084::DEBUG::2014-10-29 11:25:06,492::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137084::DEBUG::2014-10-29 11:25:06,492::task::993::Storage.TaskManager.Task::(_decref) Task=`cdf15a2b-2c0a-4850-9b50-59331566e962`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:25:07,456::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:07,456::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:07,458::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:07,459::__init__::232::IOProcess::(_processLogs) (202053) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:07,460::__init__::232::IOProcess::(_processLogs) (202053) Queuing response >Thread-179::DEBUG::2014-10-29 11:25:07,460::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:25:07,478::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000419756 s, 886 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:25:07,480::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:07,480::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:07,480::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:07,480::__init__::232::IOProcess::(_processLogs) (202054) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:07,481::__init__::232::IOProcess::(_processLogs) (202054) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:07,499::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:07,499::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:07,500::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:07,500::__init__::232::IOProcess::(_processLogs) (202055) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:07,501::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202055) Queuing response >Thread-10269::DEBUG::2014-10-29 11:25:07,503::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:25:07,520::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00043816 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:25:07,521::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:07,522::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:07,522::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:07,522::__init__::232::IOProcess::(_processLogs) (202056) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:07,523::__init__::232::IOProcess::(_processLogs) (202056) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:08,064::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:08,065::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:08,066::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:08,066::__init__::232::IOProcess::(_processLogs) (202057) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:08,068::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202057) Queuing response >Thread-33::DEBUG::2014-10-29 11:25:08,069::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:25:08,087::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000682407 s, 714 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:25:08,089::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:08,089::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:08,091::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:08,092::__init__::232::IOProcess::(_processLogs) (202058) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:08,092::__init__::232::IOProcess::(_processLogs) (202058) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:08,093::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:08,093::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:08,093::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:08,094::__init__::232::IOProcess::(_processLogs) (202059) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:08,095::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202059) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:08,096::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:08,096::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:08,096::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:08,096::__init__::232::IOProcess::(_processLogs) (202060) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:08,097::__init__::232::IOProcess::(_processLogs) (202060) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:08,098::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:08,098::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:08,098::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:08,099::__init__::232::IOProcess::(_processLogs) (202061) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:08,099::__init__::232::IOProcess::(_processLogs) (202061) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:08,107::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:08,109::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137085::DEBUG::2014-10-29 11:25:08,113::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:08,115::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:08,117::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137086::DEBUG::2014-10-29 11:25:08,120::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137086::DEBUG::2014-10-29 11:25:08,123::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:25:08,151::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:08,151::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:08,151::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:08,152::__init__::232::IOProcess::(_processLogs) (202062) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:08,153::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202062) Queuing response >Thread-178::DEBUG::2014-10-29 11:25:08,154::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:25:08,173::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000517667 s, 981 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:25:08,174::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:08,175::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:08,175::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:08,175::__init__::232::IOProcess::(_processLogs) (202063) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:08,177::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202063) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:08,179::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:08,179::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:08,179::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:08,180::__init__::232::IOProcess::(_processLogs) (202064) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:08,181::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202064) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:08,182::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:08,182::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:08,182::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:08,182::__init__::232::IOProcess::(_processLogs) (202065) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:08,183::__init__::232::IOProcess::(_processLogs) (202065) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:08,184::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:08,184::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:08,184::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:08,184::__init__::232::IOProcess::(_processLogs) (202066) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:08,185::__init__::232::IOProcess::(_processLogs) (202066) Queuing response >Detector thread::DEBUG::2014-10-29 11:25:10,322::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54700 >Detector thread::DEBUG::2014-10-29 11:25:10,323::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54700 >Detector thread::DEBUG::2014-10-29 11:25:10,323::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54700 >Detector thread::DEBUG::2014-10-29 11:25:10,324::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54700) >Thread-137087::DEBUG::2014-10-29 11:25:10,363::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137087::DEBUG::2014-10-29 11:25:10,365::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137087::DEBUG::2014-10-29 11:25:10,365::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.27', 'elapsedTime': '514542', 'displayType': 'vnc', 'cpuSys': '0.66', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '3251662', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '59148', 'readRate': '0.00', 'truesize': '6010888192', 'writeRate': '33909.24'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.14', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:25:10,539::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54702 >Detector thread::DEBUG::2014-10-29 11:25:10,540::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54702 >Detector thread::DEBUG::2014-10-29 11:25:10,540::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54702 >Detector thread::DEBUG::2014-10-29 11:25:10,540::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54702) >Thread-137088::DEBUG::2014-10-29 11:25:10,580::task::595::Storage.TaskManager.Task::(_updateState) Task=`7fe9fdf9-36d3-4b71-83d6-889eb7f1d0ab`::moving from state init -> state preparing >Thread-137088::INFO::2014-10-29 11:25:10,580::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137088::INFO::2014-10-29 11:25:10,581::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517667', 'lastCheck': '2.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682407', 'lastCheck': '2.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000419756', 'lastCheck': '3.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00043816', 'lastCheck': '3.1', 'valid': True}} >Thread-137088::DEBUG::2014-10-29 11:25:10,581::task::1191::Storage.TaskManager.Task::(prepare) Task=`7fe9fdf9-36d3-4b71-83d6-889eb7f1d0ab`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517667', 'lastCheck': '2.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682407', 'lastCheck': '2.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000419756', 'lastCheck': '3.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00043816', 'lastCheck': '3.1', 'valid': True}} >Thread-137088::DEBUG::2014-10-29 11:25:10,582::task::595::Storage.TaskManager.Task::(_updateState) Task=`7fe9fdf9-36d3-4b71-83d6-889eb7f1d0ab`::moving from state preparing -> state finished >Thread-137088::DEBUG::2014-10-29 11:25:10,582::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137088::DEBUG::2014-10-29 11:25:10,582::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137088::DEBUG::2014-10-29 11:25:10,582::task::993::Storage.TaskManager.Task::(_decref) Task=`7fe9fdf9-36d3-4b71-83d6-889eb7f1d0ab`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:25:10,996::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54703 >Detector thread::DEBUG::2014-10-29 11:25:10,997::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54703 >Detector thread::DEBUG::2014-10-29 11:25:10,998::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54703 >Detector thread::DEBUG::2014-10-29 11:25:10,998::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54703) >Thread-137089::DEBUG::2014-10-29 11:25:11,037::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137089::DEBUG::2014-10-29 11:25:11,039::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137089::DEBUG::2014-10-29 11:25:11,061::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137089::DEBUG::2014-10-29 11:25:11,110::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '30', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '30', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:11,140::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:11,143::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137090::DEBUG::2014-10-29 11:25:11,147::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:11,149::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:11,152::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137091::DEBUG::2014-10-29 11:25:11,155::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137091::DEBUG::2014-10-29 11:25:11,157::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:11,284::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:11,285::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:11,287::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:14,174::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:14,177::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137092::DEBUG::2014-10-29 11:25:14,181::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:14,183::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:14,185::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137093::DEBUG::2014-10-29 11:25:14,188::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137093::DEBUG::2014-10-29 11:25:14,191::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:16,296::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:16,301::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:16,309::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:25:17,105::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54705 >Detector thread::DEBUG::2014-10-29 11:25:17,105::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54705 >Detector thread::DEBUG::2014-10-29 11:25:17,106::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54705 >Detector thread::DEBUG::2014-10-29 11:25:17,106::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54705) >Thread-137094::DEBUG::2014-10-29 11:25:17,146::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137094::DEBUG::2014-10-29 11:25:17,147::task::595::Storage.TaskManager.Task::(_updateState) Task=`493ca683-0b11-4c2b-a0f0-8cd11b16fc4a`::moving from state init -> state preparing >Thread-137094::INFO::2014-10-29 11:25:17,148::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137094::DEBUG::2014-10-29 11:25:17,152::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:25:17,156::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:17,156::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:17,157::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:17,157::__init__::232::IOProcess::(_processLogs) (202067) Got request for method 'glob' >Thread-137094::DEBUG::2014-10-29 11:25:17,158::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:25:17,158::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202067) Queuing response >Thread-137094::DEBUG::2014-10-29 11:25:17,159::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137094::INFO::2014-10-29 11:25:17,160::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137094::DEBUG::2014-10-29 11:25:17,160::task::1191::Storage.TaskManager.Task::(prepare) Task=`493ca683-0b11-4c2b-a0f0-8cd11b16fc4a`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137094::DEBUG::2014-10-29 11:25:17,161::task::595::Storage.TaskManager.Task::(_updateState) Task=`493ca683-0b11-4c2b-a0f0-8cd11b16fc4a`::moving from state preparing -> state finished >Thread-137094::DEBUG::2014-10-29 11:25:17,161::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137094::DEBUG::2014-10-29 11:25:17,161::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137094::DEBUG::2014-10-29 11:25:17,161::task::993::Storage.TaskManager.Task::(_decref) Task=`493ca683-0b11-4c2b-a0f0-8cd11b16fc4a`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:17,205::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Detector thread::DEBUG::2014-10-29 11:25:17,207::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54706 >JsonRpcServer::DEBUG::2014-10-29 11:25:17,209::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Detector thread::DEBUG::2014-10-29 11:25:17,211::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54706 >Detector thread::DEBUG::2014-10-29 11:25:17,213::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54706 >Detector thread::DEBUG::2014-10-29 11:25:17,215::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54706) >Thread-137095::DEBUG::2014-10-29 11:25:17,219::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:17,221::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:17,223::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137097::DEBUG::2014-10-29 11:25:17,225::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137097::DEBUG::2014-10-29 11:25:17,228::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-137096::DEBUG::2014-10-29 11:25:17,249::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137096::DEBUG::2014-10-29 11:25:17,249::task::595::Storage.TaskManager.Task::(_updateState) Task=`000bd021-2d4c-4c8d-b4ef-a8ec6a498cc7`::moving from state init -> state preparing >Thread-137096::INFO::2014-10-29 11:25:17,250::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137096::DEBUG::2014-10-29 11:25:17,250::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137096::DEBUG::2014-10-29 11:25:17,250::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137096::DEBUG::2014-10-29 11:25:17,251::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137096::DEBUG::2014-10-29 11:25:17,251::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137096::DEBUG::2014-10-29 11:25:17,251::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137096::DEBUG::2014-10-29 11:25:17,252::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137096::DEBUG::2014-10-29 11:25:17,344::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137096::DEBUG::2014-10-29 11:25:17,345::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-17::DEBUG::2014-10-29 11:25:17,486::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:17,488::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:17,489::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:17,489::__init__::232::IOProcess::(_processLogs) (202068) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:17,491::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202068) Queuing response >Thread-179::DEBUG::2014-10-29 11:25:17,492::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-137096::DEBUG::2014-10-29 11:25:17,519::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137096::DEBUG::2014-10-29 11:25:17,520::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137096::DEBUG::2014-10-29 11:25:17,520::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137096::DEBUG::2014-10-29 11:25:17,521::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137096::DEBUG::2014-10-29 11:25:17,521::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137096::DEBUG::2014-10-29 11:25:17,522::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137096::DEBUG::2014-10-29 11:25:17,522::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137096::DEBUG::2014-10-29 11:25:17,522::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:25:17,530::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:17,534::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-179::DEBUG::2014-10-29 11:25:17,535::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.020589 s, 18.1 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:25:17,536::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:17,537::__init__::232::IOProcess::(_processLogs) (202069) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:25:17,539::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|(202069) Queuing response >Thread-137096::DEBUG::2014-10-29 11:25:17,547::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:25:17,549::__init__::232::IOProcess::(_processLogs) (15851DEBUG|(null)|Receiving request... >Thread-10269::DEBUG::2014-10-29 11:25:17,550::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:25:17,551::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:17,568::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:17,571::__init__::232::IOProcess::(_processLogs) (202070) Got request for method 'statvfs' >Thread-10269::DEBUG::2014-10-29 11:25:17,571::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000453491 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:25:17,574::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:17,575::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:17,575::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:17,575::__init__::232::IOProcess::(_processLogs) (202071) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:25:17,576::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:17,576::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:17,576::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:17,576::__init__::232::IOProcess::(_processLogs) (202072) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:25:17,577::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:17,577::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:17,577::__init__::232::IOProcess::(_processLogs) (202071) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:17,577::__init__::232::IOProcess::(_processLogs) (202070) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:17,578::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:17,578::__init__::232::IOProcess::(_processLogs) (202073) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:25:17,578::__init__::232::IOProcess::(_processLogs) (202072) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:17,578::__init__::232::IOProcess::(_processLogs) (202073) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:17,579::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:17,579::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:17,581::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:17,581::__init__::232::IOProcess::(_processLogs) (202074) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:17,582::__init__::232::IOProcess::(_processLogs) (202074) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:17,585::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:17,586::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:17,587::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:17,587::__init__::232::IOProcess::(_processLogs) (202075) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:25:17,587::__init__::232::IOProcess::(_processLogs) (202075) Queuing response >Thread-137096::DEBUG::2014-10-29 11:25:17,588::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:25:17,590::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:17,592::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:17,593::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:17,594::__init__::232::IOProcess::(_processLogs) (202076) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:17,594::__init__::232::IOProcess::(_processLogs) (202076) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:17,594::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:17,595::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:17,595::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:17,595::__init__::232::IOProcess::(_processLogs) (202077) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:25:17,596::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202077) Queuing response >Thread-137096::DEBUG::2014-10-29 11:25:17,596::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:25:17,599::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:17,599::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:17,600::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:17,600::__init__::232::IOProcess::(_processLogs) (202078) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:17,600::__init__::232::IOProcess::(_processLogs) (202078) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:17,601::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:17,601::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:17,601::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:17,602::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202079) Got request for method 'glob' >Thread-137096::DEBUG::2014-10-29 11:25:17,602::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:25:17,603::__init__::232::IOProcess::(_processLogs) (202079) Queuing response >Thread-137096::INFO::2014-10-29 11:25:17,604::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137096::INFO::2014-10-29 11:25:17,605::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137096::INFO::2014-10-29 11:25:17,605::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:25:17,606::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:17,606::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:17,606::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:17,607::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202080) Got request for method 'readfile' >Thread-137096::DEBUG::2014-10-29 11:25:17,608::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:25:17,609::__init__::232::IOProcess::(_processLogs) (202080) Queuing response >Thread-137096::DEBUG::2014-10-29 11:25:17,611::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`5af4b2b2-e57d-46a9-974a-5637d1473327`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137096::DEBUG::2014-10-29 11:25:17,612::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137096::DEBUG::2014-10-29 11:25:17,612::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137096::DEBUG::2014-10-29 11:25:17,612::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`5af4b2b2-e57d-46a9-974a-5637d1473327`::Granted request >Thread-137096::DEBUG::2014-10-29 11:25:17,613::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`000bd021-2d4c-4c8d-b4ef-a8ec6a498cc7`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137096::DEBUG::2014-10-29 11:25:17,613::task::993::Storage.TaskManager.Task::(_decref) Task=`000bd021-2d4c-4c8d-b4ef-a8ec6a498cc7`::ref 1 aborting False >Thread-137096::INFO::2014-10-29 11:25:17,616::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137096::DEBUG::2014-10-29 11:25:17,617::task::1191::Storage.TaskManager.Task::(prepare) Task=`000bd021-2d4c-4c8d-b4ef-a8ec6a498cc7`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137096::DEBUG::2014-10-29 11:25:17,617::task::595::Storage.TaskManager.Task::(_updateState) Task=`000bd021-2d4c-4c8d-b4ef-a8ec6a498cc7`::moving from state preparing -> state finished >Thread-137096::DEBUG::2014-10-29 11:25:17,617::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137096::DEBUG::2014-10-29 11:25:17,617::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137096::DEBUG::2014-10-29 11:25:17,618::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137096::DEBUG::2014-10-29 11:25:17,618::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137096::DEBUG::2014-10-29 11:25:17,618::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137096::DEBUG::2014-10-29 11:25:17,619::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137096::DEBUG::2014-10-29 11:25:17,619::task::993::Storage.TaskManager.Task::(_decref) Task=`000bd021-2d4c-4c8d-b4ef-a8ec6a498cc7`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:25:17,651::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54707 >Detector thread::DEBUG::2014-10-29 11:25:17,652::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54707 >Detector thread::DEBUG::2014-10-29 11:25:17,652::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54707 >Detector thread::DEBUG::2014-10-29 11:25:17,653::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54707) >Thread-137102::DEBUG::2014-10-29 11:25:17,691::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137102::DEBUG::2014-10-29 11:25:17,692::task::595::Storage.TaskManager.Task::(_updateState) Task=`4eb66e05-2cc8-4e91-a98b-97782e53ce3e`::moving from state init -> state preparing >Thread-137102::INFO::2014-10-29 11:25:17,692::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137102::INFO::2014-10-29 11:25:17,693::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517667', 'lastCheck': '9.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682407', 'lastCheck': '9.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.020589', 'lastCheck': '0.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000453491', 'lastCheck': '0.1', 'valid': True}} >Thread-137102::DEBUG::2014-10-29 11:25:17,693::task::1191::Storage.TaskManager.Task::(prepare) Task=`4eb66e05-2cc8-4e91-a98b-97782e53ce3e`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517667', 'lastCheck': '9.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682407', 'lastCheck': '9.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.020589', 'lastCheck': '0.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000453491', 'lastCheck': '0.1', 'valid': True}} >Thread-137102::DEBUG::2014-10-29 11:25:17,693::task::595::Storage.TaskManager.Task::(_updateState) Task=`4eb66e05-2cc8-4e91-a98b-97782e53ce3e`::moving from state preparing -> state finished >Thread-137102::DEBUG::2014-10-29 11:25:17,693::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137102::DEBUG::2014-10-29 11:25:17,694::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137102::DEBUG::2014-10-29 11:25:17,694::task::993::Storage.TaskManager.Task::(_decref) Task=`4eb66e05-2cc8-4e91-a98b-97782e53ce3e`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:25:18,103::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:18,106::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-33::DEBUG::2014-10-29 11:25:18,108::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:25:18,108::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:18,129::__init__::232::IOProcess::(_processLogs) (202081) Got request for method 'statvfs' >Thread-33::DEBUG::2014-10-29 11:25:18,131::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000465574 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:25:18,132::__init__::232::IOProcess::(_processLogs) (202081) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:18,134::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:18,135::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:18,135::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:18,135::__init__::232::IOProcess::(_processLogs) (202082) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:18,135::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202082) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:18,138::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:18,138::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:18,138::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:18,138::__init__::232::IOProcess::(_processLogs) (202083) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:18,139::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202083) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:18,140::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:18,140::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:18,141::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:18,141::__init__::232::IOProcess::(_processLogs) (202084) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:18,142::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202084) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:18,143::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:18,143::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:18,143::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:18,144::__init__::232::IOProcess::(_processLogs) (202085) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:18,144::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202085) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:18,187::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:18,188::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-178::DEBUG::2014-10-29 11:25:18,190::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:25:18,190::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:18,206::__init__::232::IOProcess::(_processLogs) (202086) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:18,206::__init__::232::IOProcess::(_processLogs) (202086) Queuing response >Thread-178::DEBUG::2014-10-29 11:25:18,210::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000567689 s, 895 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:25:18,211::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:18,212::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:18,212::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:18,212::__init__::232::IOProcess::(_processLogs) (202087) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:18,212::__init__::232::IOProcess::(_processLogs) (202087) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:18,214::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:18,215::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:18,215::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:18,215::__init__::232::IOProcess::(_processLogs) (202088) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:18,215::__init__::232::IOProcess::(_processLogs) (202088) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:18,217::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:18,217::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:18,218::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:18,219::__init__::232::IOProcess::(_processLogs) (202089) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:18,219::__init__::232::IOProcess::(_processLogs) (202089) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:18,219::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:18,220::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:18,220::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:18,220::__init__::232::IOProcess::(_processLogs) (202090) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:18,221::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202090) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:20,242::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:20,244::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-22::DEBUG::2014-10-29 11:25:20,248::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-137103::DEBUG::2014-10-29 11:25:20,250::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ccae773-2e0e-455e-9894-c3cf730584ed`::moving from state init -> state preparing >Thread-137103::INFO::2014-10-29 11:25:20,251::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137103::INFO::2014-10-29 11:25:20,251::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567689', 'lastCheck': '2.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000465574', 'lastCheck': '2.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.020589', 'lastCheck': '2.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000453491', 'lastCheck': '2.7', 'valid': True}} >Thread-137103::DEBUG::2014-10-29 11:25:20,252::task::1191::Storage.TaskManager.Task::(prepare) Task=`9ccae773-2e0e-455e-9894-c3cf730584ed`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567689', 'lastCheck': '2.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000465574', 'lastCheck': '2.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.020589', 'lastCheck': '2.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000453491', 'lastCheck': '2.7', 'valid': True}} >Thread-137103::DEBUG::2014-10-29 11:25:20,252::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ccae773-2e0e-455e-9894-c3cf730584ed`::moving from state preparing -> state finished >Thread-137103::DEBUG::2014-10-29 11:25:20,252::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137103::DEBUG::2014-10-29 11:25:20,252::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137103::DEBUG::2014-10-29 11:25:20,253::task::993::Storage.TaskManager.Task::(_decref) Task=`9ccae773-2e0e-455e-9894-c3cf730584ed`::ref 0 aborting False >Thread-137103::DEBUG::2014-10-29 11:25:20,296::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:20,321::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:20,323::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137104::DEBUG::2014-10-29 11:25:20,326::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137104::DEBUG::2014-10-29 11:25:20,328::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:25:20,538::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54708 >Detector thread::DEBUG::2014-10-29 11:25:20,539::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54708 >Detector thread::DEBUG::2014-10-29 11:25:20,539::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54708 >Detector thread::DEBUG::2014-10-29 11:25:20,540::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54708) >Thread-137105::DEBUG::2014-10-29 11:25:20,578::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137105::DEBUG::2014-10-29 11:25:20,579::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137105::DEBUG::2014-10-29 11:25:20,580::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.08', 'elapsedTime': '514553', 'displayType': 'vnc', 'cpuSys': '0.87', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '3251662', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '59148', 'readRate': '0.00', 'truesize': '6010888192', 'writeRate': '33909.24'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.35', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:25:20,664::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54709 >Detector thread::DEBUG::2014-10-29 11:25:20,665::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54709 >Detector thread::DEBUG::2014-10-29 11:25:20,665::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54709 >Detector thread::DEBUG::2014-10-29 11:25:20,665::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54709) >Thread-137106::DEBUG::2014-10-29 11:25:20,706::task::595::Storage.TaskManager.Task::(_updateState) Task=`e542c3da-2f9b-4d99-9288-c7506b586b4c`::moving from state init -> state preparing >Thread-137106::INFO::2014-10-29 11:25:20,706::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137106::INFO::2014-10-29 11:25:20,707::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567689', 'lastCheck': '2.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000465574', 'lastCheck': '2.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.020589', 'lastCheck': '3.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000453491', 'lastCheck': '3.1', 'valid': True}} >Thread-137106::DEBUG::2014-10-29 11:25:20,707::task::1191::Storage.TaskManager.Task::(prepare) Task=`e542c3da-2f9b-4d99-9288-c7506b586b4c`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000567689', 'lastCheck': '2.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000465574', 'lastCheck': '2.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.020589', 'lastCheck': '3.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000453491', 'lastCheck': '3.1', 'valid': True}} >Thread-137106::DEBUG::2014-10-29 11:25:20,708::task::595::Storage.TaskManager.Task::(_updateState) Task=`e542c3da-2f9b-4d99-9288-c7506b586b4c`::moving from state preparing -> state finished >Thread-137106::DEBUG::2014-10-29 11:25:20,708::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137106::DEBUG::2014-10-29 11:25:20,708::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137106::DEBUG::2014-10-29 11:25:20,708::task::993::Storage.TaskManager.Task::(_decref) Task=`e542c3da-2f9b-4d99-9288-c7506b586b4c`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:25:21,158::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54711 >Detector thread::DEBUG::2014-10-29 11:25:21,159::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54711 >Detector thread::DEBUG::2014-10-29 11:25:21,159::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54711 >Detector thread::DEBUG::2014-10-29 11:25:21,159::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54711) >Thread-137107::DEBUG::2014-10-29 11:25:21,198::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137107::DEBUG::2014-10-29 11:25:21,200::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137107::DEBUG::2014-10-29 11:25:21,220::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137107::DEBUG::2014-10-29 11:25:21,269::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '14', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '14', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:21,320::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:21,322::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:21,327::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:23,387::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:23,391::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137108::DEBUG::2014-10-29 11:25:23,395::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:23,397::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:23,399::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137109::DEBUG::2014-10-29 11:25:23,403::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137109::DEBUG::2014-10-29 11:25:23,405::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:26,332::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:26,333::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:26,334::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:26,463::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:26,465::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137110::DEBUG::2014-10-29 11:25:26,468::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:26,472::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:26,474::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137111::DEBUG::2014-10-29 11:25:26,477::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137111::DEBUG::2014-10-29 11:25:26,479::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:25:27,591::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:27,593::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:27,593::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:27,593::__init__::232::IOProcess::(_processLogs) (202091) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:27,596::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202091) Queuing response >Thread-179::DEBUG::2014-10-29 11:25:27,597::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:25:27,618::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-179::DEBUG::2014-10-29 11:25:27,620::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000601603 s, 618 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:25:27,620::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:27,623::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:27,623::__init__::232::IOProcess::(_processLogs) (202092) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:27,625::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202092) Queuing response >Thread-10269::DEBUG::2014-10-29 11:25:27,627::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:25:27,645::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:27,649::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10269::DEBUG::2014-10-29 11:25:27,649::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000705096 s, 712 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:25:27,650::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:27,654::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202093) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:27,655::__init__::232::IOProcess::(_processLogs) (202093) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:27,656::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:27,658::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:27,660::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:27,661::__init__::232::IOProcess::(_processLogs) (202094) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:27,661::__init__::232::IOProcess::(_processLogs) (202094) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:28,146::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:28,147::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:28,147::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:28,147::__init__::232::IOProcess::(_processLogs) (202095) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:28,148::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202095) Queuing response >Thread-33::DEBUG::2014-10-29 11:25:28,149::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:25:28,178::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000572102 s, 851 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:25:28,180::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:28,180::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:28,180::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:28,181::__init__::232::IOProcess::(_processLogs) (202096) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:28,182::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202096) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:28,183::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:28,184::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:28,184::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:28,184::__init__::232::IOProcess::(_processLogs) (202097) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:28,184::__init__::232::IOProcess::(_processLogs) (202097) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:28,185::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:28,186::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:28,187::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:28,187::__init__::232::IOProcess::(_processLogs) (202098) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:28,187::__init__::232::IOProcess::(_processLogs) (202098) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:28,188::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:28,188::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:28,189::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:28,190::__init__::232::IOProcess::(_processLogs) (202099) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:28,191::__init__::232::IOProcess::(_processLogs) (202099) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:28,223::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:28,225::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:28,225::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:28,226::__init__::232::IOProcess::(_processLogs) (202100) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:28,226::__init__::232::IOProcess::(_processLogs) (202100) Queuing response >Thread-178::DEBUG::2014-10-29 11:25:28,227::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:25:28,250::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000619229 s, 820 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:25:28,253::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:28,254::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:28,254::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:28,254::__init__::232::IOProcess::(_processLogs) (202101) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:28,256::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202101) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:28,257::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:28,265::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:28,268::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:28,268::__init__::232::IOProcess::(_processLogs) (202102) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:28,269::__init__::232::IOProcess::(_processLogs) (202102) Queuing response >Detector thread::DEBUG::2014-10-29 11:25:28,270::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54713 >Detector thread::DEBUG::2014-10-29 11:25:28,273::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54713 >Thread-17::DEBUG::2014-10-29 11:25:28,274::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Detector thread::DEBUG::2014-10-29 11:25:28,275::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54713 >Thread-17::DEBUG::2014-10-29 11:25:28,276::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Detector thread::DEBUG::2014-10-29 11:25:28,277::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54713) >Thread-17::DEBUG::2014-10-29 11:25:28,282::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:28,284::__init__::232::IOProcess::(_processLogs) (202103) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:28,284::__init__::232::IOProcess::(_processLogs) (202103) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:28,285::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:28,285::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:28,285::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:28,286::__init__::232::IOProcess::(_processLogs) (202104) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:28,286::__init__::232::IOProcess::(_processLogs) (202104) Queuing response >Thread-137112::DEBUG::2014-10-29 11:25:28,312::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137112::DEBUG::2014-10-29 11:25:28,313::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e488ff9-838e-4301-9da8-9b5a25749131`::moving from state init -> state preparing >Thread-137112::INFO::2014-10-29 11:25:28,313::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137112::DEBUG::2014-10-29 11:25:28,317::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:25:28,318::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:28,318::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:28,319::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:28,319::__init__::232::IOProcess::(_processLogs) (202105) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:25:28,319::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202105) Queuing response >Thread-137112::DEBUG::2014-10-29 11:25:28,320::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137112::DEBUG::2014-10-29 11:25:28,320::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137112::INFO::2014-10-29 11:25:28,321::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137112::DEBUG::2014-10-29 11:25:28,321::task::1191::Storage.TaskManager.Task::(prepare) Task=`3e488ff9-838e-4301-9da8-9b5a25749131`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137112::DEBUG::2014-10-29 11:25:28,321::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e488ff9-838e-4301-9da8-9b5a25749131`::moving from state preparing -> state finished >Thread-137112::DEBUG::2014-10-29 11:25:28,322::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137112::DEBUG::2014-10-29 11:25:28,322::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137112::DEBUG::2014-10-29 11:25:28,322::task::993::Storage.TaskManager.Task::(_decref) Task=`3e488ff9-838e-4301-9da8-9b5a25749131`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:25:28,366::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54714 >Detector thread::DEBUG::2014-10-29 11:25:28,367::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54714 >Detector thread::DEBUG::2014-10-29 11:25:28,368::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54714 >Detector thread::DEBUG::2014-10-29 11:25:28,368::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54714) >Thread-137113::DEBUG::2014-10-29 11:25:28,407::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137113::DEBUG::2014-10-29 11:25:28,408::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b152923-404d-4906-a5e8-ee8eea6a75bc`::moving from state init -> state preparing >Thread-137113::INFO::2014-10-29 11:25:28,408::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137113::DEBUG::2014-10-29 11:25:28,408::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137113::DEBUG::2014-10-29 11:25:28,409::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137113::DEBUG::2014-10-29 11:25:28,409::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137113::DEBUG::2014-10-29 11:25:28,409::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137113::DEBUG::2014-10-29 11:25:28,410::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137113::DEBUG::2014-10-29 11:25:28,410::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137113::DEBUG::2014-10-29 11:25:28,486::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137113::DEBUG::2014-10-29 11:25:28,487::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137113::DEBUG::2014-10-29 11:25:28,665::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137113::DEBUG::2014-10-29 11:25:28,666::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137113::DEBUG::2014-10-29 11:25:28,666::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137113::DEBUG::2014-10-29 11:25:28,666::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137113::DEBUG::2014-10-29 11:25:28,667::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137113::DEBUG::2014-10-29 11:25:28,667::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137113::DEBUG::2014-10-29 11:25:28,667::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137113::DEBUG::2014-10-29 11:25:28,668::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:25:28,676::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:28,678::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:28,679::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:28,679::__init__::232::IOProcess::(_processLogs) (202106) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:25:28,680::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202106) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:28,682::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:28,682::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:28,683::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:28,683::__init__::232::IOProcess::(_processLogs) (202107) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:25:28,684::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202107) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:28,686::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:28,687::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:28,689::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:28,691::__init__::232::IOProcess::(_processLogs) (202108) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:25:28,696::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202108) Queuing response >Thread-137113::DEBUG::2014-10-29 11:25:28,698::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:25:28,700::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:28,700::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:28,701::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:28,701::__init__::232::IOProcess::(_processLogs) (202109) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:25:28,702::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202109) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:28,703::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:28,703::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:28,703::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:28,704::__init__::232::IOProcess::(_processLogs) (202110) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:25:28,704::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202110) Queuing response >Thread-137113::DEBUG::2014-10-29 11:25:28,705::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:25:28,706::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:28,706::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:28,707::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:28,707::__init__::232::IOProcess::(_processLogs) (202111) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:25:28,708::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202111) Queuing response >Thread-137113::DEBUG::2014-10-29 11:25:28,708::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:25:28,710::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:28,711::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:28,712::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:28,712::__init__::232::IOProcess::(_processLogs) (202112) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:28,712::__init__::232::IOProcess::(_processLogs) (202112) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:28,713::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:28,713::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:28,713::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:28,713::__init__::232::IOProcess::(_processLogs) (202113) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:25:28,716::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202113) Queuing response >Thread-137113::DEBUG::2014-10-29 11:25:28,716::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-137113::INFO::2014-10-29 11:25:28,717::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137113::INFO::2014-10-29 11:25:28,717::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137113::INFO::2014-10-29 11:25:28,717::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:25:28,718::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:28,718::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:28,719::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:28,719::__init__::232::IOProcess::(_processLogs) (202114) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:25:28,722::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202114) Queuing response >Thread-137113::DEBUG::2014-10-29 11:25:28,723::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137113::DEBUG::2014-10-29 11:25:28,724::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`bd6743b6-6b37-4ad3-a352-a219fb9ee96f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137113::DEBUG::2014-10-29 11:25:28,724::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137113::DEBUG::2014-10-29 11:25:28,725::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137113::DEBUG::2014-10-29 11:25:28,725::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`bd6743b6-6b37-4ad3-a352-a219fb9ee96f`::Granted request >Thread-137113::DEBUG::2014-10-29 11:25:28,726::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4b152923-404d-4906-a5e8-ee8eea6a75bc`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137113::DEBUG::2014-10-29 11:25:28,726::task::993::Storage.TaskManager.Task::(_decref) Task=`4b152923-404d-4906-a5e8-ee8eea6a75bc`::ref 1 aborting False >Thread-137113::INFO::2014-10-29 11:25:28,729::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137113::DEBUG::2014-10-29 11:25:28,729::task::1191::Storage.TaskManager.Task::(prepare) Task=`4b152923-404d-4906-a5e8-ee8eea6a75bc`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137113::DEBUG::2014-10-29 11:25:28,730::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b152923-404d-4906-a5e8-ee8eea6a75bc`::moving from state preparing -> state finished >Thread-137113::DEBUG::2014-10-29 11:25:28,730::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137113::DEBUG::2014-10-29 11:25:28,730::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137113::DEBUG::2014-10-29 11:25:28,731::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137113::DEBUG::2014-10-29 11:25:28,731::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137113::DEBUG::2014-10-29 11:25:28,731::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137113::DEBUG::2014-10-29 11:25:28,731::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137113::DEBUG::2014-10-29 11:25:28,732::task::993::Storage.TaskManager.Task::(_decref) Task=`4b152923-404d-4906-a5e8-ee8eea6a75bc`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:25:28,756::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54715 >Detector thread::DEBUG::2014-10-29 11:25:28,757::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54715 >Detector thread::DEBUG::2014-10-29 11:25:28,757::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54715 >Detector thread::DEBUG::2014-10-29 11:25:28,758::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54715) >Thread-137118::DEBUG::2014-10-29 11:25:28,797::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137118::DEBUG::2014-10-29 11:25:28,798::task::595::Storage.TaskManager.Task::(_updateState) Task=`0ed12c59-47fa-4723-a8d8-1045b5681db2`::moving from state init -> state preparing >Thread-137118::INFO::2014-10-29 11:25:28,798::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137118::INFO::2014-10-29 11:25:28,799::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619229', 'lastCheck': '0.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572102', 'lastCheck': '0.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601603', 'lastCheck': '1.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000705096', 'lastCheck': '1.1', 'valid': True}} >Thread-137118::DEBUG::2014-10-29 11:25:28,799::task::1191::Storage.TaskManager.Task::(prepare) Task=`0ed12c59-47fa-4723-a8d8-1045b5681db2`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619229', 'lastCheck': '0.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572102', 'lastCheck': '0.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601603', 'lastCheck': '1.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000705096', 'lastCheck': '1.1', 'valid': True}} >Thread-137118::DEBUG::2014-10-29 11:25:28,799::task::595::Storage.TaskManager.Task::(_updateState) Task=`0ed12c59-47fa-4723-a8d8-1045b5681db2`::moving from state preparing -> state finished >Thread-137118::DEBUG::2014-10-29 11:25:28,799::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137118::DEBUG::2014-10-29 11:25:28,800::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137118::DEBUG::2014-10-29 11:25:28,800::task::993::Storage.TaskManager.Task::(_decref) Task=`0ed12c59-47fa-4723-a8d8-1045b5681db2`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:29,493::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:29,495::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137119::DEBUG::2014-10-29 11:25:29,499::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:29,501::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:29,503::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137120::DEBUG::2014-10-29 11:25:29,506::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137120::DEBUG::2014-10-29 11:25:29,508::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:25:30,326::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54716 >Detector thread::DEBUG::2014-10-29 11:25:30,326::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54716 >Detector thread::DEBUG::2014-10-29 11:25:30,326::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54716 >Detector thread::DEBUG::2014-10-29 11:25:30,327::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54716) >Thread-137121::DEBUG::2014-10-29 11:25:30,366::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137121::DEBUG::2014-10-29 11:25:30,368::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137121::DEBUG::2014-10-29 11:25:30,386::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137121::DEBUG::2014-10-29 11:25:30,435::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '97', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '97', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:25:30,729::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54717 >Detector thread::DEBUG::2014-10-29 11:25:30,730::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54717 >Detector thread::DEBUG::2014-10-29 11:25:30,730::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54717 >Detector thread::DEBUG::2014-10-29 11:25:30,730::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54717) >Detector thread::DEBUG::2014-10-29 11:25:30,766::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54718 >Detector thread::DEBUG::2014-10-29 11:25:30,767::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54718 >Detector thread::DEBUG::2014-10-29 11:25:30,767::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54718 >Detector thread::DEBUG::2014-10-29 11:25:30,767::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54718) >Thread-137122::DEBUG::2014-10-29 11:25:30,771::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137122::DEBUG::2014-10-29 11:25:30,773::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137122::DEBUG::2014-10-29 11:25:30,774::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.08', 'elapsedTime': '514563', 'displayType': 'vnc', 'cpuSys': '0.87', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '3251662', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '59148', 'readRate': '0.00', 'truesize': '6010888192', 'writeRate': '33909.24'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.52', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-137123::DEBUG::2014-10-29 11:25:30,807::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4c8a9e3-3132-44ca-9a66-03a61ee2d3ab`::moving from state init -> state preparing >Thread-137123::INFO::2014-10-29 11:25:30,808::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137123::INFO::2014-10-29 11:25:30,808::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619229', 'lastCheck': '2.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572102', 'lastCheck': '2.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601603', 'lastCheck': '3.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000705096', 'lastCheck': '3.1', 'valid': True}} >Thread-137123::DEBUG::2014-10-29 11:25:30,809::task::1191::Storage.TaskManager.Task::(prepare) Task=`c4c8a9e3-3132-44ca-9a66-03a61ee2d3ab`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619229', 'lastCheck': '2.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572102', 'lastCheck': '2.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601603', 'lastCheck': '3.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000705096', 'lastCheck': '3.1', 'valid': True}} >Thread-137123::DEBUG::2014-10-29 11:25:30,809::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4c8a9e3-3132-44ca-9a66-03a61ee2d3ab`::moving from state preparing -> state finished >Thread-137123::DEBUG::2014-10-29 11:25:30,809::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137123::DEBUG::2014-10-29 11:25:30,809::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137123::DEBUG::2014-10-29 11:25:30,810::task::993::Storage.TaskManager.Task::(_decref) Task=`c4c8a9e3-3132-44ca-9a66-03a61ee2d3ab`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:31,341::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:31,343::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:31,344::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:32,522::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:32,524::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137124::DEBUG::2014-10-29 11:25:32,528::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:32,530::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:32,532::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137125::DEBUG::2014-10-29 11:25:32,534::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137125::DEBUG::2014-10-29 11:25:32,537::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:25:34,555::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >Thread-22::DEBUG::2014-10-29 11:25:35,271::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:35,548::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:35,551::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137126::DEBUG::2014-10-29 11:25:35,555::task::595::Storage.TaskManager.Task::(_updateState) Task=`db6afe31-d6ad-4557-b0a3-a9e201cff5b2`::moving from state init -> state preparing >Thread-137126::INFO::2014-10-29 11:25:35,555::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137126::INFO::2014-10-29 11:25:35,556::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619229', 'lastCheck': '7.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572102', 'lastCheck': '7.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601603', 'lastCheck': '7.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000705096', 'lastCheck': '7.9', 'valid': True}} >Thread-137126::DEBUG::2014-10-29 11:25:35,556::task::1191::Storage.TaskManager.Task::(prepare) Task=`db6afe31-d6ad-4557-b0a3-a9e201cff5b2`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619229', 'lastCheck': '7.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572102', 'lastCheck': '7.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601603', 'lastCheck': '7.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000705096', 'lastCheck': '7.9', 'valid': True}} >Thread-137126::DEBUG::2014-10-29 11:25:35,556::task::595::Storage.TaskManager.Task::(_updateState) Task=`db6afe31-d6ad-4557-b0a3-a9e201cff5b2`::moving from state preparing -> state finished >Thread-137126::DEBUG::2014-10-29 11:25:35,557::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137126::DEBUG::2014-10-29 11:25:35,557::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137126::DEBUG::2014-10-29 11:25:35,558::task::993::Storage.TaskManager.Task::(_decref) Task=`db6afe31-d6ad-4557-b0a3-a9e201cff5b2`::ref 0 aborting False >Thread-137126::DEBUG::2014-10-29 11:25:35,578::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:35,600::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:35,602::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137127::DEBUG::2014-10-29 11:25:35,605::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137127::DEBUG::2014-10-29 11:25:35,608::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:36,350::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:36,352::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:36,353::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:25:37,657::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:37,658::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:37,658::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:37,658::__init__::232::IOProcess::(_processLogs) (202115) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:37,663::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202115) Queuing response >Thread-179::DEBUG::2014-10-29 11:25:37,664::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:25:37,665::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:37,683::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:37,683::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:37,683::__init__::232::IOProcess::(_processLogs) (202116) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:37,686::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202116) Queuing response >Thread-10269::DEBUG::2014-10-29 11:25:37,687::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:25:37,704::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000579711 s, 642 kB/s\n'; <rc> = 0 >Thread-10269::DEBUG::2014-10-29 11:25:37,708::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000511889 s, 981 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:25:37,710::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:37,713::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:37,714::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:37,714::__init__::232::IOProcess::(_processLogs) (202117) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:37,715::__init__::232::IOProcess::(_processLogs) (202117) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:37,715::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:37,715::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:37,716::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:37,717::__init__::232::IOProcess::(_processLogs) (202118) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:37,718::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202118) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:38,191::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:38,192::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:38,192::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:38,192::__init__::232::IOProcess::(_processLogs) (202119) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:38,193::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202119) Queuing response >Thread-33::DEBUG::2014-10-29 11:25:38,195::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:25:38,212::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00042923 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:25:38,213::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:38,214::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:38,214::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:38,214::__init__::232::IOProcess::(_processLogs) (202120) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:38,216::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202120) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:38,218::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:38,218::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:38,219::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:38,219::__init__::232::IOProcess::(_processLogs) (202121) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:38,220::__init__::232::IOProcess::(_processLogs) (202121) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:38,220::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:38,220::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:38,221::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:38,222::__init__::232::IOProcess::(_processLogs) (202122) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:38,222::__init__::232::IOProcess::(_processLogs) (202122) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:38,223::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:38,223::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:38,223::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:38,224::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202123) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:38,225::__init__::232::IOProcess::(_processLogs) (202123) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:38,288::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:38,288::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:38,290::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:38,291::__init__::232::IOProcess::(_processLogs) (202124) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:25:38,291::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:25:38,292::__init__::232::IOProcess::(_processLogs) (202124) Queuing response >Thread-178::DEBUG::2014-10-29 11:25:38,309::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000531971 s, 955 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:25:38,310::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:38,311::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:38,311::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:38,313::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202125) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:38,314::__init__::232::IOProcess::(_processLogs) (202125) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:38,314::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:38,315::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:38,316::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:38,316::__init__::232::IOProcess::(_processLogs) (202126) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:38,317::__init__::232::IOProcess::(_processLogs) (202126) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:38,317::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:38,318::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:38,318::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:38,319::__init__::232::IOProcess::(_processLogs) (202127) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:38,319::__init__::232::IOProcess::(_processLogs) (202127) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:38,319::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:38,320::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:38,321::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:38,322::__init__::232::IOProcess::(_processLogs) (202128) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:38,322::__init__::232::IOProcess::(_processLogs) (202128) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:38,675::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:38,679::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137128::DEBUG::2014-10-29 11:25:38,683::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:38,686::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:38,688::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137129::DEBUG::2014-10-29 11:25:38,692::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137129::DEBUG::2014-10-29 11:25:38,694::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:25:39,383::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54721 >Detector thread::DEBUG::2014-10-29 11:25:39,384::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54721 >Detector thread::DEBUG::2014-10-29 11:25:39,384::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54721 >Detector thread::DEBUG::2014-10-29 11:25:39,385::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54721) >Thread-137130::DEBUG::2014-10-29 11:25:39,425::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137130::DEBUG::2014-10-29 11:25:39,426::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9c8ff5e-167a-4c5a-ad61-06d970c6b8ac`::moving from state init -> state preparing >Thread-137130::INFO::2014-10-29 11:25:39,426::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137130::DEBUG::2014-10-29 11:25:39,429::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:25:39,430::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:39,430::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:39,431::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:39,431::__init__::232::IOProcess::(_processLogs) (202129) Got request for method 'glob' >Thread-137130::DEBUG::2014-10-29 11:25:39,433::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:25:39,433::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202129) Queuing response >Thread-137130::DEBUG::2014-10-29 11:25:39,434::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137130::INFO::2014-10-29 11:25:39,435::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137130::DEBUG::2014-10-29 11:25:39,435::task::1191::Storage.TaskManager.Task::(prepare) Task=`e9c8ff5e-167a-4c5a-ad61-06d970c6b8ac`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137130::DEBUG::2014-10-29 11:25:39,436::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9c8ff5e-167a-4c5a-ad61-06d970c6b8ac`::moving from state preparing -> state finished >Thread-137130::DEBUG::2014-10-29 11:25:39,436::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137130::DEBUG::2014-10-29 11:25:39,436::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137130::DEBUG::2014-10-29 11:25:39,436::task::993::Storage.TaskManager.Task::(_decref) Task=`e9c8ff5e-167a-4c5a-ad61-06d970c6b8ac`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:25:39,480::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54722 >Detector thread::DEBUG::2014-10-29 11:25:39,481::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54722 >Detector thread::DEBUG::2014-10-29 11:25:39,481::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54722 >Detector thread::DEBUG::2014-10-29 11:25:39,481::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54722) >Thread-137131::DEBUG::2014-10-29 11:25:39,520::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137131::DEBUG::2014-10-29 11:25:39,520::task::595::Storage.TaskManager.Task::(_updateState) Task=`44de0b99-6467-441a-9d65-033cd7db2ad4`::moving from state init -> state preparing >Thread-137131::INFO::2014-10-29 11:25:39,521::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137131::DEBUG::2014-10-29 11:25:39,521::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137131::DEBUG::2014-10-29 11:25:39,521::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137131::DEBUG::2014-10-29 11:25:39,522::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137131::DEBUG::2014-10-29 11:25:39,522::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137131::DEBUG::2014-10-29 11:25:39,522::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137131::DEBUG::2014-10-29 11:25:39,523::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137131::DEBUG::2014-10-29 11:25:39,609::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137131::DEBUG::2014-10-29 11:25:39,610::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137131::DEBUG::2014-10-29 11:25:39,779::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137131::DEBUG::2014-10-29 11:25:39,780::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137131::DEBUG::2014-10-29 11:25:39,781::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137131::DEBUG::2014-10-29 11:25:39,781::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137131::DEBUG::2014-10-29 11:25:39,782::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137131::DEBUG::2014-10-29 11:25:39,782::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137131::DEBUG::2014-10-29 11:25:39,782::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137131::DEBUG::2014-10-29 11:25:39,783::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:25:39,788::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:39,791::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:39,792::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:39,792::__init__::232::IOProcess::(_processLogs) (202130) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:25:39,793::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202130) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:39,795::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:39,795::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:39,795::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:39,796::__init__::232::IOProcess::(_processLogs) (202131) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:25:39,796::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202131) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:39,796::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:39,797::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:39,799::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:39,800::__init__::232::IOProcess::(_processLogs) (202132) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:25:39,802::__init__::232::IOProcess::(_processLogs) (202132) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:39,808::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:39,809::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137131::DEBUG::2014-10-29 11:25:39,811::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:25:39,812::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:39,813::__init__::232::IOProcess::(_processLogs) (202133) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:25:39,814::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202133) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:39,815::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:39,815::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:39,816::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:39,816::__init__::232::IOProcess::(_processLogs) (202134) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:25:39,816::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202134) Queuing response >Thread-137131::DEBUG::2014-10-29 11:25:39,817::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:25:39,818::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:39,819::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:39,819::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:39,819::__init__::232::IOProcess::(_processLogs) (202135) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:25:39,820::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202135) Queuing response >Thread-137131::DEBUG::2014-10-29 11:25:39,820::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:25:39,822::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:39,823::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:39,823::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:39,824::__init__::232::IOProcess::(_processLogs) (202136) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:39,824::__init__::232::IOProcess::(_processLogs) (202136) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:39,825::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:39,825::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137131::DEBUG::2014-10-29 11:25:39,826::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:25:39,826::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-137131::INFO::2014-10-29 11:25:39,827::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:25:39,828::__init__::232::IOProcess::(_processLogs) (202137) Got request for method 'glob' >Thread-137131::INFO::2014-10-29 11:25:39,828::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:25:39,829::__init__::232::IOProcess::(_processLogs) (202137) Queuing response >Thread-137131::INFO::2014-10-29 11:25:39,830::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:25:39,831::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:39,831::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:39,832::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:39,832::__init__::232::IOProcess::(_processLogs) (202138) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:25:39,833::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202138) Queuing response >Thread-137131::DEBUG::2014-10-29 11:25:39,833::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137131::DEBUG::2014-10-29 11:25:39,835::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`f717f400-60db-4c2c-b402-bd830804cacd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137131::DEBUG::2014-10-29 11:25:39,836::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137131::DEBUG::2014-10-29 11:25:39,836::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137131::DEBUG::2014-10-29 11:25:39,836::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`f717f400-60db-4c2c-b402-bd830804cacd`::Granted request >Thread-137131::DEBUG::2014-10-29 11:25:39,837::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`44de0b99-6467-441a-9d65-033cd7db2ad4`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137131::DEBUG::2014-10-29 11:25:39,837::task::993::Storage.TaskManager.Task::(_decref) Task=`44de0b99-6467-441a-9d65-033cd7db2ad4`::ref 1 aborting False >Thread-137131::INFO::2014-10-29 11:25:39,840::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137131::DEBUG::2014-10-29 11:25:39,840::task::1191::Storage.TaskManager.Task::(prepare) Task=`44de0b99-6467-441a-9d65-033cd7db2ad4`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137131::DEBUG::2014-10-29 11:25:39,841::task::595::Storage.TaskManager.Task::(_updateState) Task=`44de0b99-6467-441a-9d65-033cd7db2ad4`::moving from state preparing -> state finished >Thread-137131::DEBUG::2014-10-29 11:25:39,841::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137131::DEBUG::2014-10-29 11:25:39,841::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137131::DEBUG::2014-10-29 11:25:39,842::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137131::DEBUG::2014-10-29 11:25:39,842::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137131::DEBUG::2014-10-29 11:25:39,842::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137131::DEBUG::2014-10-29 11:25:39,842::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137131::DEBUG::2014-10-29 11:25:39,843::task::993::Storage.TaskManager.Task::(_decref) Task=`44de0b99-6467-441a-9d65-033cd7db2ad4`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:25:39,865::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54723 >Detector thread::DEBUG::2014-10-29 11:25:39,865::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54723 >Detector thread::DEBUG::2014-10-29 11:25:39,866::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54723 >Detector thread::DEBUG::2014-10-29 11:25:39,866::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54723) >Thread-137136::DEBUG::2014-10-29 11:25:39,905::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137136::DEBUG::2014-10-29 11:25:39,905::task::595::Storage.TaskManager.Task::(_updateState) Task=`36418919-054d-4973-88fd-079113f715e0`::moving from state init -> state preparing >Thread-137136::INFO::2014-10-29 11:25:39,906::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137136::INFO::2014-10-29 11:25:39,907::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531971', 'lastCheck': '1.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00042923', 'lastCheck': '1.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000579711', 'lastCheck': '2.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000511889', 'lastCheck': '2.2', 'valid': True}} >Thread-137136::DEBUG::2014-10-29 11:25:39,907::task::1191::Storage.TaskManager.Task::(prepare) Task=`36418919-054d-4973-88fd-079113f715e0`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531971', 'lastCheck': '1.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00042923', 'lastCheck': '1.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000579711', 'lastCheck': '2.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000511889', 'lastCheck': '2.2', 'valid': True}} >Thread-137136::DEBUG::2014-10-29 11:25:39,907::task::595::Storage.TaskManager.Task::(_updateState) Task=`36418919-054d-4973-88fd-079113f715e0`::moving from state preparing -> state finished >Thread-137136::DEBUG::2014-10-29 11:25:39,907::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137136::DEBUG::2014-10-29 11:25:39,908::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137136::DEBUG::2014-10-29 11:25:39,908::task::993::Storage.TaskManager.Task::(_decref) Task=`36418919-054d-4973-88fd-079113f715e0`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:25:40,329::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54724 >Detector thread::DEBUG::2014-10-29 11:25:40,331::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54724 >Detector thread::DEBUG::2014-10-29 11:25:40,331::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54724 >Detector thread::DEBUG::2014-10-29 11:25:40,331::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54724) >Thread-137137::DEBUG::2014-10-29 11:25:40,370::task::595::Storage.TaskManager.Task::(_updateState) Task=`69e0f6d0-0e5f-404e-a751-4516e75ff6b0`::moving from state init -> state preparing >Thread-137137::INFO::2014-10-29 11:25:40,370::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137137::INFO::2014-10-29 11:25:40,371::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531971', 'lastCheck': '2.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00042923', 'lastCheck': '2.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000579711', 'lastCheck': '2.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000511889', 'lastCheck': '2.7', 'valid': True}} >Thread-137137::DEBUG::2014-10-29 11:25:40,371::task::1191::Storage.TaskManager.Task::(prepare) Task=`69e0f6d0-0e5f-404e-a751-4516e75ff6b0`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000531971', 'lastCheck': '2.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00042923', 'lastCheck': '2.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000579711', 'lastCheck': '2.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000511889', 'lastCheck': '2.7', 'valid': True}} >Thread-137137::DEBUG::2014-10-29 11:25:40,371::task::595::Storage.TaskManager.Task::(_updateState) Task=`69e0f6d0-0e5f-404e-a751-4516e75ff6b0`::moving from state preparing -> state finished >Thread-137137::DEBUG::2014-10-29 11:25:40,372::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137137::DEBUG::2014-10-29 11:25:40,372::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137137::DEBUG::2014-10-29 11:25:40,372::task::993::Storage.TaskManager.Task::(_decref) Task=`69e0f6d0-0e5f-404e-a751-4516e75ff6b0`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:25:40,484::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54725 >Detector thread::DEBUG::2014-10-29 11:25:40,485::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54725 >Detector thread::DEBUG::2014-10-29 11:25:40,485::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54725 >Detector thread::DEBUG::2014-10-29 11:25:40,485::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54725) >Thread-137138::DEBUG::2014-10-29 11:25:40,525::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137138::DEBUG::2014-10-29 11:25:40,527::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137138::DEBUG::2014-10-29 11:25:40,547::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137138::DEBUG::2014-10-29 11:25:40,595::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '81', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '81', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:25:40,929::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54726 >Detector thread::DEBUG::2014-10-29 11:25:40,930::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54726 >Detector thread::DEBUG::2014-10-29 11:25:40,930::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54726 >Detector thread::DEBUG::2014-10-29 11:25:40,931::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54726) >Thread-137139::DEBUG::2014-10-29 11:25:40,970::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137139::DEBUG::2014-10-29 11:25:40,971::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137139::DEBUG::2014-10-29 11:25:40,972::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.31', 'elapsedTime': '514573', 'displayType': 'vnc', 'cpuSys': '0.87', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '3251662', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '59148', 'readRate': '0.00', 'truesize': '6010888192', 'writeRate': '33909.24'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.70', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:41,360::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:41,362::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:41,365::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:41,721::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:41,723::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137140::DEBUG::2014-10-29 11:25:41,727::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:41,729::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:41,731::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137141::DEBUG::2014-10-29 11:25:41,733::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137141::DEBUG::2014-10-29 11:25:41,736::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:44,751::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:44,758::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137142::DEBUG::2014-10-29 11:25:44,768::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:44,774::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:44,779::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137143::DEBUG::2014-10-29 11:25:44,788::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137143::DEBUG::2014-10-29 11:25:44,806::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:46,372::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:46,378::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:46,383::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:25:47,718::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:47,719::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:47,719::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:47,719::__init__::232::IOProcess::(_processLogs) (202139) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:47,720::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202139) Queuing response >Thread-10269::DEBUG::2014-10-29 11:25:47,721::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain de096187-36e2-44e5-b8db-a9b67c3960de >Thread-179::DEBUG::2014-10-29 11:25:47,726::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:25:47,750::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-179::DEBUG::2014-10-29 11:25:47,754::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000525818 s, 707 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:25:47,755::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:47,757::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:47,757::__init__::232::IOProcess::(_processLogs) (202140) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:25:47,758::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202140) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:47,760::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:47,760::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:47,761::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:47,761::__init__::232::IOProcess::(_processLogs) (202141) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:25:47,761::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202141) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:47,761::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:47,762::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:47,762::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:47,762::__init__::232::IOProcess::(_processLogs) (202142) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:25:47,762::__init__::232::IOProcess::(_processLogs) (202142) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:47,763::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:47,763::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:47,764::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:47,764::__init__::232::IOProcess::(_processLogs) (202143) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:25:47,764::__init__::232::IOProcess::(_processLogs) (202143) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:47,764::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:47,765::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:47,765::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:47,765::__init__::232::IOProcess::(_processLogs) (202144) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:47,765::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202144) Queuing response >Thread-10269::DEBUG::2014-10-29 11:25:47,775::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de >Thread-17::DEBUG::2014-10-29 11:25:47,778::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:47,778::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:47,780::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:47,781::__init__::232::IOProcess::(_processLogs) (202145) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:25:47,782::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202145) Queuing response >Thread-10269::DEBUG::2014-10-29 11:25:47,783::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:25:47,784::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:47,784::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:47,784::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:47,785::__init__::232::IOProcess::(_processLogs) (202146) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:25:47,785::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202146) Queuing response >Thread-10269::DEBUG::2014-10-29 11:25:47,786::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nsednev-iso-domain', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=00000002-0002-0002-0002-000000000324,00000002-0002-0002-0002-00000000002d,00000002-0002-0002-0002-0000000003d4,00000002-0002-0002-0002-000000000321', 'REMOTE_PATH=monster-nfs.scl.lab.tlv.redhat.com:/RHEV/nsednev-iso-domain', 'ROLE=Regular', 'SDUUID=de096187-36e2-44e5-b8db-a9b67c3960de', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=4fa36e197e83f2488bfc8aea7825ed34cc463260'] >Thread-17::DEBUG::2014-10-29 11:25:47,787::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:47,788::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:47,789::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:47,789::__init__::232::IOProcess::(_processLogs) (202147) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:47,789::__init__::232::IOProcess::(_processLogs) (202147) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:47,790::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:47,790::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:47,790::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:47,790::__init__::232::IOProcess::(_processLogs) (202148) Got request for method 'glob' >Thread-10269::DEBUG::2014-10-29 11:25:47,791::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:25:47,791::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202148) Queuing response >Thread-10269::INFO::2014-10-29 11:25:47,792::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace de096187-36e2-44e5-b8db-a9b67c3960de_imageNS already registered >Thread-10269::INFO::2014-10-29 11:25:47,793::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace de096187-36e2-44e5-b8db-a9b67c3960de_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:25:47,794::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:47,794::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:47,795::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:47,795::__init__::232::IOProcess::(_processLogs) (202149) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:47,796::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202149) Queuing response >Thread-10269::DEBUG::2014-10-29 11:25:47,797::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:25:47,814::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000759896 s, 661 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:25:47,816::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:47,817::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:47,817::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:47,817::__init__::232::IOProcess::(_processLogs) (202150) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:47,819::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202150) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:47,821::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:47,824::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137148::DEBUG::2014-10-29 11:25:47,827::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:47,829::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:47,831::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137149::DEBUG::2014-10-29 11:25:47,834::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137149::DEBUG::2014-10-29 11:25:47,837::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:25:48,227::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:48,227::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:48,227::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:48,228::__init__::232::IOProcess::(_processLogs) (202151) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:48,229::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202151) Queuing response >Thread-33::DEBUG::2014-10-29 11:25:48,230::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:25:48,247::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000542127 s, 898 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:25:48,249::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:48,250::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:48,250::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:48,250::__init__::232::IOProcess::(_processLogs) (202152) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:48,252::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202152) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:48,253::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:48,254::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:48,255::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:48,255::__init__::232::IOProcess::(_processLogs) (202153) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:48,256::__init__::232::IOProcess::(_processLogs) (202153) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:48,256::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:48,257::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:48,258::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:48,258::__init__::232::IOProcess::(_processLogs) (202154) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:48,259::__init__::232::IOProcess::(_processLogs) (202154) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:48,259::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:48,260::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:48,260::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:48,261::__init__::232::IOProcess::(_processLogs) (202155) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:48,262::__init__::232::IOProcess::(_processLogs) (202155) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:48,322::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:48,322::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:48,323::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:48,323::__init__::232::IOProcess::(_processLogs) (202156) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:48,324::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202156) Queuing response >Thread-178::DEBUG::2014-10-29 11:25:48,326::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:25:48,345::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00146514 s, 347 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:25:48,347::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:48,347::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:48,347::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:48,348::__init__::232::IOProcess::(_processLogs) (202157) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:48,348::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202157) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:48,350::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:48,350::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:48,350::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:48,351::__init__::232::IOProcess::(_processLogs) (202158) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:48,351::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202158) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:48,352::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:48,352::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:48,353::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:48,353::__init__::232::IOProcess::(_processLogs) (202159) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:48,353::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202159) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:48,354::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:48,355::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:48,355::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:48,355::__init__::232::IOProcess::(_processLogs) (202160) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:48,355::__init__::232::IOProcess::(_processLogs) (202160) Queuing response >Thread-22::DEBUG::2014-10-29 11:25:50,276::task::595::Storage.TaskManager.Task::(_updateState) Task=`d328516d-21bf-40db-a5ee-0b545aad0fcd`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:25:50,279::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:25:50,281::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:50,281::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:50,281::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:50,281::__init__::232::IOProcess::(_processLogs) (202161) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:25:50,282::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202161) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:50,284::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:50,286::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:50,286::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:50,286::__init__::232::IOProcess::(_processLogs) (202162) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:25:50,287::__init__::232::IOProcess::(_processLogs) (202162) Queuing response >Thread-22::INFO::2014-10-29 11:25:50,287::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010888192', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:25:50,287::task::1191::Storage.TaskManager.Task::(prepare) Task=`d328516d-21bf-40db-a5ee-0b545aad0fcd`::finished: {'truesize': '6010888192', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:25:50,288::task::595::Storage.TaskManager.Task::(_updateState) Task=`d328516d-21bf-40db-a5ee-0b545aad0fcd`::moving from state preparing -> state finished >Thread-22::DEBUG::2014-10-29 11:25:50,288::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-10-29 11:25:50,288::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2014-10-29 11:25:50,288::task::993::Storage.TaskManager.Task::(_decref) Task=`d328516d-21bf-40db-a5ee-0b545aad0fcd`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:25:50,392::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Detector thread::DEBUG::2014-10-29 11:25:50,465::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54728 >Detector thread::DEBUG::2014-10-29 11:25:50,468::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54728 >Detector thread::DEBUG::2014-10-29 11:25:50,469::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54728 >Detector thread::DEBUG::2014-10-29 11:25:50,471::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54728) >Detector thread::DEBUG::2014-10-29 11:25:50,488::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54730 >Detector thread::DEBUG::2014-10-29 11:25:50,488::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54730 >Detector thread::DEBUG::2014-10-29 11:25:50,489::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54730 >Detector thread::DEBUG::2014-10-29 11:25:50,489::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54730) >Thread-137150::DEBUG::2014-10-29 11:25:50,508::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc6a9b95-13af-4f41-b3b3-8350a8b0df94`::moving from state init -> state preparing >Thread-137150::INFO::2014-10-29 11:25:50,508::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137150::INFO::2014-10-29 11:25:50,509::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00146514', 'lastCheck': '2.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000542127', 'lastCheck': '2.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525818', 'lastCheck': '2.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000759896', 'lastCheck': '2.7', 'valid': True}} >Thread-137150::DEBUG::2014-10-29 11:25:50,509::task::1191::Storage.TaskManager.Task::(prepare) Task=`dc6a9b95-13af-4f41-b3b3-8350a8b0df94`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00146514', 'lastCheck': '2.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000542127', 'lastCheck': '2.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525818', 'lastCheck': '2.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000759896', 'lastCheck': '2.7', 'valid': True}} >Thread-137150::DEBUG::2014-10-29 11:25:50,509::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc6a9b95-13af-4f41-b3b3-8350a8b0df94`::moving from state preparing -> state finished >Thread-137150::DEBUG::2014-10-29 11:25:50,510::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137150::DEBUG::2014-10-29 11:25:50,510::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137150::DEBUG::2014-10-29 11:25:50,510::task::993::Storage.TaskManager.Task::(_decref) Task=`dc6a9b95-13af-4f41-b3b3-8350a8b0df94`::ref 0 aborting False >Thread-137151::DEBUG::2014-10-29 11:25:50,529::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137151::DEBUG::2014-10-29 11:25:50,530::task::595::Storage.TaskManager.Task::(_updateState) Task=`1eb0adcb-2ac5-47ef-a428-a12885b41f33`::moving from state init -> state preparing >Thread-137151::INFO::2014-10-29 11:25:50,530::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137151::DEBUG::2014-10-29 11:25:50,533::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:25:50,534::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-137151::DEBUG::2014-10-29 11:25:50,535::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:25:50,536::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-137151::DEBUG::2014-10-29 11:25:50,538::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-17::DEBUG::2014-10-29 11:25:50,538::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:50,540::__init__::232::IOProcess::(_processLogs) (202163) Got request for method 'glob' >Thread-137151::INFO::2014-10-29 11:25:50,540::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-17::DEBUG::2014-10-29 11:25:50,540::__init__::232::IOProcess::(_processLogs) (202163) Queuing response >Thread-137151::DEBUG::2014-10-29 11:25:50,541::task::1191::Storage.TaskManager.Task::(prepare) Task=`1eb0adcb-2ac5-47ef-a428-a12885b41f33`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137151::DEBUG::2014-10-29 11:25:50,543::task::595::Storage.TaskManager.Task::(_updateState) Task=`1eb0adcb-2ac5-47ef-a428-a12885b41f33`::moving from state preparing -> state finished >Thread-137151::DEBUG::2014-10-29 11:25:50,546::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137151::DEBUG::2014-10-29 11:25:50,546::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137151::DEBUG::2014-10-29 11:25:50,547::task::993::Storage.TaskManager.Task::(_decref) Task=`1eb0adcb-2ac5-47ef-a428-a12885b41f33`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:25:50,592::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54731 >Detector thread::DEBUG::2014-10-29 11:25:50,592::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54731 >Detector thread::DEBUG::2014-10-29 11:25:50,593::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54731 >Detector thread::DEBUG::2014-10-29 11:25:50,593::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54731) >Thread-137152::DEBUG::2014-10-29 11:25:50,632::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137152::DEBUG::2014-10-29 11:25:50,633::task::595::Storage.TaskManager.Task::(_updateState) Task=`ec0dbe57-a3b5-477c-9bd5-379cf9e2ff82`::moving from state init -> state preparing >Thread-137152::INFO::2014-10-29 11:25:50,633::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137152::DEBUG::2014-10-29 11:25:50,633::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137152::DEBUG::2014-10-29 11:25:50,634::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137152::DEBUG::2014-10-29 11:25:50,634::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137152::DEBUG::2014-10-29 11:25:50,634::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137152::DEBUG::2014-10-29 11:25:50,635::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137152::DEBUG::2014-10-29 11:25:50,635::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Detector thread::DEBUG::2014-10-29 11:25:50,651::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54732 >Detector thread::DEBUG::2014-10-29 11:25:50,654::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54732 >Detector thread::DEBUG::2014-10-29 11:25:50,655::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54732 >Detector thread::DEBUG::2014-10-29 11:25:50,655::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54732) >Thread-137153::DEBUG::2014-10-29 11:25:50,682::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137153::DEBUG::2014-10-29 11:25:50,685::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137153::DEBUG::2014-10-29 11:25:50,704::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137152::DEBUG::2014-10-29 11:25:50,716::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137152::DEBUG::2014-10-29 11:25:50,719::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137153::DEBUG::2014-10-29 11:25:50,774::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '63', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '63', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:50,850::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:50,860::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137154::DEBUG::2014-10-29 11:25:50,864::task::595::Storage.TaskManager.Task::(_updateState) Task=`940326c3-2733-4666-9fe7-e6c2985331d2`::moving from state init -> state preparing >Thread-137154::INFO::2014-10-29 11:25:50,865::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137154::INFO::2014-10-29 11:25:50,866::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00146514', 'lastCheck': '2.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000542127', 'lastCheck': '2.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525818', 'lastCheck': '3.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000759896', 'lastCheck': '3.0', 'valid': True}} >Thread-137154::DEBUG::2014-10-29 11:25:50,866::task::1191::Storage.TaskManager.Task::(prepare) Task=`940326c3-2733-4666-9fe7-e6c2985331d2`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00146514', 'lastCheck': '2.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000542127', 'lastCheck': '2.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525818', 'lastCheck': '3.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000759896', 'lastCheck': '3.0', 'valid': True}} >Thread-137154::DEBUG::2014-10-29 11:25:50,866::task::595::Storage.TaskManager.Task::(_updateState) Task=`940326c3-2733-4666-9fe7-e6c2985331d2`::moving from state preparing -> state finished >Thread-137154::DEBUG::2014-10-29 11:25:50,866::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137154::DEBUG::2014-10-29 11:25:50,867::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137154::DEBUG::2014-10-29 11:25:50,867::task::993::Storage.TaskManager.Task::(_decref) Task=`940326c3-2733-4666-9fe7-e6c2985331d2`::ref 0 aborting False >Thread-137154::DEBUG::2014-10-29 11:25:50,895::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-137152::DEBUG::2014-10-29 11:25:50,912::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137152::DEBUG::2014-10-29 11:25:50,913::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137152::DEBUG::2014-10-29 11:25:50,913::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137152::DEBUG::2014-10-29 11:25:50,913::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137152::DEBUG::2014-10-29 11:25:50,914::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137152::DEBUG::2014-10-29 11:25:50,914::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137152::DEBUG::2014-10-29 11:25:50,915::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137152::DEBUG::2014-10-29 11:25:50,915::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:25:50,923::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:50,926::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-17::DEBUG::2014-10-29 11:25:50,927::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:50,929::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:50,931::__init__::232::IOProcess::(_processLogs) (202164) Got request for method 'glob' >JsonRpcServer::DEBUG::2014-10-29 11:25:50,932::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:25:50,935::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202164) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:50,940::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:50,942::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137159::DEBUG::2014-10-29 11:25:50,943::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:25:50,944::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:50,945::__init__::232::IOProcess::(_processLogs) (202165) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:25:50,950::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202165) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:50,956::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:50,958::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:50,961::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:50,963::__init__::232::IOProcess::(_processLogs) (202166) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:25:50,969::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202166) Queuing response >Thread-137152::DEBUG::2014-10-29 11:25:50,970::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-137159::DEBUG::2014-10-29 11:25:50,974::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:25:50,974::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:50,976::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:50,978::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:50,978::__init__::232::IOProcess::(_processLogs) (202167) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:25:50,979::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202167) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:50,981::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:50,981::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:50,981::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:50,982::__init__::232::IOProcess::(_processLogs) (202168) Got request for method 'touch' >Thread-137152::DEBUG::2014-10-29 11:25:50,983::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:25:50,983::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202168) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:50,984::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:50,984::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:50,984::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:50,985::__init__::232::IOProcess::(_processLogs) (202169) Got request for method 'readfile' >Thread-137152::DEBUG::2014-10-29 11:25:50,985::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:25:50,986::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202169) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:50,987::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:50,988::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:50,988::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:50,988::__init__::232::IOProcess::(_processLogs) (202170) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:50,989::__init__::232::IOProcess::(_processLogs) (202170) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:50,989::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:50,989::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:50,990::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:50,990::__init__::232::IOProcess::(_processLogs) (202171) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:25:50,991::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202171) Queuing response >Thread-137152::DEBUG::2014-10-29 11:25:50,991::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-137152::INFO::2014-10-29 11:25:50,992::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137152::INFO::2014-10-29 11:25:50,992::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137152::INFO::2014-10-29 11:25:50,993::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:25:50,993::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:50,994::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:50,994::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:50,994::__init__::232::IOProcess::(_processLogs) (202172) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:25:50,995::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202172) Queuing response >Thread-137152::DEBUG::2014-10-29 11:25:50,995::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137152::DEBUG::2014-10-29 11:25:50,998::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`22985899-b434-41f8-b7ed-a6f5c45c0f5f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137152::DEBUG::2014-10-29 11:25:50,998::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137152::DEBUG::2014-10-29 11:25:50,998::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137152::DEBUG::2014-10-29 11:25:50,998::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`22985899-b434-41f8-b7ed-a6f5c45c0f5f`::Granted request >Thread-137152::DEBUG::2014-10-29 11:25:50,999::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ec0dbe57-a3b5-477c-9bd5-379cf9e2ff82`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137152::DEBUG::2014-10-29 11:25:50,999::task::993::Storage.TaskManager.Task::(_decref) Task=`ec0dbe57-a3b5-477c-9bd5-379cf9e2ff82`::ref 1 aborting False >Thread-137152::INFO::2014-10-29 11:25:51,002::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137152::DEBUG::2014-10-29 11:25:51,002::task::1191::Storage.TaskManager.Task::(prepare) Task=`ec0dbe57-a3b5-477c-9bd5-379cf9e2ff82`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137152::DEBUG::2014-10-29 11:25:51,003::task::595::Storage.TaskManager.Task::(_updateState) Task=`ec0dbe57-a3b5-477c-9bd5-379cf9e2ff82`::moving from state preparing -> state finished >Thread-137152::DEBUG::2014-10-29 11:25:51,003::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137152::DEBUG::2014-10-29 11:25:51,003::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137152::DEBUG::2014-10-29 11:25:51,004::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137152::DEBUG::2014-10-29 11:25:51,004::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137152::DEBUG::2014-10-29 11:25:51,004::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137152::DEBUG::2014-10-29 11:25:51,004::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137152::DEBUG::2014-10-29 11:25:51,005::task::993::Storage.TaskManager.Task::(_decref) Task=`ec0dbe57-a3b5-477c-9bd5-379cf9e2ff82`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:25:51,026::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54733 >Detector thread::DEBUG::2014-10-29 11:25:51,027::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54733 >Detector thread::DEBUG::2014-10-29 11:25:51,027::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54733 >Detector thread::DEBUG::2014-10-29 11:25:51,028::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54733) >Thread-137160::DEBUG::2014-10-29 11:25:51,066::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137160::DEBUG::2014-10-29 11:25:51,066::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f5a9ac9-48bc-4944-9ae4-7431476094c8`::moving from state init -> state preparing >Thread-137160::INFO::2014-10-29 11:25:51,067::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137160::INFO::2014-10-29 11:25:51,067::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00146514', 'lastCheck': '2.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000542127', 'lastCheck': '2.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525818', 'lastCheck': '3.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000759896', 'lastCheck': '3.2', 'valid': True}} >Thread-137160::DEBUG::2014-10-29 11:25:51,068::task::1191::Storage.TaskManager.Task::(prepare) Task=`1f5a9ac9-48bc-4944-9ae4-7431476094c8`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00146514', 'lastCheck': '2.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000542127', 'lastCheck': '2.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525818', 'lastCheck': '3.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000759896', 'lastCheck': '3.2', 'valid': True}} >Thread-137160::DEBUG::2014-10-29 11:25:51,068::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f5a9ac9-48bc-4944-9ae4-7431476094c8`::moving from state preparing -> state finished >Thread-137160::DEBUG::2014-10-29 11:25:51,068::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137160::DEBUG::2014-10-29 11:25:51,068::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137160::DEBUG::2014-10-29 11:25:51,069::task::993::Storage.TaskManager.Task::(_decref) Task=`1f5a9ac9-48bc-4944-9ae4-7431476094c8`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:25:51,122::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54734 >Detector thread::DEBUG::2014-10-29 11:25:51,123::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54734 >Detector thread::DEBUG::2014-10-29 11:25:51,123::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54734 >Detector thread::DEBUG::2014-10-29 11:25:51,123::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54734) >Thread-137161::DEBUG::2014-10-29 11:25:51,162::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137161::DEBUG::2014-10-29 11:25:51,163::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137161::DEBUG::2014-10-29 11:25:51,164::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.99', 'elapsedTime': '514583', 'displayType': 'vnc', 'cpuSys': '0.60', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '9283554', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '73883', 'readRate': '0.00', 'truesize': '6010888192', 'writeRate': '47036.06'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.89', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:51,391::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:51,393::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:51,394::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:54,156::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:54,160::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137162::DEBUG::2014-10-29 11:25:54,163::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:54,166::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:54,168::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137163::DEBUG::2014-10-29 11:25:54,171::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137163::DEBUG::2014-10-29 11:25:54,173::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:56,399::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:56,400::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:25:56,402::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:57,217::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:57,219::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137164::DEBUG::2014-10-29 11:25:57,222::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:25:57,224::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:25:57,226::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137165::DEBUG::2014-10-29 11:25:57,229::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137165::DEBUG::2014-10-29 11:25:57,231::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:25:57,782::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:57,782::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:57,782::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:57,783::__init__::232::IOProcess::(_processLogs) (202173) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:57,783::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202173) Queuing response >Thread-179::DEBUG::2014-10-29 11:25:57,785::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:25:57,802::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000735173 s, 506 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:25:57,804::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:57,804::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:57,804::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:57,804::__init__::232::IOProcess::(_processLogs) (202174) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:57,806::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202174) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:57,820::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:57,821::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:57,821::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:57,821::__init__::232::IOProcess::(_processLogs) (202175) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:57,823::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202175) Queuing response >Thread-10269::DEBUG::2014-10-29 11:25:57,825::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:25:57,841::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000524366 s, 957 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:25:57,843::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:57,844::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:57,844::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:57,844::__init__::232::IOProcess::(_processLogs) (202176) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:57,844::__init__::232::IOProcess::(_processLogs) (202176) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:58,263::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:58,263::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:58,264::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:58,266::__init__::232::IOProcess::(_processLogs) (202177) Got request for method 'statvfs' >Thread-33::DEBUG::2014-10-29 11:25:58,266::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:25:58,282::__init__::232::IOProcess::(_processLogs) (202177) Queuing response >Thread-33::DEBUG::2014-10-29 11:25:58,285::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000525889 s, 926 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:25:58,286::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:58,287::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:58,287::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:58,287::__init__::232::IOProcess::(_processLogs) (202178) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:58,289::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202178) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:58,291::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:58,292::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:58,293::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:58,293::__init__::232::IOProcess::(_processLogs) (202179) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:58,293::__init__::232::IOProcess::(_processLogs) (202179) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:58,294::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:58,294::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:58,295::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:58,295::__init__::232::IOProcess::(_processLogs) (202180) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:58,295::__init__::232::IOProcess::(_processLogs) (202180) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:58,296::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:58,297::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:58,297::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:58,298::__init__::232::IOProcess::(_processLogs) (202181) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:58,299::__init__::232::IOProcess::(_processLogs) (202181) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:58,357::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:58,358::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:58,359::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:58,361::__init__::232::IOProcess::(_processLogs) (202182) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:25:58,361::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:25:58,362::__init__::232::IOProcess::(_processLogs) (202182) Queuing response >Thread-178::DEBUG::2014-10-29 11:25:58,381::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00055048 s, 923 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:25:58,383::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:58,383::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:58,384::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:58,384::__init__::232::IOProcess::(_processLogs) (202183) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:25:58,386::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202183) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:58,387::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:58,387::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:58,388::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:58,389::__init__::232::IOProcess::(_processLogs) (202184) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:58,389::__init__::232::IOProcess::(_processLogs) (202184) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:58,390::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:58,390::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:58,391::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:58,391::__init__::232::IOProcess::(_processLogs) (202185) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:58,392::__init__::232::IOProcess::(_processLogs) (202185) Queuing response >Thread-17::DEBUG::2014-10-29 11:25:58,392::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:25:58,392::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:25:58,393::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:25:58,394::__init__::232::IOProcess::(_processLogs) (202186) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:25:58,396::__init__::232::IOProcess::(_processLogs) (202186) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:00,246::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:00,249::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137166::DEBUG::2014-10-29 11:26:00,253::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:00,256::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:00,257::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137167::DEBUG::2014-10-29 11:26:00,261::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137167::DEBUG::2014-10-29 11:26:00,263::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:26:00,330::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54736 >Detector thread::DEBUG::2014-10-29 11:26:00,331::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54736 >Detector thread::DEBUG::2014-10-29 11:26:00,331::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54736 >Detector thread::DEBUG::2014-10-29 11:26:00,332::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54736) >Thread-137168::DEBUG::2014-10-29 11:26:00,371::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137168::DEBUG::2014-10-29 11:26:00,372::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137168::DEBUG::2014-10-29 11:26:00,372::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.99', 'elapsedTime': '514592', 'displayType': 'vnc', 'cpuSys': '0.60', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '9283554', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '73883', 'readRate': '0.00', 'truesize': '6010888192', 'writeRate': '47036.06'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.98', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:26:00,597::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54738 >Detector thread::DEBUG::2014-10-29 11:26:00,597::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54738 >Detector thread::DEBUG::2014-10-29 11:26:00,597::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54738 >Detector thread::DEBUG::2014-10-29 11:26:00,598::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54738) >Thread-137169::DEBUG::2014-10-29 11:26:00,638::task::595::Storage.TaskManager.Task::(_updateState) Task=`f7a60c95-a2ad-4a97-8eab-247799ba0587`::moving from state init -> state preparing >Thread-137169::INFO::2014-10-29 11:26:00,638::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137169::INFO::2014-10-29 11:26:00,639::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00055048', 'lastCheck': '2.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525889', 'lastCheck': '2.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000735173', 'lastCheck': '2.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000524366', 'lastCheck': '2.8', 'valid': True}} >Thread-137169::DEBUG::2014-10-29 11:26:00,639::task::1191::Storage.TaskManager.Task::(prepare) Task=`f7a60c95-a2ad-4a97-8eab-247799ba0587`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00055048', 'lastCheck': '2.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525889', 'lastCheck': '2.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000735173', 'lastCheck': '2.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000524366', 'lastCheck': '2.8', 'valid': True}} >Thread-137169::DEBUG::2014-10-29 11:26:00,640::task::595::Storage.TaskManager.Task::(_updateState) Task=`f7a60c95-a2ad-4a97-8eab-247799ba0587`::moving from state preparing -> state finished >Thread-137169::DEBUG::2014-10-29 11:26:00,640::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137169::DEBUG::2014-10-29 11:26:00,640::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137169::DEBUG::2014-10-29 11:26:00,641::task::993::Storage.TaskManager.Task::(_decref) Task=`f7a60c95-a2ad-4a97-8eab-247799ba0587`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:26:00,823::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54739 >Detector thread::DEBUG::2014-10-29 11:26:00,824::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54739 >Detector thread::DEBUG::2014-10-29 11:26:00,824::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54739 >Detector thread::DEBUG::2014-10-29 11:26:00,825::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54739) >Thread-137170::DEBUG::2014-10-29 11:26:00,864::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137170::DEBUG::2014-10-29 11:26:00,866::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137170::DEBUG::2014-10-29 11:26:00,886::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137170::DEBUG::2014-10-29 11:26:00,934::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '47', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '47', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:01,408::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:01,409::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:01,412::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:26:01,653::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54741 >Detector thread::DEBUG::2014-10-29 11:26:01,654::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54741 >Detector thread::DEBUG::2014-10-29 11:26:01,654::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54741 >Detector thread::DEBUG::2014-10-29 11:26:01,654::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54741) >Thread-137171::DEBUG::2014-10-29 11:26:01,694::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137171::DEBUG::2014-10-29 11:26:01,695::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c636e38-6044-406e-96e6-6c389a700ae4`::moving from state init -> state preparing >Thread-137171::INFO::2014-10-29 11:26:01,695::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137171::DEBUG::2014-10-29 11:26:01,698::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:26:01,699::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:01,700::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:01,700::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:01,701::__init__::232::IOProcess::(_processLogs) (202187) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:01,702::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202187) Queuing response >Thread-137171::DEBUG::2014-10-29 11:26:01,703::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137171::DEBUG::2014-10-29 11:26:01,703::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137171::INFO::2014-10-29 11:26:01,704::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137171::DEBUG::2014-10-29 11:26:01,704::task::1191::Storage.TaskManager.Task::(prepare) Task=`4c636e38-6044-406e-96e6-6c389a700ae4`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137171::DEBUG::2014-10-29 11:26:01,704::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c636e38-6044-406e-96e6-6c389a700ae4`::moving from state preparing -> state finished >Thread-137171::DEBUG::2014-10-29 11:26:01,704::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137171::DEBUG::2014-10-29 11:26:01,705::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137171::DEBUG::2014-10-29 11:26:01,705::task::993::Storage.TaskManager.Task::(_decref) Task=`4c636e38-6044-406e-96e6-6c389a700ae4`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:26:01,749::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54742 >Detector thread::DEBUG::2014-10-29 11:26:01,749::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54742 >Detector thread::DEBUG::2014-10-29 11:26:01,750::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54742 >Detector thread::DEBUG::2014-10-29 11:26:01,750::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54742) >Thread-137172::DEBUG::2014-10-29 11:26:01,789::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137172::DEBUG::2014-10-29 11:26:01,790::task::595::Storage.TaskManager.Task::(_updateState) Task=`7ee88fc4-e9a9-4bd9-be16-6b4a4b81479d`::moving from state init -> state preparing >Thread-137172::INFO::2014-10-29 11:26:01,790::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137172::DEBUG::2014-10-29 11:26:01,790::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137172::DEBUG::2014-10-29 11:26:01,791::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137172::DEBUG::2014-10-29 11:26:01,791::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137172::DEBUG::2014-10-29 11:26:01,791::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137172::DEBUG::2014-10-29 11:26:01,792::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137172::DEBUG::2014-10-29 11:26:01,792::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137172::DEBUG::2014-10-29 11:26:01,885::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137172::DEBUG::2014-10-29 11:26:01,886::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137172::DEBUG::2014-10-29 11:26:02,050::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137172::DEBUG::2014-10-29 11:26:02,051::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137172::DEBUG::2014-10-29 11:26:02,051::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137172::DEBUG::2014-10-29 11:26:02,052::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137172::DEBUG::2014-10-29 11:26:02,052::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137172::DEBUG::2014-10-29 11:26:02,053::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137172::DEBUG::2014-10-29 11:26:02,053::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137172::DEBUG::2014-10-29 11:26:02,053::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:26:02,060::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:02,062::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:02,063::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:02,063::__init__::232::IOProcess::(_processLogs) (202188) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:02,064::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202188) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:02,065::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:02,066::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:02,066::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:02,066::__init__::232::IOProcess::(_processLogs) (202189) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:02,067::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202189) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:02,069::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:02,072::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:02,073::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:02,075::__init__::232::IOProcess::(_processLogs) (202190) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:02,077::__init__::232::IOProcess::(_processLogs) (202190) Queuing response >Thread-137172::DEBUG::2014-10-29 11:26:02,081::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:26:02,083::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:02,084::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:02,084::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:02,085::__init__::232::IOProcess::(_processLogs) (202191) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:02,086::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202191) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:02,087::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:02,087::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:02,087::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:02,087::__init__::232::IOProcess::(_processLogs) (202192) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:26:02,088::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202192) Queuing response >Thread-137172::DEBUG::2014-10-29 11:26:02,089::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:26:02,090::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:02,090::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:02,090::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:02,091::__init__::232::IOProcess::(_processLogs) (202193) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:26:02,092::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202193) Queuing response >Thread-137172::DEBUG::2014-10-29 11:26:02,092::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:26:02,094::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:02,094::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:02,095::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:02,095::__init__::232::IOProcess::(_processLogs) (202194) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:02,095::__init__::232::IOProcess::(_processLogs) (202194) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:02,096::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:02,096::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:02,097::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:02,097::__init__::232::IOProcess::(_processLogs) (202195) Got request for method 'glob' >Thread-137172::DEBUG::2014-10-29 11:26:02,098::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:26:02,098::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202195) Queuing response >Thread-137172::INFO::2014-10-29 11:26:02,099::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137172::INFO::2014-10-29 11:26:02,100::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137172::INFO::2014-10-29 11:26:02,100::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:26:02,101::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:02,101::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:02,101::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:02,102::__init__::232::IOProcess::(_processLogs) (202196) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:26:02,102::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202196) Queuing response >Thread-137172::DEBUG::2014-10-29 11:26:02,103::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137172::DEBUG::2014-10-29 11:26:02,105::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`9e195b07-1e9c-47f2-8128-1abe04a02794`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137172::DEBUG::2014-10-29 11:26:02,105::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137172::DEBUG::2014-10-29 11:26:02,106::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137172::DEBUG::2014-10-29 11:26:02,106::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`9e195b07-1e9c-47f2-8128-1abe04a02794`::Granted request >Thread-137172::DEBUG::2014-10-29 11:26:02,107::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7ee88fc4-e9a9-4bd9-be16-6b4a4b81479d`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137172::DEBUG::2014-10-29 11:26:02,107::task::993::Storage.TaskManager.Task::(_decref) Task=`7ee88fc4-e9a9-4bd9-be16-6b4a4b81479d`::ref 1 aborting False >Thread-137172::INFO::2014-10-29 11:26:02,110::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137172::DEBUG::2014-10-29 11:26:02,110::task::1191::Storage.TaskManager.Task::(prepare) Task=`7ee88fc4-e9a9-4bd9-be16-6b4a4b81479d`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137172::DEBUG::2014-10-29 11:26:02,110::task::595::Storage.TaskManager.Task::(_updateState) Task=`7ee88fc4-e9a9-4bd9-be16-6b4a4b81479d`::moving from state preparing -> state finished >Thread-137172::DEBUG::2014-10-29 11:26:02,110::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137172::DEBUG::2014-10-29 11:26:02,111::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137172::DEBUG::2014-10-29 11:26:02,111::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137172::DEBUG::2014-10-29 11:26:02,111::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137172::DEBUG::2014-10-29 11:26:02,112::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137172::DEBUG::2014-10-29 11:26:02,112::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137172::DEBUG::2014-10-29 11:26:02,112::task::993::Storage.TaskManager.Task::(_decref) Task=`7ee88fc4-e9a9-4bd9-be16-6b4a4b81479d`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:26:02,134::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54743 >Detector thread::DEBUG::2014-10-29 11:26:02,135::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54743 >Detector thread::DEBUG::2014-10-29 11:26:02,135::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54743 >Detector thread::DEBUG::2014-10-29 11:26:02,136::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54743) >Thread-137177::DEBUG::2014-10-29 11:26:02,175::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137177::DEBUG::2014-10-29 11:26:02,176::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc7ca5a3-b4f2-4294-bf8b-70fa916b2b10`::moving from state init -> state preparing >Thread-137177::INFO::2014-10-29 11:26:02,176::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137177::INFO::2014-10-29 11:26:02,177::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00055048', 'lastCheck': '3.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525889', 'lastCheck': '3.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000735173', 'lastCheck': '4.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000524366', 'lastCheck': '4.3', 'valid': True}} >Thread-137177::DEBUG::2014-10-29 11:26:02,177::task::1191::Storage.TaskManager.Task::(prepare) Task=`bc7ca5a3-b4f2-4294-bf8b-70fa916b2b10`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00055048', 'lastCheck': '3.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525889', 'lastCheck': '3.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000735173', 'lastCheck': '4.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000524366', 'lastCheck': '4.3', 'valid': True}} >Thread-137177::DEBUG::2014-10-29 11:26:02,177::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc7ca5a3-b4f2-4294-bf8b-70fa916b2b10`::moving from state preparing -> state finished >Thread-137177::DEBUG::2014-10-29 11:26:02,177::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137177::DEBUG::2014-10-29 11:26:02,178::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137177::DEBUG::2014-10-29 11:26:02,178::task::993::Storage.TaskManager.Task::(_decref) Task=`bc7ca5a3-b4f2-4294-bf8b-70fa916b2b10`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:03,288::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:03,291::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137178::DEBUG::2014-10-29 11:26:03,294::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:03,296::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:03,298::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137179::DEBUG::2014-10-29 11:26:03,302::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137179::DEBUG::2014-10-29 11:26:03,304::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:26:04,592::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >Thread-22::DEBUG::2014-10-29 11:26:05,417::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:06,317::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:06,319::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137180::DEBUG::2014-10-29 11:26:06,324::task::595::Storage.TaskManager.Task::(_updateState) Task=`403a2664-aa44-49ce-bb42-3f7c29dc0d2f`::moving from state init -> state preparing >Thread-137180::INFO::2014-10-29 11:26:06,324::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137180::INFO::2014-10-29 11:26:06,325::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00055048', 'lastCheck': '7.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525889', 'lastCheck': '8.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000735173', 'lastCheck': '8.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000524366', 'lastCheck': '8.5', 'valid': True}} >Thread-137180::DEBUG::2014-10-29 11:26:06,325::task::1191::Storage.TaskManager.Task::(prepare) Task=`403a2664-aa44-49ce-bb42-3f7c29dc0d2f`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00055048', 'lastCheck': '7.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525889', 'lastCheck': '8.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000735173', 'lastCheck': '8.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000524366', 'lastCheck': '8.5', 'valid': True}} >Thread-137180::DEBUG::2014-10-29 11:26:06,325::task::595::Storage.TaskManager.Task::(_updateState) Task=`403a2664-aa44-49ce-bb42-3f7c29dc0d2f`::moving from state preparing -> state finished >Thread-137180::DEBUG::2014-10-29 11:26:06,326::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137180::DEBUG::2014-10-29 11:26:06,326::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137180::DEBUG::2014-10-29 11:26:06,326::task::993::Storage.TaskManager.Task::(_decref) Task=`403a2664-aa44-49ce-bb42-3f7c29dc0d2f`::ref 0 aborting False >Thread-137180::DEBUG::2014-10-29 11:26:06,360::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:06,382::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:06,385::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137181::DEBUG::2014-10-29 11:26:06,389::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137181::DEBUG::2014-10-29 11:26:06,392::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:06,417::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:06,419::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:06,421::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:26:07,810::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:07,811::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:07,811::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:07,811::__init__::232::IOProcess::(_processLogs) (202197) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:07,812::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202197) Queuing response >Thread-179::DEBUG::2014-10-29 11:26:07,813::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:26:07,832::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00139873 s, 266 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:26:07,834::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:07,835::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:07,835::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:07,835::__init__::232::IOProcess::(_processLogs) (202198) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:07,837::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202198) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:07,847::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:07,848::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:07,848::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:07,848::__init__::232::IOProcess::(_processLogs) (202199) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:07,850::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202199) Queuing response >Thread-10269::DEBUG::2014-10-29 11:26:07,851::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:26:07,869::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000429084 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:26:07,871::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:07,872::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:07,872::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:07,872::__init__::232::IOProcess::(_processLogs) (202200) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:07,874::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202200) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:08,299::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:08,300::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:08,300::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:08,300::__init__::232::IOProcess::(_processLogs) (202201) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:08,302::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202201) Queuing response >Thread-33::DEBUG::2014-10-29 11:26:08,303::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:26:08,320::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000611246 s, 797 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:26:08,321::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:08,322::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:08,324::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:08,326::__init__::232::IOProcess::(_processLogs) (202202) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:08,326::__init__::232::IOProcess::(_processLogs) (202202) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:08,326::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:08,327::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:08,327::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:08,327::__init__::232::IOProcess::(_processLogs) (202203) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:08,327::__init__::232::IOProcess::(_processLogs) (202203) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:08,329::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:08,329::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:08,329::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:08,330::__init__::232::IOProcess::(_processLogs) (202204) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:08,330::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202204) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:08,331::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:08,331::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:08,332::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:08,332::__init__::232::IOProcess::(_processLogs) (202205) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:08,333::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202205) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:08,397::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:08,397::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:08,397::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:08,398::__init__::232::IOProcess::(_processLogs) (202206) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:08,399::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202206) Queuing response >Thread-178::DEBUG::2014-10-29 11:26:08,401::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:26:08,417::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000495253 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:26:08,419::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:08,420::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:08,421::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:08,421::__init__::232::IOProcess::(_processLogs) (202207) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:08,423::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202207) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:08,425::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:08,425::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:08,426::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:08,426::__init__::232::IOProcess::(_processLogs) (202208) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:08,427::__init__::232::IOProcess::(_processLogs) (202208) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:08,427::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:08,428::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:08,428::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:08,428::__init__::232::IOProcess::(_processLogs) (202209) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:08,429::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202209) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:08,430::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:08,430::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:08,430::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:08,431::__init__::232::IOProcess::(_processLogs) (202210) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:08,431::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202210) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:09,434::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:09,438::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137182::DEBUG::2014-10-29 11:26:09,442::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:09,444::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:09,446::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137183::DEBUG::2014-10-29 11:26:09,449::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137183::DEBUG::2014-10-29 11:26:09,452::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:26:10,534::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54744 >Detector thread::DEBUG::2014-10-29 11:26:10,534::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54744 >Detector thread::DEBUG::2014-10-29 11:26:10,534::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54744 >Detector thread::DEBUG::2014-10-29 11:26:10,535::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54744) >Thread-137184::DEBUG::2014-10-29 11:26:10,575::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137184::DEBUG::2014-10-29 11:26:10,580::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137184::DEBUG::2014-10-29 11:26:10,584::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.63', 'elapsedTime': '514603', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '9283554', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '73883', 'readRate': '0.00', 'truesize': '6010888192', 'writeRate': '47036.06'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.16', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:26:10,690::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54745 >Detector thread::DEBUG::2014-10-29 11:26:10,691::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54745 >Detector thread::DEBUG::2014-10-29 11:26:10,692::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54745 >Detector thread::DEBUG::2014-10-29 11:26:10,692::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54745) >Thread-137185::DEBUG::2014-10-29 11:26:10,732::task::595::Storage.TaskManager.Task::(_updateState) Task=`12cbf051-8e59-4403-aac9-f92044e3f7d3`::moving from state init -> state preparing >Thread-137185::INFO::2014-10-29 11:26:10,733::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137185::INFO::2014-10-29 11:26:10,733::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495253', 'lastCheck': '2.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611246', 'lastCheck': '2.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00139873', 'lastCheck': '2.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000429084', 'lastCheck': '2.9', 'valid': True}} >Thread-137185::DEBUG::2014-10-29 11:26:10,734::task::1191::Storage.TaskManager.Task::(prepare) Task=`12cbf051-8e59-4403-aac9-f92044e3f7d3`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495253', 'lastCheck': '2.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611246', 'lastCheck': '2.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00139873', 'lastCheck': '2.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000429084', 'lastCheck': '2.9', 'valid': True}} >Thread-137185::DEBUG::2014-10-29 11:26:10,734::task::595::Storage.TaskManager.Task::(_updateState) Task=`12cbf051-8e59-4403-aac9-f92044e3f7d3`::moving from state preparing -> state finished >Thread-137185::DEBUG::2014-10-29 11:26:10,734::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137185::DEBUG::2014-10-29 11:26:10,734::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137185::DEBUG::2014-10-29 11:26:10,735::task::993::Storage.TaskManager.Task::(_decref) Task=`12cbf051-8e59-4403-aac9-f92044e3f7d3`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:26:10,983::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54747 >Detector thread::DEBUG::2014-10-29 11:26:10,983::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54747 >Detector thread::DEBUG::2014-10-29 11:26:10,984::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54747 >Detector thread::DEBUG::2014-10-29 11:26:10,984::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54747) >Thread-137186::DEBUG::2014-10-29 11:26:11,023::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137186::DEBUG::2014-10-29 11:26:11,025::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137186::DEBUG::2014-10-29 11:26:11,044::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137186::DEBUG::2014-10-29 11:26:11,090::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '32', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '32', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:11,429::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:11,430::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:11,433::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:12,470::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:12,475::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137187::DEBUG::2014-10-29 11:26:12,478::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:12,487::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:12,489::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137188::DEBUG::2014-10-29 11:26:12,492::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137188::DEBUG::2014-10-29 11:26:12,495::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:26:12,754::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54749 >Detector thread::DEBUG::2014-10-29 11:26:12,756::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54749 >Detector thread::DEBUG::2014-10-29 11:26:12,756::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54749 >Detector thread::DEBUG::2014-10-29 11:26:12,757::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54749) >Thread-137189::DEBUG::2014-10-29 11:26:12,797::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137189::DEBUG::2014-10-29 11:26:12,798::task::595::Storage.TaskManager.Task::(_updateState) Task=`f19924d8-473b-4dce-b8a1-b2f8324410a2`::moving from state init -> state preparing >Thread-137189::INFO::2014-10-29 11:26:12,799::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137189::DEBUG::2014-10-29 11:26:12,814::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:26:12,815::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:12,815::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:12,816::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:12,816::__init__::232::IOProcess::(_processLogs) (202211) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:12,816::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202211) Queuing response >Thread-137189::DEBUG::2014-10-29 11:26:12,817::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137189::DEBUG::2014-10-29 11:26:12,817::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137189::INFO::2014-10-29 11:26:12,818::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137189::DEBUG::2014-10-29 11:26:12,818::task::1191::Storage.TaskManager.Task::(prepare) Task=`f19924d8-473b-4dce-b8a1-b2f8324410a2`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137189::DEBUG::2014-10-29 11:26:12,818::task::595::Storage.TaskManager.Task::(_updateState) Task=`f19924d8-473b-4dce-b8a1-b2f8324410a2`::moving from state preparing -> state finished >Thread-137189::DEBUG::2014-10-29 11:26:12,819::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137189::DEBUG::2014-10-29 11:26:12,819::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137189::DEBUG::2014-10-29 11:26:12,819::task::993::Storage.TaskManager.Task::(_decref) Task=`f19924d8-473b-4dce-b8a1-b2f8324410a2`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:26:12,863::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54750 >Detector thread::DEBUG::2014-10-29 11:26:12,864::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54750 >Detector thread::DEBUG::2014-10-29 11:26:12,864::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54750 >Detector thread::DEBUG::2014-10-29 11:26:12,865::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54750) >Thread-137190::DEBUG::2014-10-29 11:26:12,903::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137190::DEBUG::2014-10-29 11:26:12,904::task::595::Storage.TaskManager.Task::(_updateState) Task=`02110351-f518-495e-9ccc-eca5b480809d`::moving from state init -> state preparing >Thread-137190::INFO::2014-10-29 11:26:12,904::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137190::DEBUG::2014-10-29 11:26:12,904::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137190::DEBUG::2014-10-29 11:26:12,905::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137190::DEBUG::2014-10-29 11:26:12,905::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137190::DEBUG::2014-10-29 11:26:12,905::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137190::DEBUG::2014-10-29 11:26:12,905::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137190::DEBUG::2014-10-29 11:26:12,906::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137190::DEBUG::2014-10-29 11:26:12,984::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137190::DEBUG::2014-10-29 11:26:12,985::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137190::DEBUG::2014-10-29 11:26:13,163::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137190::DEBUG::2014-10-29 11:26:13,164::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137190::DEBUG::2014-10-29 11:26:13,164::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137190::DEBUG::2014-10-29 11:26:13,164::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137190::DEBUG::2014-10-29 11:26:13,165::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137190::DEBUG::2014-10-29 11:26:13,165::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137190::DEBUG::2014-10-29 11:26:13,166::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137190::DEBUG::2014-10-29 11:26:13,166::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:26:13,175::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:13,176::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:13,177::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:13,178::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202212) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:13,179::__init__::232::IOProcess::(_processLogs) (202212) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:13,180::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:13,180::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:13,180::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:13,180::__init__::232::IOProcess::(_processLogs) (202213) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:13,181::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:13,181::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:13,181::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:13,181::__init__::232::IOProcess::(_processLogs) (202214) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:13,182::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:13,182::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:13,182::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:13,183::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202215) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:13,184::__init__::232::IOProcess::(_processLogs) (202214) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:13,184::__init__::232::IOProcess::(_processLogs) (202215) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:13,185::__init__::232::IOProcess::(_processLogs) (202213) Queuing response >Thread-137190::DEBUG::2014-10-29 11:26:13,189::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:26:13,190::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:13,191::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:13,191::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:13,191::__init__::232::IOProcess::(_processLogs) (202216) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:26:13,192::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202216) Queuing response >Thread-137190::DEBUG::2014-10-29 11:26:13,193::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:26:13,194::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:13,194::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:13,194::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:13,195::__init__::232::IOProcess::(_processLogs) (202217) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:26:13,195::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202217) Queuing response >Thread-137190::DEBUG::2014-10-29 11:26:13,196::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:26:13,197::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:13,198::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:13,199::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:13,199::__init__::232::IOProcess::(_processLogs) (202218) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:13,199::__init__::232::IOProcess::(_processLogs) (202218) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:13,200::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:13,200::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:13,200::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:13,201::__init__::232::IOProcess::(_processLogs) (202219) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:13,201::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202219) Queuing response >Thread-137190::DEBUG::2014-10-29 11:26:13,202::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-137190::INFO::2014-10-29 11:26:13,203::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137190::INFO::2014-10-29 11:26:13,203::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137190::INFO::2014-10-29 11:26:13,203::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:26:13,204::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:13,204::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:13,205::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:13,205::__init__::232::IOProcess::(_processLogs) (202220) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:26:13,206::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202220) Queuing response >Thread-137190::DEBUG::2014-10-29 11:26:13,206::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137190::DEBUG::2014-10-29 11:26:13,208::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`1f177e59-90f8-4660-b0d6-6707b6d642eb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137190::DEBUG::2014-10-29 11:26:13,209::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137190::DEBUG::2014-10-29 11:26:13,209::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137190::DEBUG::2014-10-29 11:26:13,209::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`1f177e59-90f8-4660-b0d6-6707b6d642eb`::Granted request >Thread-137190::DEBUG::2014-10-29 11:26:13,210::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`02110351-f518-495e-9ccc-eca5b480809d`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137190::DEBUG::2014-10-29 11:26:13,210::task::993::Storage.TaskManager.Task::(_decref) Task=`02110351-f518-495e-9ccc-eca5b480809d`::ref 1 aborting False >Thread-137190::INFO::2014-10-29 11:26:13,213::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137190::DEBUG::2014-10-29 11:26:13,213::task::1191::Storage.TaskManager.Task::(prepare) Task=`02110351-f518-495e-9ccc-eca5b480809d`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137190::DEBUG::2014-10-29 11:26:13,214::task::595::Storage.TaskManager.Task::(_updateState) Task=`02110351-f518-495e-9ccc-eca5b480809d`::moving from state preparing -> state finished >Thread-137190::DEBUG::2014-10-29 11:26:13,214::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137190::DEBUG::2014-10-29 11:26:13,214::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137190::DEBUG::2014-10-29 11:26:13,215::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137190::DEBUG::2014-10-29 11:26:13,215::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137190::DEBUG::2014-10-29 11:26:13,215::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137190::DEBUG::2014-10-29 11:26:13,215::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137190::DEBUG::2014-10-29 11:26:13,216::task::993::Storage.TaskManager.Task::(_decref) Task=`02110351-f518-495e-9ccc-eca5b480809d`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:26:13,238::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54751 >Detector thread::DEBUG::2014-10-29 11:26:13,239::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54751 >Detector thread::DEBUG::2014-10-29 11:26:13,239::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54751 >Detector thread::DEBUG::2014-10-29 11:26:13,240::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54751) >Thread-137195::DEBUG::2014-10-29 11:26:13,278::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137195::DEBUG::2014-10-29 11:26:13,279::task::595::Storage.TaskManager.Task::(_updateState) Task=`cb043b7d-224c-4914-b1fd-e778e5b1db76`::moving from state init -> state preparing >Thread-137195::INFO::2014-10-29 11:26:13,279::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137195::INFO::2014-10-29 11:26:13,280::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495253', 'lastCheck': '4.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611246', 'lastCheck': '4.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00139873', 'lastCheck': '5.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000429084', 'lastCheck': '5.4', 'valid': True}} >Thread-137195::DEBUG::2014-10-29 11:26:13,280::task::1191::Storage.TaskManager.Task::(prepare) Task=`cb043b7d-224c-4914-b1fd-e778e5b1db76`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000495253', 'lastCheck': '4.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611246', 'lastCheck': '4.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00139873', 'lastCheck': '5.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000429084', 'lastCheck': '5.4', 'valid': True}} >Thread-137195::DEBUG::2014-10-29 11:26:13,280::task::595::Storage.TaskManager.Task::(_updateState) Task=`cb043b7d-224c-4914-b1fd-e778e5b1db76`::moving from state preparing -> state finished >Thread-137195::DEBUG::2014-10-29 11:26:13,281::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137195::DEBUG::2014-10-29 11:26:13,281::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137195::DEBUG::2014-10-29 11:26:13,281::task::993::Storage.TaskManager.Task::(_decref) Task=`cb043b7d-224c-4914-b1fd-e778e5b1db76`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:15,511::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:15,514::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137196::DEBUG::2014-10-29 11:26:15,518::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:15,520::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:15,522::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137197::DEBUG::2014-10-29 11:26:15,525::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137197::DEBUG::2014-10-29 11:26:15,528::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:16,442::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:16,447::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:16,454::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:26:17,840::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:17,841::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:17,841::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:17,841::__init__::232::IOProcess::(_processLogs) (202221) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:17,842::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202221) Queuing response >Thread-179::DEBUG::2014-10-29 11:26:17,843::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:26:17,860::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000520919 s, 714 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:26:17,862::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:17,862::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:17,863::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:17,863::__init__::232::IOProcess::(_processLogs) (202222) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:17,864::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202222) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:17,876::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:17,876::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:17,877::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:17,877::__init__::232::IOProcess::(_processLogs) (202223) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:17,877::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202223) Queuing response >Thread-10269::DEBUG::2014-10-29 11:26:17,879::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:26:17,896::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000942777 s, 532 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:26:17,897::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:17,898::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:17,900::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:17,901::__init__::232::IOProcess::(_processLogs) (202224) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:17,902::__init__::232::IOProcess::(_processLogs) (202224) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:18,335::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:18,335::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:18,335::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:18,336::__init__::232::IOProcess::(_processLogs) (202225) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:18,337::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202225) Queuing response >Thread-33::DEBUG::2014-10-29 11:26:18,338::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:26:18,358::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000571676 s, 852 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:26:18,360::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:18,362::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:18,362::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:18,363::__init__::232::IOProcess::(_processLogs) (202226) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:18,363::__init__::232::IOProcess::(_processLogs) (202226) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:18,364::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:18,364::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:18,364::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:18,364::__init__::232::IOProcess::(_processLogs) (202227) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:18,365::__init__::232::IOProcess::(_processLogs) (202227) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:18,366::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:18,366::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:18,366::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:18,367::__init__::232::IOProcess::(_processLogs) (202228) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:18,367::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202228) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:18,368::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:18,369::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:18,370::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:18,370::__init__::232::IOProcess::(_processLogs) (202229) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:18,371::__init__::232::IOProcess::(_processLogs) (202229) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:18,433::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:18,435::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:18,437::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-178::DEBUG::2014-10-29 11:26:18,437::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:26:18,439::__init__::232::IOProcess::(_processLogs) (202230) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:18,454::__init__::232::IOProcess::(_processLogs) (202230) Queuing response >Thread-178::DEBUG::2014-10-29 11:26:18,456::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00042267 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:26:18,457::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:18,458::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:18,459::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:18,461::__init__::232::IOProcess::(_processLogs) (202231) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:18,461::__init__::232::IOProcess::(_processLogs) (202231) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:18,462::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:18,462::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:18,463::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:18,463::__init__::232::IOProcess::(_processLogs) (202232) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:18,464::__init__::232::IOProcess::(_processLogs) (202232) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:18,464::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:18,464::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:18,465::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:18,466::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202233) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:18,466::__init__::232::IOProcess::(_processLogs) (202233) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:18,467::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:18,467::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:18,468::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:18,468::__init__::232::IOProcess::(_processLogs) (202234) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:18,469::__init__::232::IOProcess::(_processLogs) (202234) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:18,542::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:18,544::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137198::DEBUG::2014-10-29 11:26:18,548::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:18,551::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:18,553::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137199::DEBUG::2014-10-29 11:26:18,556::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137199::DEBUG::2014-10-29 11:26:18,558::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:26:20,444::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Detector thread::DEBUG::2014-10-29 11:26:20,745::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54752 >Detector thread::DEBUG::2014-10-29 11:26:20,746::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54752 >Detector thread::DEBUG::2014-10-29 11:26:20,746::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54752 >Detector thread::DEBUG::2014-10-29 11:26:20,747::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54752) >Thread-137200::DEBUG::2014-10-29 11:26:20,787::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137200::DEBUG::2014-10-29 11:26:20,789::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137200::DEBUG::2014-10-29 11:26:20,790::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.1', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '13.69', 'elapsedTime': '514613', 'displayType': 'vnc', 'cpuSys': '1.26', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '9283554', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '73883', 'readRate': '0.00', 'truesize': '6010888192', 'writeRate': '47036.06'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.36', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:26:20,794::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54753 >Detector thread::DEBUG::2014-10-29 11:26:20,796::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54753 >Detector thread::DEBUG::2014-10-29 11:26:20,796::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54753 >Detector thread::DEBUG::2014-10-29 11:26:20,796::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54753) >Thread-137201::DEBUG::2014-10-29 11:26:20,837::task::595::Storage.TaskManager.Task::(_updateState) Task=`afb91f55-c189-4691-bda5-56603860e387`::moving from state init -> state preparing >Thread-137201::INFO::2014-10-29 11:26:20,838::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137201::INFO::2014-10-29 11:26:20,839::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00042267', 'lastCheck': '2.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571676', 'lastCheck': '2.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520919', 'lastCheck': '3.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000942777', 'lastCheck': '2.9', 'valid': True}} >Thread-137201::DEBUG::2014-10-29 11:26:20,839::task::1191::Storage.TaskManager.Task::(prepare) Task=`afb91f55-c189-4691-bda5-56603860e387`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00042267', 'lastCheck': '2.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571676', 'lastCheck': '2.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520919', 'lastCheck': '3.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000942777', 'lastCheck': '2.9', 'valid': True}} >Thread-137201::DEBUG::2014-10-29 11:26:20,839::task::595::Storage.TaskManager.Task::(_updateState) Task=`afb91f55-c189-4691-bda5-56603860e387`::moving from state preparing -> state finished >Thread-137201::DEBUG::2014-10-29 11:26:20,840::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137201::DEBUG::2014-10-29 11:26:20,840::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137201::DEBUG::2014-10-29 11:26:20,840::task::993::Storage.TaskManager.Task::(_decref) Task=`afb91f55-c189-4691-bda5-56603860e387`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:26:21,139::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54755 >Detector thread::DEBUG::2014-10-29 11:26:21,140::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54755 >Detector thread::DEBUG::2014-10-29 11:26:21,140::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54755 >Detector thread::DEBUG::2014-10-29 11:26:21,141::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54755) >Thread-137202::DEBUG::2014-10-29 11:26:21,179::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137202::DEBUG::2014-10-29 11:26:21,180::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137202::DEBUG::2014-10-29 11:26:21,198::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137202::DEBUG::2014-10-29 11:26:21,244::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '16', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '16', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:21,464::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:21,465::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:21,467::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:21,570::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:21,573::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137203::DEBUG::2014-10-29 11:26:21,577::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce5e6803-c239-41c6-a6cc-438fb08d72d4`::moving from state init -> state preparing >Thread-137203::INFO::2014-10-29 11:26:21,577::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137203::INFO::2014-10-29 11:26:21,578::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00042267', 'lastCheck': '3.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571676', 'lastCheck': '3.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520919', 'lastCheck': '3.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000942777', 'lastCheck': '3.7', 'valid': True}} >Thread-137203::DEBUG::2014-10-29 11:26:21,578::task::1191::Storage.TaskManager.Task::(prepare) Task=`ce5e6803-c239-41c6-a6cc-438fb08d72d4`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00042267', 'lastCheck': '3.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571676', 'lastCheck': '3.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520919', 'lastCheck': '3.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000942777', 'lastCheck': '3.7', 'valid': True}} >Thread-137203::DEBUG::2014-10-29 11:26:21,578::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce5e6803-c239-41c6-a6cc-438fb08d72d4`::moving from state preparing -> state finished >Thread-137203::DEBUG::2014-10-29 11:26:21,579::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137203::DEBUG::2014-10-29 11:26:21,579::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137203::DEBUG::2014-10-29 11:26:21,579::task::993::Storage.TaskManager.Task::(_decref) Task=`ce5e6803-c239-41c6-a6cc-438fb08d72d4`::ref 0 aborting False >Thread-137203::DEBUG::2014-10-29 11:26:21,600::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:21,624::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:21,625::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137204::DEBUG::2014-10-29 11:26:21,628::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137204::DEBUG::2014-10-29 11:26:21,632::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:26:24,649::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54757 >Detector thread::DEBUG::2014-10-29 11:26:24,650::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54757 >Detector thread::DEBUG::2014-10-29 11:26:24,650::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54757 >Detector thread::DEBUG::2014-10-29 11:26:24,651::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54757) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:24,680::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:24,685::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137206::DEBUG::2014-10-29 11:26:24,691::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-137205::DEBUG::2014-10-29 11:26:24,698::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:24,700::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-137205::DEBUG::2014-10-29 11:26:24,706::task::595::Storage.TaskManager.Task::(_updateState) Task=`6cd38d25-a9f9-4791-b285-8d1beed2b3b5`::moving from state init -> state preparing >Thread-137205::INFO::2014-10-29 11:26:24,710::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >JsonRpcServer::DEBUG::2014-10-29 11:26:24,711::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137207::DEBUG::2014-10-29 11:26:24,728::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137205::DEBUG::2014-10-29 11:26:24,740::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:26:24,744::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:24,745::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:24,747::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:24,748::__init__::232::IOProcess::(_processLogs) (202235) Got request for method 'glob' >Thread-137207::DEBUG::2014-10-29 11:26:24,750::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-137205::DEBUG::2014-10-29 11:26:25,776::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:26:25,776::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202235) Queuing response >Thread-137205::DEBUG::2014-10-29 11:26:25,778::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137205::INFO::2014-10-29 11:26:25,779::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137205::DEBUG::2014-10-29 11:26:25,779::task::1191::Storage.TaskManager.Task::(prepare) Task=`6cd38d25-a9f9-4791-b285-8d1beed2b3b5`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137205::DEBUG::2014-10-29 11:26:25,779::task::595::Storage.TaskManager.Task::(_updateState) Task=`6cd38d25-a9f9-4791-b285-8d1beed2b3b5`::moving from state preparing -> state finished >Thread-137205::DEBUG::2014-10-29 11:26:25,780::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137205::DEBUG::2014-10-29 11:26:25,780::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137205::DEBUG::2014-10-29 11:26:25,780::task::993::Storage.TaskManager.Task::(_decref) Task=`6cd38d25-a9f9-4791-b285-8d1beed2b3b5`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:26:25,830::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54758 >Detector thread::DEBUG::2014-10-29 11:26:25,831::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54758 >Detector thread::DEBUG::2014-10-29 11:26:25,832::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54758 >Detector thread::DEBUG::2014-10-29 11:26:25,832::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54758) >Thread-137208::DEBUG::2014-10-29 11:26:25,870::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137208::DEBUG::2014-10-29 11:26:25,871::task::595::Storage.TaskManager.Task::(_updateState) Task=`719db993-6e34-4cb9-8ad9-a0c3f329ea0c`::moving from state init -> state preparing >Thread-137208::INFO::2014-10-29 11:26:25,871::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137208::DEBUG::2014-10-29 11:26:25,872::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137208::DEBUG::2014-10-29 11:26:25,872::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137208::DEBUG::2014-10-29 11:26:25,872::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137208::DEBUG::2014-10-29 11:26:25,872::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137208::DEBUG::2014-10-29 11:26:25,873::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137208::DEBUG::2014-10-29 11:26:25,873::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137208::DEBUG::2014-10-29 11:26:25,967::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137208::DEBUG::2014-10-29 11:26:25,968::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137208::DEBUG::2014-10-29 11:26:26,134::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137208::DEBUG::2014-10-29 11:26:26,136::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137208::DEBUG::2014-10-29 11:26:26,136::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137208::DEBUG::2014-10-29 11:26:26,137::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137208::DEBUG::2014-10-29 11:26:26,137::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137208::DEBUG::2014-10-29 11:26:26,137::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137208::DEBUG::2014-10-29 11:26:26,138::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137208::DEBUG::2014-10-29 11:26:26,138::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:26:26,144::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:26,147::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:26,148::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:26,148::__init__::232::IOProcess::(_processLogs) (202236) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:26,149::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202236) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:26,151::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:26,151::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:26,151::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:26,152::__init__::232::IOProcess::(_processLogs) (202237) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:26,152::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202237) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:26,154::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:26,156::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:26,157::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:26,159::__init__::232::IOProcess::(_processLogs) (202238) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:26,163::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202238) Queuing response >Thread-137208::DEBUG::2014-10-29 11:26:26,167::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:26:26,167::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:26,169::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:26,170::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:26,171::__init__::232::IOProcess::(_processLogs) (202239) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:26,171::__init__::232::IOProcess::(_processLogs) (202239) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:26,171::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:26,172::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:26,172::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:26,172::__init__::232::IOProcess::(_processLogs) (202240) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:26:26,173::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202240) Queuing response >Thread-137208::DEBUG::2014-10-29 11:26:26,174::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:26:26,175::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:26,175::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:26,176::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:26,176::__init__::232::IOProcess::(_processLogs) (202241) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:26:26,177::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202241) Queuing response >Thread-137208::DEBUG::2014-10-29 11:26:26,177::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:26:26,179::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:26,180::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:26,180::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:26,181::__init__::232::IOProcess::(_processLogs) (202242) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:26,181::__init__::232::IOProcess::(_processLogs) (202242) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:26,181::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:26,182::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:26,182::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:26,182::__init__::232::IOProcess::(_processLogs) (202243) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:26,183::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202243) Queuing response >Thread-137208::DEBUG::2014-10-29 11:26:26,183::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-137208::INFO::2014-10-29 11:26:26,184::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137208::INFO::2014-10-29 11:26:26,184::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137208::INFO::2014-10-29 11:26:26,185::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:26:26,186::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:26,186::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:26,186::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:26,186::__init__::232::IOProcess::(_processLogs) (202244) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:26:26,187::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202244) Queuing response >Thread-137208::DEBUG::2014-10-29 11:26:26,187::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137208::DEBUG::2014-10-29 11:26:26,190::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`a1c6c48b-9e75-4725-a758-da3430c772ff`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137208::DEBUG::2014-10-29 11:26:26,190::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137208::DEBUG::2014-10-29 11:26:26,190::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137208::DEBUG::2014-10-29 11:26:26,191::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`a1c6c48b-9e75-4725-a758-da3430c772ff`::Granted request >Thread-137208::DEBUG::2014-10-29 11:26:26,191::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`719db993-6e34-4cb9-8ad9-a0c3f329ea0c`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137208::DEBUG::2014-10-29 11:26:26,192::task::993::Storage.TaskManager.Task::(_decref) Task=`719db993-6e34-4cb9-8ad9-a0c3f329ea0c`::ref 1 aborting False >Thread-137208::INFO::2014-10-29 11:26:26,194::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137208::DEBUG::2014-10-29 11:26:26,195::task::1191::Storage.TaskManager.Task::(prepare) Task=`719db993-6e34-4cb9-8ad9-a0c3f329ea0c`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137208::DEBUG::2014-10-29 11:26:26,195::task::595::Storage.TaskManager.Task::(_updateState) Task=`719db993-6e34-4cb9-8ad9-a0c3f329ea0c`::moving from state preparing -> state finished >Thread-137208::DEBUG::2014-10-29 11:26:26,195::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137208::DEBUG::2014-10-29 11:26:26,195::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137208::DEBUG::2014-10-29 11:26:26,196::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137208::DEBUG::2014-10-29 11:26:26,196::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137208::DEBUG::2014-10-29 11:26:26,196::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137208::DEBUG::2014-10-29 11:26:26,197::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137208::DEBUG::2014-10-29 11:26:26,197::task::993::Storage.TaskManager.Task::(_decref) Task=`719db993-6e34-4cb9-8ad9-a0c3f329ea0c`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:26:26,230::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54759 >Detector thread::DEBUG::2014-10-29 11:26:26,230::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54759 >Detector thread::DEBUG::2014-10-29 11:26:26,231::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54759 >Detector thread::DEBUG::2014-10-29 11:26:26,231::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54759) >Thread-137213::DEBUG::2014-10-29 11:26:26,270::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137213::DEBUG::2014-10-29 11:26:26,270::task::595::Storage.TaskManager.Task::(_updateState) Task=`89308752-e18c-4e31-99cd-798712ec17d2`::moving from state init -> state preparing >Thread-137213::INFO::2014-10-29 11:26:26,271::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137213::INFO::2014-10-29 11:26:26,271::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00042267', 'lastCheck': '7.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571676', 'lastCheck': '7.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520919', 'lastCheck': '8.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000942777', 'lastCheck': '8.4', 'valid': True}} >Thread-137213::DEBUG::2014-10-29 11:26:26,272::task::1191::Storage.TaskManager.Task::(prepare) Task=`89308752-e18c-4e31-99cd-798712ec17d2`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00042267', 'lastCheck': '7.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571676', 'lastCheck': '7.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000520919', 'lastCheck': '8.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000942777', 'lastCheck': '8.4', 'valid': True}} >Thread-137213::DEBUG::2014-10-29 11:26:26,272::task::595::Storage.TaskManager.Task::(_updateState) Task=`89308752-e18c-4e31-99cd-798712ec17d2`::moving from state preparing -> state finished >Thread-137213::DEBUG::2014-10-29 11:26:26,272::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137213::DEBUG::2014-10-29 11:26:26,273::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137213::DEBUG::2014-10-29 11:26:26,273::task::993::Storage.TaskManager.Task::(_decref) Task=`89308752-e18c-4e31-99cd-798712ec17d2`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:26,474::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:26,476::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:26,479::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:26:27,869::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:27,869::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:27,869::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:27,870::__init__::232::IOProcess::(_processLogs) (202245) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:27,870::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202245) Queuing response >Thread-179::DEBUG::2014-10-29 11:26:27,872::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:26:27,890::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000491324 s, 757 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:26:27,892::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:27,892::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:27,894::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:27,895::__init__::232::IOProcess::(_processLogs) (202246) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:27,896::__init__::232::IOProcess::(_processLogs) (202246) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:27,902::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:27,903::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:27,903::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:27,904::__init__::232::IOProcess::(_processLogs) (202247) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:27,905::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202247) Queuing response >Thread-10269::DEBUG::2014-10-29 11:26:27,907::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:26:27,930::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.0056851 s, 88.3 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:26:27,932::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:27,932::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:27,933::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:27,933::__init__::232::IOProcess::(_processLogs) (202248) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:27,935::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202248) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:28,372::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:28,373::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:28,374::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:28,374::__init__::232::IOProcess::(_processLogs) (202249) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:28,375::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202249) Queuing response >Thread-33::DEBUG::2014-10-29 11:26:28,377::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:26:28,394::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000572256 s, 851 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:26:28,396::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:28,396::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:28,399::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:28,400::__init__::232::IOProcess::(_processLogs) (202250) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:28,400::__init__::232::IOProcess::(_processLogs) (202250) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:28,401::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:28,402::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:28,402::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:28,403::__init__::232::IOProcess::(_processLogs) (202251) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:28,403::__init__::232::IOProcess::(_processLogs) (202251) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:28,403::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:28,404::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:28,404::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:28,405::__init__::232::IOProcess::(_processLogs) (202252) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:28,405::__init__::232::IOProcess::(_processLogs) (202252) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:28,406::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:28,406::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:28,407::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:28,408::__init__::232::IOProcess::(_processLogs) (202253) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:28,409::__init__::232::IOProcess::(_processLogs) (202253) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:28,470::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:28,471::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:28,471::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:28,471::__init__::232::IOProcess::(_processLogs) (202254) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:28,472::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202254) Queuing response >Thread-178::DEBUG::2014-10-29 11:26:28,474::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:26:28,491::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000515866 s, 985 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:26:28,493::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:28,493::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:28,494::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:28,494::__init__::232::IOProcess::(_processLogs) (202255) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:28,496::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202255) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:28,498::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:28,499::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:28,500::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:28,500::__init__::232::IOProcess::(_processLogs) (202256) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:28,500::__init__::232::IOProcess::(_processLogs) (202256) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:28,501::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:28,501::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:28,502::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:28,503::__init__::232::IOProcess::(_processLogs) (202257) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:28,503::__init__::232::IOProcess::(_processLogs) (202257) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:28,504::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:28,504::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:28,504::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:28,504::__init__::232::IOProcess::(_processLogs) (202258) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:28,505::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202258) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:28,818::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:28,820::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137214::DEBUG::2014-10-29 11:26:28,824::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:28,826::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:28,828::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137215::DEBUG::2014-10-29 11:26:28,831::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137215::DEBUG::2014-10-29 11:26:28,834::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:26:30,293::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54760 >Detector thread::DEBUG::2014-10-29 11:26:30,293::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54760 >Detector thread::DEBUG::2014-10-29 11:26:30,294::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54760 >Detector thread::DEBUG::2014-10-29 11:26:30,294::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54760) >Thread-137216::DEBUG::2014-10-29 11:26:30,333::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137216::DEBUG::2014-10-29 11:26:30,335::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137216::DEBUG::2014-10-29 11:26:30,354::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137216::DEBUG::2014-10-29 11:26:30,405::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '101', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '0', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:26:30,911::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54761 >Detector thread::DEBUG::2014-10-29 11:26:30,912::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54761 >Detector thread::DEBUG::2014-10-29 11:26:30,912::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54761 >Detector thread::DEBUG::2014-10-29 11:26:30,913::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54761) >Thread-137217::DEBUG::2014-10-29 11:26:30,952::task::595::Storage.TaskManager.Task::(_updateState) Task=`caca4727-be5a-4171-8477-95044e4bb260`::moving from state init -> state preparing >Detector thread::DEBUG::2014-10-29 11:26:30,952::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54762 >Thread-137217::INFO::2014-10-29 11:26:30,953::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Detector thread::DEBUG::2014-10-29 11:26:30,955::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54762 >Thread-137217::INFO::2014-10-29 11:26:30,957::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515866', 'lastCheck': '2.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572256', 'lastCheck': '2.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491324', 'lastCheck': '3.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0056851', 'lastCheck': '3.0', 'valid': True}} >Detector thread::DEBUG::2014-10-29 11:26:30,957::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54762 >Thread-137217::DEBUG::2014-10-29 11:26:30,958::task::1191::Storage.TaskManager.Task::(prepare) Task=`caca4727-be5a-4171-8477-95044e4bb260`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515866', 'lastCheck': '2.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572256', 'lastCheck': '2.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491324', 'lastCheck': '3.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0056851', 'lastCheck': '3.0', 'valid': True}} >Detector thread::DEBUG::2014-10-29 11:26:30,959::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54762) >Thread-137217::DEBUG::2014-10-29 11:26:30,960::task::595::Storage.TaskManager.Task::(_updateState) Task=`caca4727-be5a-4171-8477-95044e4bb260`::moving from state preparing -> state finished >Thread-137217::DEBUG::2014-10-29 11:26:30,962::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137217::DEBUG::2014-10-29 11:26:30,963::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137217::DEBUG::2014-10-29 11:26:30,964::task::993::Storage.TaskManager.Task::(_decref) Task=`caca4727-be5a-4171-8477-95044e4bb260`::ref 0 aborting False >Thread-137218::DEBUG::2014-10-29 11:26:30,996::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137218::DEBUG::2014-10-29 11:26:31,000::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137218::DEBUG::2014-10-29 11:26:31,004::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.1', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '13.69', 'elapsedTime': '514623', 'displayType': 'vnc', 'cpuSys': '1.26', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '9283554', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '73883', 'readRate': '0.00', 'truesize': '6010888192', 'writeRate': '47036.06'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.55', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:31,486::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:31,487::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:31,489::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:31,847::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:31,850::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137219::DEBUG::2014-10-29 11:26:31,853::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:31,855::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:31,857::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137220::DEBUG::2014-10-29 11:26:31,860::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137220::DEBUG::2014-10-29 11:26:31,862::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:26:34,620::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:34,875::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:34,878::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137221::DEBUG::2014-10-29 11:26:34,881::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:34,887::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:34,888::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137222::DEBUG::2014-10-29 11:26:34,891::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137222::DEBUG::2014-10-29 11:26:34,894::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:26:35,468::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:36,497::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:36,499::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:36,500::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:26:36,853::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54765 >Detector thread::DEBUG::2014-10-29 11:26:36,854::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54765 >Detector thread::DEBUG::2014-10-29 11:26:36,854::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54765 >Detector thread::DEBUG::2014-10-29 11:26:36,854::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54765) >Thread-137223::DEBUG::2014-10-29 11:26:36,894::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137223::DEBUG::2014-10-29 11:26:36,895::task::595::Storage.TaskManager.Task::(_updateState) Task=`713ec93e-437c-419f-944b-1d4be52ad786`::moving from state init -> state preparing >Thread-137223::INFO::2014-10-29 11:26:36,895::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137223::DEBUG::2014-10-29 11:26:36,899::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:26:36,900::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:36,901::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:36,901::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:36,901::__init__::232::IOProcess::(_processLogs) (202259) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:36,902::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202259) Queuing response >Thread-137223::DEBUG::2014-10-29 11:26:36,903::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137223::DEBUG::2014-10-29 11:26:36,903::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137223::INFO::2014-10-29 11:26:36,903::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137223::DEBUG::2014-10-29 11:26:36,904::task::1191::Storage.TaskManager.Task::(prepare) Task=`713ec93e-437c-419f-944b-1d4be52ad786`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137223::DEBUG::2014-10-29 11:26:36,904::task::595::Storage.TaskManager.Task::(_updateState) Task=`713ec93e-437c-419f-944b-1d4be52ad786`::moving from state preparing -> state finished >Thread-137223::DEBUG::2014-10-29 11:26:36,904::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137223::DEBUG::2014-10-29 11:26:36,904::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137223::DEBUG::2014-10-29 11:26:36,905::task::993::Storage.TaskManager.Task::(_decref) Task=`713ec93e-437c-419f-944b-1d4be52ad786`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:26:36,948::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54766 >Detector thread::DEBUG::2014-10-29 11:26:36,948::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54766 >Detector thread::DEBUG::2014-10-29 11:26:36,949::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54766 >Detector thread::DEBUG::2014-10-29 11:26:36,949::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54766) >Thread-137224::DEBUG::2014-10-29 11:26:36,988::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137224::DEBUG::2014-10-29 11:26:36,988::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9a858d1-0d77-4864-81c5-ea35ea1ea279`::moving from state init -> state preparing >Thread-137224::INFO::2014-10-29 11:26:36,989::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137224::DEBUG::2014-10-29 11:26:36,989::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137224::DEBUG::2014-10-29 11:26:36,990::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137224::DEBUG::2014-10-29 11:26:36,990::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137224::DEBUG::2014-10-29 11:26:36,990::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137224::DEBUG::2014-10-29 11:26:36,990::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137224::DEBUG::2014-10-29 11:26:36,991::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137224::DEBUG::2014-10-29 11:26:37,078::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137224::DEBUG::2014-10-29 11:26:37,079::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137224::DEBUG::2014-10-29 11:26:37,260::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137224::DEBUG::2014-10-29 11:26:37,261::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137224::DEBUG::2014-10-29 11:26:37,261::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137224::DEBUG::2014-10-29 11:26:37,262::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137224::DEBUG::2014-10-29 11:26:37,262::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137224::DEBUG::2014-10-29 11:26:37,262::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137224::DEBUG::2014-10-29 11:26:37,263::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137224::DEBUG::2014-10-29 11:26:37,263::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:26:37,271::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:37,273::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:37,273::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:37,274::__init__::232::IOProcess::(_processLogs) (202260) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:37,275::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202260) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:37,276::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:37,277::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:37,277::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:37,278::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:37,278::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:37,281::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:37,281::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:37,282::__init__::232::IOProcess::(_processLogs) (202261) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:37,282::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:37,282::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:37,282::__init__::232::IOProcess::(_processLogs) (202262) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:37,283::__init__::232::IOProcess::(_processLogs) (202263) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:37,283::__init__::232::IOProcess::(_processLogs) (202262) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:37,283::__init__::232::IOProcess::(_processLogs) (202263) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:37,283::__init__::232::IOProcess::(_processLogs) (202261) Queuing response >Thread-137224::DEBUG::2014-10-29 11:26:37,287::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:26:37,288::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:37,288::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:37,289::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:37,289::__init__::232::IOProcess::(_processLogs) (202264) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:26:37,290::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202264) Queuing response >Thread-137224::DEBUG::2014-10-29 11:26:37,290::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:26:37,291::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:37,292::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:37,292::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:37,293::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202265) Got request for method 'readfile' >Thread-137224::DEBUG::2014-10-29 11:26:37,293::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:26:37,294::__init__::232::IOProcess::(_processLogs) (202265) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:37,296::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:37,297::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:37,297::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:37,298::__init__::232::IOProcess::(_processLogs) (202266) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:37,299::__init__::232::IOProcess::(_processLogs) (202266) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:37,299::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:37,299::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137224::DEBUG::2014-10-29 11:26:37,300::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:26:37,300::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-137224::INFO::2014-10-29 11:26:37,301::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137224::INFO::2014-10-29 11:26:37,302::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:26:37,302::__init__::232::IOProcess::(_processLogs) (202267) Got request for method 'glob' >Thread-137224::INFO::2014-10-29 11:26:37,304::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:26:37,304::__init__::232::IOProcess::(_processLogs) (202267) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:37,306::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:37,306::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:37,306::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:37,307::__init__::232::IOProcess::(_processLogs) (202268) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:26:37,307::__init__::232::IOProcess::(_processLogs) (202268) Queuing response >Thread-137224::DEBUG::2014-10-29 11:26:37,308::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137224::DEBUG::2014-10-29 11:26:37,309::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`f6893aaa-2115-40a1-adde-081b269b0454`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137224::DEBUG::2014-10-29 11:26:37,309::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137224::DEBUG::2014-10-29 11:26:37,310::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137224::DEBUG::2014-10-29 11:26:37,310::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`f6893aaa-2115-40a1-adde-081b269b0454`::Granted request >Thread-137224::DEBUG::2014-10-29 11:26:37,311::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d9a858d1-0d77-4864-81c5-ea35ea1ea279`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137224::DEBUG::2014-10-29 11:26:37,311::task::993::Storage.TaskManager.Task::(_decref) Task=`d9a858d1-0d77-4864-81c5-ea35ea1ea279`::ref 1 aborting False >Thread-137224::INFO::2014-10-29 11:26:37,314::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137224::DEBUG::2014-10-29 11:26:37,314::task::1191::Storage.TaskManager.Task::(prepare) Task=`d9a858d1-0d77-4864-81c5-ea35ea1ea279`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137224::DEBUG::2014-10-29 11:26:37,314::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9a858d1-0d77-4864-81c5-ea35ea1ea279`::moving from state preparing -> state finished >Thread-137224::DEBUG::2014-10-29 11:26:37,314::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137224::DEBUG::2014-10-29 11:26:37,315::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137224::DEBUG::2014-10-29 11:26:37,315::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137224::DEBUG::2014-10-29 11:26:37,316::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137224::DEBUG::2014-10-29 11:26:37,316::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137224::DEBUG::2014-10-29 11:26:37,316::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137224::DEBUG::2014-10-29 11:26:37,316::task::993::Storage.TaskManager.Task::(_decref) Task=`d9a858d1-0d77-4864-81c5-ea35ea1ea279`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:26:37,339::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54767 >Detector thread::DEBUG::2014-10-29 11:26:37,339::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54767 >Detector thread::DEBUG::2014-10-29 11:26:37,339::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54767 >Detector thread::DEBUG::2014-10-29 11:26:37,340::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54767) >Thread-137229::DEBUG::2014-10-29 11:26:37,379::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137229::DEBUG::2014-10-29 11:26:37,379::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5092626-1b60-42bf-ad66-6794e1c500cf`::moving from state init -> state preparing >Thread-137229::INFO::2014-10-29 11:26:37,380::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137229::INFO::2014-10-29 11:26:37,380::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515866', 'lastCheck': '8.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572256', 'lastCheck': '9.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491324', 'lastCheck': '9.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0056851', 'lastCheck': '9.4', 'valid': True}} >Thread-137229::DEBUG::2014-10-29 11:26:37,381::task::1191::Storage.TaskManager.Task::(prepare) Task=`b5092626-1b60-42bf-ad66-6794e1c500cf`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515866', 'lastCheck': '8.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572256', 'lastCheck': '9.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491324', 'lastCheck': '9.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0056851', 'lastCheck': '9.4', 'valid': True}} >Thread-137229::DEBUG::2014-10-29 11:26:37,381::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5092626-1b60-42bf-ad66-6794e1c500cf`::moving from state preparing -> state finished >Thread-137229::DEBUG::2014-10-29 11:26:37,381::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137229::DEBUG::2014-10-29 11:26:37,382::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137229::DEBUG::2014-10-29 11:26:37,382::task::993::Storage.TaskManager.Task::(_decref) Task=`b5092626-1b60-42bf-ad66-6794e1c500cf`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:26:37,898::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:37,898::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:37,899::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:37,899::__init__::232::IOProcess::(_processLogs) (202269) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:37,901::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202269) Queuing response >Thread-179::DEBUG::2014-10-29 11:26:37,901::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:37,920::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:37,923::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-179::DEBUG::2014-10-29 11:26:37,928::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.0022064 s, 169 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:26:37,934::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-137230::DEBUG::2014-10-29 11:26:37,935::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ff098cf-d33c-4fe5-92a9-b902aaad25af`::moving from state init -> state preparing >Thread-17::DEBUG::2014-10-29 11:26:37,936::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137230::INFO::2014-10-29 11:26:37,938::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-17::DEBUG::2014-10-29 11:26:37,939::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-137230::INFO::2014-10-29 11:26:37,943::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515866', 'lastCheck': '9.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572256', 'lastCheck': '9.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491324', 'lastCheck': '10.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0056851', 'lastCheck': '10.0', 'valid': True}} >Thread-137230::DEBUG::2014-10-29 11:26:37,945::task::1191::Storage.TaskManager.Task::(prepare) Task=`9ff098cf-d33c-4fe5-92a9-b902aaad25af`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515866', 'lastCheck': '9.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572256', 'lastCheck': '9.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000491324', 'lastCheck': '10.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0056851', 'lastCheck': '10.0', 'valid': True}} >Thread-17::DEBUG::2014-10-29 11:26:37,946::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202270) Got request for method 'statvfs' >Thread-137230::DEBUG::2014-10-29 11:26:37,948::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ff098cf-d33c-4fe5-92a9-b902aaad25af`::moving from state preparing -> state finished >Thread-17::DEBUG::2014-10-29 11:26:37,948::__init__::232::IOProcess::(_processLogs) (202270) Queuing response >Thread-137230::DEBUG::2014-10-29 11:26:37,950::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137230::DEBUG::2014-10-29 11:26:37,951::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17::DEBUG::2014-10-29 11:26:37,953::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-137230::DEBUG::2014-10-29 11:26:37,953::task::993::Storage.TaskManager.Task::(_decref) Task=`9ff098cf-d33c-4fe5-92a9-b902aaad25af`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:26:37,955::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:37,956::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:37,959::__init__::232::IOProcess::(_processLogs) (202271) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:37,964::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202271) Queuing response >Thread-10269::DEBUG::2014-10-29 11:26:37,967::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:26:37,985::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000456163 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:26:37,988::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:37,996::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:37,999::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:38,001::__init__::232::IOProcess::(_processLogs) (202272) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:38,001::__init__::232::IOProcess::(_processLogs) (202272) Queuing response >Thread-137230::DEBUG::2014-10-29 11:26:38,012::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:38,038::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:38,040::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137231::DEBUG::2014-10-29 11:26:38,044::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137231::DEBUG::2014-10-29 11:26:38,046::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:26:38,410::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:38,410::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:38,411::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:38,411::__init__::232::IOProcess::(_processLogs) (202273) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:38,412::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202273) Queuing response >Thread-33::DEBUG::2014-10-29 11:26:38,414::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:26:38,431::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000440144 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:26:38,433::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:38,433::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:38,435::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:38,436::__init__::232::IOProcess::(_processLogs) (202274) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:38,436::__init__::232::IOProcess::(_processLogs) (202274) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:38,437::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:38,438::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:38,439::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:38,439::__init__::232::IOProcess::(_processLogs) (202275) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:38,439::__init__::232::IOProcess::(_processLogs) (202275) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:38,440::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:38,441::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:38,441::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:38,442::__init__::232::IOProcess::(_processLogs) (202276) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:38,442::__init__::232::IOProcess::(_processLogs) (202276) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:38,442::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:38,443::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:38,444::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:38,444::__init__::232::IOProcess::(_processLogs) (202277) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:38,444::__init__::232::IOProcess::(_processLogs) (202277) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:38,507::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:38,508::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:38,508::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:38,508::__init__::232::IOProcess::(_processLogs) (202278) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:38,510::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202278) Queuing response >Thread-178::DEBUG::2014-10-29 11:26:38,511::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:26:38,528::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000521193 s, 975 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:26:38,530::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:38,530::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:38,530::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:38,531::__init__::232::IOProcess::(_processLogs) (202279) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:38,533::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202279) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:38,535::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:38,535::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:38,536::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:38,536::__init__::232::IOProcess::(_processLogs) (202280) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:38,537::__init__::232::IOProcess::(_processLogs) (202280) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:38,537::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:38,537::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:38,538::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:38,538::__init__::232::IOProcess::(_processLogs) (202281) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:38,539::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202281) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:38,540::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:38,540::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:38,540::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:38,541::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202282) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:38,542::__init__::232::IOProcess::(_processLogs) (202282) Queuing response >Detector thread::DEBUG::2014-10-29 11:26:40,454::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54768 >Detector thread::DEBUG::2014-10-29 11:26:40,455::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54768 >Detector thread::DEBUG::2014-10-29 11:26:40,455::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54768 >Detector thread::DEBUG::2014-10-29 11:26:40,456::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54768) >Thread-137232::DEBUG::2014-10-29 11:26:40,494::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137232::DEBUG::2014-10-29 11:26:40,496::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137232::DEBUG::2014-10-29 11:26:40,516::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137232::DEBUG::2014-10-29 11:26:40,562::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '84', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '84', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:26:41,042::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54769 >Detector thread::DEBUG::2014-10-29 11:26:41,043::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54769 >Detector thread::DEBUG::2014-10-29 11:26:41,043::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54769 >Detector thread::DEBUG::2014-10-29 11:26:41,043::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54769) >Thread-137233::DEBUG::2014-10-29 11:26:41,083::task::595::Storage.TaskManager.Task::(_updateState) Task=`50bb5259-03ff-462b-908a-e8456c4d6c1e`::moving from state init -> state preparing >Thread-137233::INFO::2014-10-29 11:26:41,084::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137233::INFO::2014-10-29 11:26:41,085::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521193', 'lastCheck': '2.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440144', 'lastCheck': '2.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0022064', 'lastCheck': '3.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000456163', 'lastCheck': '3.1', 'valid': True}} >Thread-137233::DEBUG::2014-10-29 11:26:41,085::task::1191::Storage.TaskManager.Task::(prepare) Task=`50bb5259-03ff-462b-908a-e8456c4d6c1e`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521193', 'lastCheck': '2.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440144', 'lastCheck': '2.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0022064', 'lastCheck': '3.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000456163', 'lastCheck': '3.1', 'valid': True}} >Thread-137233::DEBUG::2014-10-29 11:26:41,085::task::595::Storage.TaskManager.Task::(_updateState) Task=`50bb5259-03ff-462b-908a-e8456c4d6c1e`::moving from state preparing -> state finished >Thread-137233::DEBUG::2014-10-29 11:26:41,085::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137233::DEBUG::2014-10-29 11:26:41,086::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137233::DEBUG::2014-10-29 11:26:41,086::task::993::Storage.TaskManager.Task::(_decref) Task=`50bb5259-03ff-462b-908a-e8456c4d6c1e`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:41,088::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:41,094::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137234::DEBUG::2014-10-29 11:26:41,097::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:41,102::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:41,105::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137235::DEBUG::2014-10-29 11:26:41,112::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137235::DEBUG::2014-10-29 11:26:41,133::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:26:41,171::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54770 >Detector thread::DEBUG::2014-10-29 11:26:41,172::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54770 >Detector thread::DEBUG::2014-10-29 11:26:41,172::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54770 >Detector thread::DEBUG::2014-10-29 11:26:41,173::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54770) >Thread-137236::DEBUG::2014-10-29 11:26:41,212::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137236::DEBUG::2014-10-29 11:26:41,213::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137236::DEBUG::2014-10-29 11:26:41,214::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.66', 'elapsedTime': '514633', 'displayType': 'vnc', 'cpuSys': '0.40', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '9283554', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '73883', 'readRate': '0.00', 'truesize': '6010888192', 'writeRate': '47036.06'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.74', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:41,506::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:41,507::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:41,508::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:44,160::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:44,162::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137237::DEBUG::2014-10-29 11:26:44,165::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:44,168::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:44,169::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137238::DEBUG::2014-10-29 11:26:44,172::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137238::DEBUG::2014-10-29 11:26:44,174::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:46,517::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:46,523::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:46,528::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:47,187::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:47,191::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137239::DEBUG::2014-10-29 11:26:47,194::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:47,198::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:47,200::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137240::DEBUG::2014-10-29 11:26:47,203::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137240::DEBUG::2014-10-29 11:26:47,206::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-179::DEBUG::2014-10-29 11:26:47,950::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 38dc6c98-2b6a-45c0-b765-c5ce685415f9 >Thread-17::DEBUG::2014-10-29 11:26:47,957::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Detector thread::DEBUG::2014-10-29 11:26:47,958::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54773 >Thread-17::DEBUG::2014-10-29 11:26:47,959::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:47,961::__init__::232::IOProcess::(_processLogs) Extracting request information... >Detector thread::DEBUG::2014-10-29 11:26:47,961::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54773 >Thread-17::DEBUG::2014-10-29 11:26:47,963::__init__::232::IOProcess::(_processLogs) (202283) Got request for method 'glob' >Detector thread::DEBUG::2014-10-29 11:26:47,963::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54773 >Detector thread::DEBUG::2014-10-29 11:26:47,966::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54773) >Thread-17::DEBUG::2014-10-29 11:26:47,969::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202283) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:47,972::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:47,972::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:47,972::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:47,973::__init__::232::IOProcess::(_processLogs) (202284) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:47,973::__init__::232::IOProcess::(_processLogs) (202284) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:47,975::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:47,975::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:47,976::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:47,976::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:47,976::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:47,976::__init__::232::IOProcess::(_processLogs) (202285) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:47,977::__init__::232::IOProcess::(_processLogs) (202285) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:47,977::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:47,977::__init__::232::IOProcess::(_processLogs) (202286) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:47,978::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202286) Queuing response >Thread-179::DEBUG::2014-10-29 11:26:47,984::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9 >Thread-17::DEBUG::2014-10-29 11:26:47,985::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:47,985::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:47,985::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:47,986::__init__::232::IOProcess::(_processLogs) (202287) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:26:47,987::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202287) Queuing response >Thread-179::DEBUG::2014-10-29 11:26:47,988::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:26:47,989::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:47,989::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:47,989::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:47,989::__init__::232::IOProcess::(_processLogs) (202288) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:26:47,990::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202288) Queuing response >Thread-179::DEBUG::2014-10-29 11:26:47,991::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nsednev_rhevm_3_5_second_SD', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=00000002-0002-0002-0002-000000000321', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_rhevm_3_5_second_SD', 'ROLE=Regular', 'SDUUID=38dc6c98-2b6a-45c0-b765-c5ce685415f9', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ea5c54387b91bc1e37853d7501f0d1b2d7d233e7'] >Thread-17::DEBUG::2014-10-29 11:26:47,992::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:47,993::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:47,993::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:47,994::__init__::232::IOProcess::(_processLogs) (202289) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:47,994::__init__::232::IOProcess::(_processLogs) (202289) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:47,995::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:47,995::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:47,995::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:47,996::__init__::232::IOProcess::(_processLogs) (202290) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:47,998::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202290) Queuing response >Thread-179::DEBUG::2014-10-29 11:26:48,002::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-179::INFO::2014-10-29 11:26:48,004::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 38dc6c98-2b6a-45c0-b765-c5ce685415f9_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:26:48,005::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-179::INFO::2014-10-29 11:26:48,007::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 38dc6c98-2b6a-45c0-b765-c5ce685415f9_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:26:48,008::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137245::DEBUG::2014-10-29 11:26:48,009::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-17::DEBUG::2014-10-29 11:26:48,011::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:48,013::__init__::232::IOProcess::(_processLogs) (202291) Got request for method 'statvfs' >Thread-137245::DEBUG::2014-10-29 11:26:48,013::task::595::Storage.TaskManager.Task::(_updateState) Task=`aea3cef7-9f83-43ba-a555-8a69203fc32f`::moving from state init -> state preparing >Thread-137245::INFO::2014-10-29 11:26:48,016::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-17::DEBUG::2014-10-29 11:26:48,020::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202291) Queuing response >Thread-10269::DEBUG::2014-10-29 11:26:48,022::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:26:48,045::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-10269::DEBUG::2014-10-29 11:26:48,047::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000529464 s, 948 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:26:48,050::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:48,053::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:48,055::__init__::232::IOProcess::(_processLogs) (202292) Got request for method 'statvfs' >Thread-137245::DEBUG::2014-10-29 11:26:48,057::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:26:48,060::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202292) Queuing response >Thread-179::DEBUG::2014-10-29 11:26:48,061::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:26:48,080::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000487192 s, 764 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:26:48,083::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:48,087::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:48,087::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:48,087::__init__::232::IOProcess::(_processLogs) (202293) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:48,087::__init__::232::IOProcess::(_processLogs) (202293) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:48,088::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:48,088::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:48,089::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:48,089::__init__::232::IOProcess::(_processLogs) (202294) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:48,090::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202294) Queuing response >Thread-137245::DEBUG::2014-10-29 11:26:48,090::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137245::DEBUG::2014-10-29 11:26:48,092::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-17::DEBUG::2014-10-29 11:26:48,092::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-137245::INFO::2014-10-29 11:26:48,093::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-17::DEBUG::2014-10-29 11:26:48,094::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137245::DEBUG::2014-10-29 11:26:48,095::task::1191::Storage.TaskManager.Task::(prepare) Task=`aea3cef7-9f83-43ba-a555-8a69203fc32f`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-17::DEBUG::2014-10-29 11:26:48,095::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-137245::DEBUG::2014-10-29 11:26:48,096::task::595::Storage.TaskManager.Task::(_updateState) Task=`aea3cef7-9f83-43ba-a555-8a69203fc32f`::moving from state preparing -> state finished >Thread-17::DEBUG::2014-10-29 11:26:48,097::__init__::232::IOProcess::(_processLogs) (202295) Got request for method 'statvfs' >Thread-137245::DEBUG::2014-10-29 11:26:48,097::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137245::DEBUG::2014-10-29 11:26:48,098::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137245::DEBUG::2014-10-29 11:26:48,100::task::993::Storage.TaskManager.Task::(_decref) Task=`aea3cef7-9f83-43ba-a555-8a69203fc32f`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:26:48,103::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202295) Queuing response >Detector thread::DEBUG::2014-10-29 11:26:48,152::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54774 >Detector thread::DEBUG::2014-10-29 11:26:48,152::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54774 >Detector thread::DEBUG::2014-10-29 11:26:48,153::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54774 >Detector thread::DEBUG::2014-10-29 11:26:48,153::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54774) >Thread-137246::DEBUG::2014-10-29 11:26:48,192::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137246::DEBUG::2014-10-29 11:26:48,193::task::595::Storage.TaskManager.Task::(_updateState) Task=`56f9ae09-2680-4687-9566-4d09d6fcb9f5`::moving from state init -> state preparing >Thread-137246::INFO::2014-10-29 11:26:48,193::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137246::DEBUG::2014-10-29 11:26:48,193::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137246::DEBUG::2014-10-29 11:26:48,194::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137246::DEBUG::2014-10-29 11:26:48,194::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137246::DEBUG::2014-10-29 11:26:48,194::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137246::DEBUG::2014-10-29 11:26:48,194::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137246::DEBUG::2014-10-29 11:26:48,195::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137246::DEBUG::2014-10-29 11:26:48,274::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137246::DEBUG::2014-10-29 11:26:48,275::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-33::DEBUG::2014-10-29 11:26:48,446::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-137246::DEBUG::2014-10-29 11:26:48,448::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137246::DEBUG::2014-10-29 11:26:48,449::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137246::DEBUG::2014-10-29 11:26:48,449::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137246::DEBUG::2014-10-29 11:26:48,449::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137246::DEBUG::2014-10-29 11:26:48,450::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137246::DEBUG::2014-10-29 11:26:48,450::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137246::DEBUG::2014-10-29 11:26:48,451::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137246::DEBUG::2014-10-29 11:26:48,451::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:26:48,457::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:48,459::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:48,461::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:48,462::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202296) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:48,464::__init__::232::IOProcess::(_processLogs) (202296) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:48,465::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:48,465::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:48,466::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:48,469::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:48,471::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:48,473::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:48,474::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:48,476::__init__::232::IOProcess::(_processLogs) (202297) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:48,478::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:48,479::__init__::232::IOProcess::(_processLogs) (202298) Got request for method 'glob' >Thread-137246::DEBUG::2014-10-29 11:26:48,480::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:26:48,481::__init__::232::IOProcess::(_processLogs) (202297) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:48,482::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:48,482::__init__::232::IOProcess::(_processLogs) (202299) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:48,482::__init__::232::IOProcess::(_processLogs) (202298) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:48,483::__init__::232::IOProcess::(_processLogs) (202299) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:48,485::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:48,487::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-137246::DEBUG::2014-10-29 11:26:48,487::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:26:48,488::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:48,490::__init__::232::IOProcess::(_processLogs) (202300) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:26:48,490::__init__::232::IOProcess::(_processLogs) (202300) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:48,491::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:48,491::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:48,491::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:48,491::__init__::232::IOProcess::(_processLogs) (202301) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:26:48,492::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202301) Queuing response >Thread-137246::DEBUG::2014-10-29 11:26:48,492::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:26:48,494::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:48,495::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:48,496::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:48,496::__init__::232::IOProcess::(_processLogs) (202302) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:48,496::__init__::232::IOProcess::(_processLogs) (202302) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:48,497::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:48,497::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137246::DEBUG::2014-10-29 11:26:48,498::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:26:48,498::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-137246::INFO::2014-10-29 11:26:48,499::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:26:48,500::__init__::232::IOProcess::(_processLogs) (202303) Got request for method 'glob' >Thread-137246::INFO::2014-10-29 11:26:48,500::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:26:48,501::__init__::232::IOProcess::(_processLogs) (202303) Queuing response >Thread-137246::INFO::2014-10-29 11:26:48,502::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:26:48,505::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:48,505::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:48,505::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:48,505::__init__::232::IOProcess::(_processLogs) (202304) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:48,507::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202304) Queuing response >Thread-33::DEBUG::2014-10-29 11:26:48,508::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:26:48,508::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:48,525::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:48,525::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:48,526::__init__::232::IOProcess::(_processLogs) (202305) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:26:48,526::__init__::232::IOProcess::(_processLogs) (202305) Queuing response >Thread-137246::DEBUG::2014-10-29 11:26:48,527::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137246::DEBUG::2014-10-29 11:26:48,530::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`8b4764d6-b934-48e2-b663-95a20a7faf2b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137246::DEBUG::2014-10-29 11:26:48,531::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-33::DEBUG::2014-10-29 11:26:48,531::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00131219 s, 371 kB/s\n'; <rc> = 0 >Thread-137246::DEBUG::2014-10-29 11:26:48,534::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-17::DEBUG::2014-10-29 11:26:48,536::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-137246::DEBUG::2014-10-29 11:26:48,536::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`8b4764d6-b934-48e2-b663-95a20a7faf2b`::Granted request >Thread-17::DEBUG::2014-10-29 11:26:48,537::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137246::DEBUG::2014-10-29 11:26:48,540::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`56f9ae09-2680-4687-9566-4d09d6fcb9f5`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137246::DEBUG::2014-10-29 11:26:48,542::task::993::Storage.TaskManager.Task::(_decref) Task=`56f9ae09-2680-4687-9566-4d09d6fcb9f5`::ref 1 aborting False >Thread-17::DEBUG::2014-10-29 11:26:48,545::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:48,547::__init__::232::IOProcess::(_processLogs) (202306) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:48,549::__init__::232::IOProcess::(_processLogs) (202306) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:48,552::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:48,554::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:48,556::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:48,557::__init__::232::IOProcess::(_processLogs) (202307) Got request for method 'statvfs' >Thread-137246::INFO::2014-10-29 11:26:48,560::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137246::DEBUG::2014-10-29 11:26:48,562::task::1191::Storage.TaskManager.Task::(prepare) Task=`56f9ae09-2680-4687-9566-4d09d6fcb9f5`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137246::DEBUG::2014-10-29 11:26:48,563::task::595::Storage.TaskManager.Task::(_updateState) Task=`56f9ae09-2680-4687-9566-4d09d6fcb9f5`::moving from state preparing -> state finished >Thread-17::DEBUG::2014-10-29 11:26:48,564::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202307) Queuing response >Thread-137246::DEBUG::2014-10-29 11:26:48,566::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137246::DEBUG::2014-10-29 11:26:48,568::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-178::DEBUG::2014-10-29 11:26:48,568::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:26:48,588::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-178::DEBUG::2014-10-29 11:26:48,592::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000466698 s, 1.1 MB/s\n'; <rc> = 0 >Thread-137246::DEBUG::2014-10-29 11:26:48,591::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-17::DEBUG::2014-10-29 11:26:48,594::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137246::DEBUG::2014-10-29 11:26:48,597::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-17::DEBUG::2014-10-29 11:26:48,597::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-137246::DEBUG::2014-10-29 11:26:48,598::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-17::DEBUG::2014-10-29 11:26:48,599::__init__::232::IOProcess::(_processLogs) (202308) Got request for method 'access' >Thread-137246::DEBUG::2014-10-29 11:26:48,600::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-17::DEBUG::2014-10-29 11:26:48,601::__init__::232::IOProcess::(_processLogs) (202308) Queuing response >Thread-137246::DEBUG::2014-10-29 11:26:48,603::task::993::Storage.TaskManager.Task::(_decref) Task=`56f9ae09-2680-4687-9566-4d09d6fcb9f5`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:26:48,610::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:48,612::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:48,613::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:48,613::__init__::232::IOProcess::(_processLogs) (202309) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:48,613::__init__::232::IOProcess::(_processLogs) (202309) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:48,614::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:48,615::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:48,615::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:48,615::__init__::232::IOProcess::(_processLogs) (202310) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:48,617::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202310) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:48,618::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:48,619::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:48,619::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:48,619::__init__::232::IOProcess::(_processLogs) (202311) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:48,620::__init__::232::IOProcess::(_processLogs) (202311) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:48,622::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:48,624::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:48,625::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:48,625::__init__::232::IOProcess::(_processLogs) (202312) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:48,625::__init__::232::IOProcess::(_processLogs) (202312) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:48,626::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:48,626::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:48,627::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:48,627::__init__::232::IOProcess::(_processLogs) (202313) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:48,628::__init__::232::IOProcess::(_processLogs) (202313) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:48,628::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:48,629::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:48,630::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:48,631::__init__::232::IOProcess::(_processLogs) (202314) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:48,631::__init__::232::IOProcess::(_processLogs) (202314) Queuing response >Detector thread::DEBUG::2014-10-29 11:26:48,633::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54775 >Detector thread::DEBUG::2014-10-29 11:26:48,634::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54775 >Detector thread::DEBUG::2014-10-29 11:26:48,634::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54775 >Detector thread::DEBUG::2014-10-29 11:26:48,634::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54775) >Thread-137251::DEBUG::2014-10-29 11:26:48,673::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137251::DEBUG::2014-10-29 11:26:48,674::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1b0fade-fa77-41ee-9f84-bfb6340a2daf`::moving from state init -> state preparing >Thread-137251::INFO::2014-10-29 11:26:48,674::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137251::INFO::2014-10-29 11:26:48,675::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466698', 'lastCheck': '0.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00131219', 'lastCheck': '0.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487192', 'lastCheck': '0.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000529464', 'lastCheck': '0.6', 'valid': True}} >Thread-137251::DEBUG::2014-10-29 11:26:48,675::task::1191::Storage.TaskManager.Task::(prepare) Task=`a1b0fade-fa77-41ee-9f84-bfb6340a2daf`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466698', 'lastCheck': '0.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00131219', 'lastCheck': '0.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487192', 'lastCheck': '0.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000529464', 'lastCheck': '0.6', 'valid': True}} >Thread-137251::DEBUG::2014-10-29 11:26:48,675::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1b0fade-fa77-41ee-9f84-bfb6340a2daf`::moving from state preparing -> state finished >Thread-137251::DEBUG::2014-10-29 11:26:48,676::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137251::DEBUG::2014-10-29 11:26:48,676::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137251::DEBUG::2014-10-29 11:26:48,676::task::993::Storage.TaskManager.Task::(_decref) Task=`a1b0fade-fa77-41ee-9f84-bfb6340a2daf`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:50,231::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:50,234::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137252::DEBUG::2014-10-29 11:26:50,238::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:50,241::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:50,242::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137253::DEBUG::2014-10-29 11:26:50,246::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137253::DEBUG::2014-10-29 11:26:50,248::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:26:50,368::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54776 >Detector thread::DEBUG::2014-10-29 11:26:50,369::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54776 >Detector thread::DEBUG::2014-10-29 11:26:50,369::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54776 >Detector thread::DEBUG::2014-10-29 11:26:50,369::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54776) >Thread-137254::DEBUG::2014-10-29 11:26:50,408::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137254::DEBUG::2014-10-29 11:26:50,409::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137254::DEBUG::2014-10-29 11:26:50,410::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.66', 'elapsedTime': '514642', 'displayType': 'vnc', 'cpuSys': '0.40', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '9283554', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '73883', 'readRate': '0.00', 'truesize': '6010888192', 'writeRate': '47036.06'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.94', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-22::DEBUG::2014-10-29 11:26:50,475::task::595::Storage.TaskManager.Task::(_updateState) Task=`69a8a945-4c66-4f1b-8791-eed763ee5bf8`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:26:50,475::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:26:50,477::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:50,477::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:50,477::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:50,478::__init__::232::IOProcess::(_processLogs) (202315) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:26:50,478::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202315) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:50,480::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:50,481::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-22::INFO::2014-10-29 11:26:50,481::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010896384', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:26:50,482::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-22::DEBUG::2014-10-29 11:26:50,483::task::1191::Storage.TaskManager.Task::(prepare) Task=`69a8a945-4c66-4f1b-8791-eed763ee5bf8`::finished: {'truesize': '6010896384', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:26:50,484::__init__::232::IOProcess::(_processLogs) (202316) Got request for method 'stat' >Thread-22::DEBUG::2014-10-29 11:26:50,485::task::595::Storage.TaskManager.Task::(_updateState) Task=`69a8a945-4c66-4f1b-8791-eed763ee5bf8`::moving from state preparing -> state finished >Thread-17::DEBUG::2014-10-29 11:26:50,485::__init__::232::IOProcess::(_processLogs) (202316) Queuing response >Thread-22::DEBUG::2014-10-29 11:26:50,486::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-10-29 11:26:50,487::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2014-10-29 11:26:50,487::task::993::Storage.TaskManager.Task::(_decref) Task=`69a8a945-4c66-4f1b-8791-eed763ee5bf8`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:26:50,558::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Detector thread::DEBUG::2014-10-29 11:26:50,612::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54778 >Detector thread::DEBUG::2014-10-29 11:26:50,613::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54778 >Detector thread::DEBUG::2014-10-29 11:26:50,613::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54778 >Detector thread::DEBUG::2014-10-29 11:26:50,613::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54778) >Thread-137255::DEBUG::2014-10-29 11:26:50,652::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137255::DEBUG::2014-10-29 11:26:50,654::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137255::DEBUG::2014-10-29 11:26:50,674::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137255::DEBUG::2014-10-29 11:26:50,721::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '69', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '69', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:26:51,179::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54779 >Detector thread::DEBUG::2014-10-29 11:26:51,180::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54779 >Detector thread::DEBUG::2014-10-29 11:26:51,180::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54779 >Detector thread::DEBUG::2014-10-29 11:26:51,180::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54779) >Thread-137256::DEBUG::2014-10-29 11:26:51,220::task::595::Storage.TaskManager.Task::(_updateState) Task=`d5da9a58-5e35-4517-9ec0-260301b8c644`::moving from state init -> state preparing >Thread-137256::INFO::2014-10-29 11:26:51,220::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137256::INFO::2014-10-29 11:26:51,221::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466698', 'lastCheck': '2.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00131219', 'lastCheck': '2.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487192', 'lastCheck': '3.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000529464', 'lastCheck': '3.1', 'valid': True}} >Thread-137256::DEBUG::2014-10-29 11:26:51,221::task::1191::Storage.TaskManager.Task::(prepare) Task=`d5da9a58-5e35-4517-9ec0-260301b8c644`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466698', 'lastCheck': '2.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00131219', 'lastCheck': '2.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487192', 'lastCheck': '3.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000529464', 'lastCheck': '3.1', 'valid': True}} >Thread-137256::DEBUG::2014-10-29 11:26:51,222::task::595::Storage.TaskManager.Task::(_updateState) Task=`d5da9a58-5e35-4517-9ec0-260301b8c644`::moving from state preparing -> state finished >Thread-137256::DEBUG::2014-10-29 11:26:51,222::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137256::DEBUG::2014-10-29 11:26:51,222::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137256::DEBUG::2014-10-29 11:26:51,222::task::993::Storage.TaskManager.Task::(_decref) Task=`d5da9a58-5e35-4517-9ec0-260301b8c644`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:51,538::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:51,539::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:51,540::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:53,261::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:53,264::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137257::DEBUG::2014-10-29 11:26:53,267::task::595::Storage.TaskManager.Task::(_updateState) Task=`c77ba7ba-fb3a-4bd2-b729-c701eff967d6`::moving from state init -> state preparing >Thread-137257::INFO::2014-10-29 11:26:53,267::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137257::INFO::2014-10-29 11:26:53,268::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466698', 'lastCheck': '4.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00131219', 'lastCheck': '4.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487192', 'lastCheck': '5.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000529464', 'lastCheck': '5.2', 'valid': True}} >Thread-137257::DEBUG::2014-10-29 11:26:53,268::task::1191::Storage.TaskManager.Task::(prepare) Task=`c77ba7ba-fb3a-4bd2-b729-c701eff967d6`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000466698', 'lastCheck': '4.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00131219', 'lastCheck': '4.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487192', 'lastCheck': '5.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000529464', 'lastCheck': '5.2', 'valid': True}} >Thread-137257::DEBUG::2014-10-29 11:26:53,268::task::595::Storage.TaskManager.Task::(_updateState) Task=`c77ba7ba-fb3a-4bd2-b729-c701eff967d6`::moving from state preparing -> state finished >Thread-137257::DEBUG::2014-10-29 11:26:53,269::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137257::DEBUG::2014-10-29 11:26:53,269::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137257::DEBUG::2014-10-29 11:26:53,269::task::993::Storage.TaskManager.Task::(_decref) Task=`c77ba7ba-fb3a-4bd2-b729-c701eff967d6`::ref 0 aborting False >Thread-137257::DEBUG::2014-10-29 11:26:53,289::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:53,311::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:53,313::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137258::DEBUG::2014-10-29 11:26:53,316::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137258::DEBUG::2014-10-29 11:26:53,318::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:56,370::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:56,372::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137259::DEBUG::2014-10-29 11:26:56,376::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:56,378::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:56,380::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137260::DEBUG::2014-10-29 11:26:56,383::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137260::DEBUG::2014-10-29 11:26:56,386::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:56,547::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:56,549::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:26:56,550::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:26:58,087::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:58,088::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:58,088::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:58,088::__init__::232::IOProcess::(_processLogs) (202317) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:58,089::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202317) Queuing response >Thread-10269::DEBUG::2014-10-29 11:26:58,091::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:26:58,107::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000520239 s, 965 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:26:58,109::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:58,111::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:58,113::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:58,113::__init__::232::IOProcess::(_processLogs) (202318) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:58,113::__init__::232::IOProcess::(_processLogs) (202318) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:58,124::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:58,124::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:58,124::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:58,125::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202319) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:58,126::__init__::232::IOProcess::(_processLogs) (202319) Queuing response >Thread-179::DEBUG::2014-10-29 11:26:58,126::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:26:58,144::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000512952 s, 725 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:26:58,146::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:58,146::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:58,146::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:58,147::__init__::232::IOProcess::(_processLogs) (202320) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:58,147::__init__::232::IOProcess::(_processLogs) (202320) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:58,624::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:58,628::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:58,630::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-33::DEBUG::2014-10-29 11:26:58,630::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:26:58,631::__init__::232::IOProcess::(_processLogs) (202321) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:58,653::__init__::232::IOProcess::(_processLogs) (202321) Queuing response >Thread-33::DEBUG::2014-10-29 11:26:58,654::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00162764 s, 299 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:26:58,657::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:58,657::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:58,658::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:58,658::__init__::232::IOProcess::(_processLogs) (202322) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:58,659::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202322) Queuing response >Thread-178::DEBUG::2014-10-29 11:26:58,663::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:26:58,663::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:58,683::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:58,685::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-178::DEBUG::2014-10-29 11:26:58,686::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000487169 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:26:58,687::__init__::232::IOProcess::(_processLogs) (202323) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:58,691::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202323) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:58,694::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:58,694::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:58,694::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:58,695::__init__::232::IOProcess::(_processLogs) (202324) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:26:58,695::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:58,695::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:58,698::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202324) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:58,700::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:58,700::__init__::232::IOProcess::(_processLogs) (202325) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:58,700::__init__::232::IOProcess::(_processLogs) (202325) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:58,701::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:58,703::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:58,703::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:58,703::__init__::232::IOProcess::(_processLogs) (202326) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:58,703::__init__::232::IOProcess::(_processLogs) (202326) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:58,704::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:58,705::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:58,706::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:58,706::__init__::232::IOProcess::(_processLogs) (202327) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:58,706::__init__::232::IOProcess::(_processLogs) (202327) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:58,706::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:58,708::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:58,708::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:58,708::__init__::232::IOProcess::(_processLogs) (202328) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:58,709::__init__::232::IOProcess::(_processLogs) (202328) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:58,709::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:58,709::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:58,710::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:58,710::__init__::232::IOProcess::(_processLogs) (202329) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:58,711::__init__::232::IOProcess::(_processLogs) (202329) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:58,714::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:58,716::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:58,716::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:58,716::__init__::232::IOProcess::(_processLogs) (202330) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:58,718::__init__::232::IOProcess::(_processLogs) (202330) Queuing response >Detector thread::DEBUG::2014-10-29 11:26:59,234::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54781 >Detector thread::DEBUG::2014-10-29 11:26:59,235::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54781 >Detector thread::DEBUG::2014-10-29 11:26:59,235::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54781 >Detector thread::DEBUG::2014-10-29 11:26:59,236::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54781) >Thread-137261::DEBUG::2014-10-29 11:26:59,275::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137261::DEBUG::2014-10-29 11:26:59,276::task::595::Storage.TaskManager.Task::(_updateState) Task=`18df3271-5f25-4dcb-8eee-c2cf46d25cc6`::moving from state init -> state preparing >Thread-137261::INFO::2014-10-29 11:26:59,276::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137261::DEBUG::2014-10-29 11:26:59,291::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:26:59,291::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:59,292::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:59,292::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:59,292::__init__::232::IOProcess::(_processLogs) (202331) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:59,293::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202331) Queuing response >Thread-137261::DEBUG::2014-10-29 11:26:59,293::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137261::DEBUG::2014-10-29 11:26:59,295::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137261::INFO::2014-10-29 11:26:59,295::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137261::DEBUG::2014-10-29 11:26:59,295::task::1191::Storage.TaskManager.Task::(prepare) Task=`18df3271-5f25-4dcb-8eee-c2cf46d25cc6`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137261::DEBUG::2014-10-29 11:26:59,296::task::595::Storage.TaskManager.Task::(_updateState) Task=`18df3271-5f25-4dcb-8eee-c2cf46d25cc6`::moving from state preparing -> state finished >Thread-137261::DEBUG::2014-10-29 11:26:59,296::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137261::DEBUG::2014-10-29 11:26:59,296::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137261::DEBUG::2014-10-29 11:26:59,296::task::993::Storage.TaskManager.Task::(_decref) Task=`18df3271-5f25-4dcb-8eee-c2cf46d25cc6`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:26:59,341::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54782 >Detector thread::DEBUG::2014-10-29 11:26:59,342::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54782 >Detector thread::DEBUG::2014-10-29 11:26:59,342::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54782 >Detector thread::DEBUG::2014-10-29 11:26:59,343::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54782) >Thread-137262::DEBUG::2014-10-29 11:26:59,381::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137262::DEBUG::2014-10-29 11:26:59,381::task::595::Storage.TaskManager.Task::(_updateState) Task=`2251637a-df6a-45fe-937e-6c59996893c0`::moving from state init -> state preparing >Thread-137262::INFO::2014-10-29 11:26:59,382::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137262::DEBUG::2014-10-29 11:26:59,382::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137262::DEBUG::2014-10-29 11:26:59,382::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137262::DEBUG::2014-10-29 11:26:59,383::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137262::DEBUG::2014-10-29 11:26:59,383::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137262::DEBUG::2014-10-29 11:26:59,383::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137262::DEBUG::2014-10-29 11:26:59,384::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:59,402::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:59,405::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137263::DEBUG::2014-10-29 11:26:59,410::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:26:59,413::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:26:59,415::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137264::DEBUG::2014-10-29 11:26:59,419::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137264::DEBUG::2014-10-29 11:26:59,421::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-137262::DEBUG::2014-10-29 11:26:59,474::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137262::DEBUG::2014-10-29 11:26:59,474::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137262::DEBUG::2014-10-29 11:26:59,651::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137262::DEBUG::2014-10-29 11:26:59,652::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137262::DEBUG::2014-10-29 11:26:59,653::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137262::DEBUG::2014-10-29 11:26:59,654::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137262::DEBUG::2014-10-29 11:26:59,654::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137262::DEBUG::2014-10-29 11:26:59,655::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137262::DEBUG::2014-10-29 11:26:59,655::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137262::DEBUG::2014-10-29 11:26:59,655::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:26:59,660::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:59,660::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:59,661::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:59,661::__init__::232::IOProcess::(_processLogs) (202332) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:59,662::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202332) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:59,667::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:59,668::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:59,668::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:59,668::__init__::232::IOProcess::(_processLogs) (202333) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:59,669::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202333) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:59,670::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:59,670::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:59,671::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:59,671::__init__::232::IOProcess::(_processLogs) (202334) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:26:59,672::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202334) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:59,678::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:59,679::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:59,683::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:59,685::__init__::232::IOProcess::(_processLogs) (202335) Got request for method 'glob' >Thread-137262::DEBUG::2014-10-29 11:26:59,686::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:26:59,687::__init__::232::IOProcess::(_processLogs) (202335) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:59,689::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:59,689::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:59,689::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:59,690::__init__::232::IOProcess::(_processLogs) (202336) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:26:59,690::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202336) Queuing response >Thread-137262::DEBUG::2014-10-29 11:26:59,691::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:26:59,692::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:59,692::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:59,693::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:59,693::__init__::232::IOProcess::(_processLogs) (202337) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:26:59,694::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202337) Queuing response >Thread-137262::DEBUG::2014-10-29 11:26:59,694::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:26:59,696::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:59,696::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:59,697::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:59,698::__init__::232::IOProcess::(_processLogs) (202338) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:26:59,698::__init__::232::IOProcess::(_processLogs) (202338) Queuing response >Thread-17::DEBUG::2014-10-29 11:26:59,698::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:59,699::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137262::DEBUG::2014-10-29 11:26:59,700::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:26:59,699::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-137262::INFO::2014-10-29 11:26:59,701::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:26:59,701::__init__::232::IOProcess::(_processLogs) (202339) Got request for method 'glob' >Thread-137262::INFO::2014-10-29 11:26:59,702::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:26:59,703::__init__::232::IOProcess::(_processLogs) (202339) Queuing response >Thread-137262::INFO::2014-10-29 11:26:59,703::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:26:59,705::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:26:59,705::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:26:59,705::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:26:59,706::__init__::232::IOProcess::(_processLogs) (202340) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:26:59,706::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202340) Queuing response >Thread-137262::DEBUG::2014-10-29 11:26:59,707::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137262::DEBUG::2014-10-29 11:26:59,709::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`a7f2abee-58f0-4adf-b6c3-292ed5bb5b3b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137262::DEBUG::2014-10-29 11:26:59,709::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137262::DEBUG::2014-10-29 11:26:59,710::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137262::DEBUG::2014-10-29 11:26:59,710::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`a7f2abee-58f0-4adf-b6c3-292ed5bb5b3b`::Granted request >Thread-137262::DEBUG::2014-10-29 11:26:59,711::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2251637a-df6a-45fe-937e-6c59996893c0`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137262::DEBUG::2014-10-29 11:26:59,711::task::993::Storage.TaskManager.Task::(_decref) Task=`2251637a-df6a-45fe-937e-6c59996893c0`::ref 1 aborting False >Thread-137262::INFO::2014-10-29 11:26:59,714::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137262::DEBUG::2014-10-29 11:26:59,714::task::1191::Storage.TaskManager.Task::(prepare) Task=`2251637a-df6a-45fe-937e-6c59996893c0`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137262::DEBUG::2014-10-29 11:26:59,714::task::595::Storage.TaskManager.Task::(_updateState) Task=`2251637a-df6a-45fe-937e-6c59996893c0`::moving from state preparing -> state finished >Thread-137262::DEBUG::2014-10-29 11:26:59,714::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137262::DEBUG::2014-10-29 11:26:59,715::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137262::DEBUG::2014-10-29 11:26:59,715::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137262::DEBUG::2014-10-29 11:26:59,715::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137262::DEBUG::2014-10-29 11:26:59,716::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137262::DEBUG::2014-10-29 11:26:59,716::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137262::DEBUG::2014-10-29 11:26:59,716::task::993::Storage.TaskManager.Task::(_decref) Task=`2251637a-df6a-45fe-937e-6c59996893c0`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:26:59,738::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54783 >Detector thread::DEBUG::2014-10-29 11:26:59,739::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54783 >Detector thread::DEBUG::2014-10-29 11:26:59,739::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54783 >Detector thread::DEBUG::2014-10-29 11:26:59,740::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54783) >Thread-137269::DEBUG::2014-10-29 11:26:59,779::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137269::DEBUG::2014-10-29 11:26:59,779::task::595::Storage.TaskManager.Task::(_updateState) Task=`9b4c478c-dde4-46ee-936e-5d61f6857f1c`::moving from state init -> state preparing >Thread-137269::INFO::2014-10-29 11:26:59,780::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137269::INFO::2014-10-29 11:26:59,780::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487169', 'lastCheck': '1.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00162764', 'lastCheck': '1.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000512952', 'lastCheck': '1.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000520239', 'lastCheck': '1.7', 'valid': True}} >Thread-137269::DEBUG::2014-10-29 11:26:59,781::task::1191::Storage.TaskManager.Task::(prepare) Task=`9b4c478c-dde4-46ee-936e-5d61f6857f1c`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487169', 'lastCheck': '1.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00162764', 'lastCheck': '1.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000512952', 'lastCheck': '1.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000520239', 'lastCheck': '1.7', 'valid': True}} >Thread-137269::DEBUG::2014-10-29 11:26:59,781::task::595::Storage.TaskManager.Task::(_updateState) Task=`9b4c478c-dde4-46ee-936e-5d61f6857f1c`::moving from state preparing -> state finished >Thread-137269::DEBUG::2014-10-29 11:26:59,781::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137269::DEBUG::2014-10-29 11:26:59,781::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137269::DEBUG::2014-10-29 11:26:59,782::task::993::Storage.TaskManager.Task::(_decref) Task=`9b4c478c-dde4-46ee-936e-5d61f6857f1c`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:27:00,291::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54784 >Detector thread::DEBUG::2014-10-29 11:27:00,291::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54784 >Detector thread::DEBUG::2014-10-29 11:27:00,292::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54784 >Detector thread::DEBUG::2014-10-29 11:27:00,292::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54784) >Thread-137270::DEBUG::2014-10-29 11:27:00,333::task::595::Storage.TaskManager.Task::(_updateState) Task=`abcc2846-6f5b-45cc-a088-01b0dd9a3c57`::moving from state init -> state preparing >Thread-137270::INFO::2014-10-29 11:27:00,333::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137270::INFO::2014-10-29 11:27:00,334::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487169', 'lastCheck': '1.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00162764', 'lastCheck': '1.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000512952', 'lastCheck': '2.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000520239', 'lastCheck': '2.2', 'valid': True}} >Thread-137270::DEBUG::2014-10-29 11:27:00,334::task::1191::Storage.TaskManager.Task::(prepare) Task=`abcc2846-6f5b-45cc-a088-01b0dd9a3c57`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487169', 'lastCheck': '1.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00162764', 'lastCheck': '1.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000512952', 'lastCheck': '2.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000520239', 'lastCheck': '2.2', 'valid': True}} >Thread-137270::DEBUG::2014-10-29 11:27:00,334::task::595::Storage.TaskManager.Task::(_updateState) Task=`abcc2846-6f5b-45cc-a088-01b0dd9a3c57`::moving from state preparing -> state finished >Thread-137270::DEBUG::2014-10-29 11:27:00,335::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137270::DEBUG::2014-10-29 11:27:00,335::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137270::DEBUG::2014-10-29 11:27:00,335::task::993::Storage.TaskManager.Task::(_decref) Task=`abcc2846-6f5b-45cc-a088-01b0dd9a3c57`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:27:00,552::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54785 >Detector thread::DEBUG::2014-10-29 11:27:00,553::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54785 >Detector thread::DEBUG::2014-10-29 11:27:00,553::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54785 >Detector thread::DEBUG::2014-10-29 11:27:00,554::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54785) >Thread-137271::DEBUG::2014-10-29 11:27:00,592::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137271::DEBUG::2014-10-29 11:27:00,593::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137271::DEBUG::2014-10-29 11:27:00,594::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.49', 'elapsedTime': '514653', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '19005875', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '59411', 'readRate': '0.00', 'truesize': '6010896384', 'writeRate': '40148.74'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.03', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:27:00,762::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54787 >Detector thread::DEBUG::2014-10-29 11:27:00,763::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54787 >Detector thread::DEBUG::2014-10-29 11:27:00,763::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54787 >Detector thread::DEBUG::2014-10-29 11:27:00,764::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54787) >Thread-137272::DEBUG::2014-10-29 11:27:00,803::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137272::DEBUG::2014-10-29 11:27:00,804::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137272::DEBUG::2014-10-29 11:27:00,823::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137272::DEBUG::2014-10-29 11:27:00,880::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '53', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '53', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:01,557::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:01,558::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:01,559::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:02,435::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:02,437::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137273::DEBUG::2014-10-29 11:27:02,441::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:02,443::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:02,445::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137274::DEBUG::2014-10-29 11:27:02,448::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137274::DEBUG::2014-10-29 11:27:02,450::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:27:04,659::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:05,464::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:05,467::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137275::DEBUG::2014-10-29 11:27:05,471::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:05,473::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:05,475::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137276::DEBUG::2014-10-29 11:27:05,478::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137276::DEBUG::2014-10-29 11:27:05,480::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:27:05,579::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:06,563::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:06,564::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:06,566::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:27:08,114::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:08,115::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:08,115::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:08,115::__init__::232::IOProcess::(_processLogs) (202341) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:08,120::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202341) Queuing response >Thread-10269::DEBUG::2014-10-29 11:27:08,121::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:27:08,140::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000462541 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:27:08,142::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:08,143::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:08,143::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:08,143::__init__::232::IOProcess::(_processLogs) (202342) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:08,144::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202342) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:08,151::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:08,151::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:08,152::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-179::DEBUG::2014-10-29 11:27:08,154::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:27:08,154::__init__::232::IOProcess::(_processLogs) (202343) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:08,170::__init__::232::IOProcess::(_processLogs) (202343) Queuing response >Thread-179::DEBUG::2014-10-29 11:27:08,172::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000463879 s, 802 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:27:08,173::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:08,174::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:08,174::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:08,174::__init__::232::IOProcess::(_processLogs) (202344) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:08,176::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202344) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:08,493::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:08,496::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137277::DEBUG::2014-10-29 11:27:08,501::task::595::Storage.TaskManager.Task::(_updateState) Task=`354b3e8c-d690-43c4-b7b1-8b8409bee7c2`::moving from state init -> state preparing >Thread-137277::INFO::2014-10-29 11:27:08,501::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137277::INFO::2014-10-29 11:27:08,502::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487169', 'lastCheck': '9.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00162764', 'lastCheck': '9.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463879', 'lastCheck': '0.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000462541', 'lastCheck': '0.4', 'valid': True}} >Thread-137277::DEBUG::2014-10-29 11:27:08,502::task::1191::Storage.TaskManager.Task::(prepare) Task=`354b3e8c-d690-43c4-b7b1-8b8409bee7c2`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487169', 'lastCheck': '9.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00162764', 'lastCheck': '9.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463879', 'lastCheck': '0.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000462541', 'lastCheck': '0.4', 'valid': True}} >Thread-137277::DEBUG::2014-10-29 11:27:08,502::task::595::Storage.TaskManager.Task::(_updateState) Task=`354b3e8c-d690-43c4-b7b1-8b8409bee7c2`::moving from state preparing -> state finished >Thread-137277::DEBUG::2014-10-29 11:27:08,503::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137277::DEBUG::2014-10-29 11:27:08,503::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137277::DEBUG::2014-10-29 11:27:08,503::task::993::Storage.TaskManager.Task::(_decref) Task=`354b3e8c-d690-43c4-b7b1-8b8409bee7c2`::ref 0 aborting False >Thread-137277::DEBUG::2014-10-29 11:27:08,525::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:08,549::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:08,551::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137278::DEBUG::2014-10-29 11:27:08,555::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137278::DEBUG::2014-10-29 11:27:08,557::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:27:08,716::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:08,716::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:08,718::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:08,720::__init__::232::IOProcess::(_processLogs) (202345) Got request for method 'statvfs' >Thread-33::DEBUG::2014-10-29 11:27:08,721::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:27:08,722::__init__::232::IOProcess::(_processLogs) (202345) Queuing response >Thread-33::DEBUG::2014-10-29 11:27:08,742::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000502776 s, 969 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:27:08,743::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:08,745::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:08,746::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:08,746::__init__::232::IOProcess::(_processLogs) (202346) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:08,748::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202346) Queuing response >Thread-178::DEBUG::2014-10-29 11:27:08,749::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:27:08,768::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:08,770::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-178::DEBUG::2014-10-29 11:27:08,771::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000774615 s, 656 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:27:08,776::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:08,777::__init__::232::IOProcess::(_processLogs) (202347) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:08,778::__init__::232::IOProcess::(_processLogs) (202347) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:08,778::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:08,779::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:08,779::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:08,779::__init__::232::IOProcess::(_processLogs) (202348) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:08,780::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202348) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:08,782::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:08,782::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:08,782::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:08,782::__init__::232::IOProcess::(_processLogs) (202349) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:08,783::__init__::232::IOProcess::(_processLogs) (202349) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:08,785::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:08,786::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:08,787::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:08,787::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:08,787::__init__::232::IOProcess::(_processLogs) (202350) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:08,787::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:08,788::__init__::232::IOProcess::(_processLogs) (202350) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:08,788::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:08,788::__init__::232::IOProcess::(_processLogs) (202351) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:08,788::__init__::232::IOProcess::(_processLogs) (202351) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:08,790::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:08,790::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:08,790::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:08,791::__init__::232::IOProcess::(_processLogs) (202352) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:08,791::__init__::232::IOProcess::(_processLogs) (202352) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:08,793::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:08,794::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:08,795::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:08,795::__init__::232::IOProcess::(_processLogs) (202353) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:08,795::__init__::232::IOProcess::(_processLogs) (202353) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:08,796::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:08,796::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:08,797::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:08,798::__init__::232::IOProcess::(_processLogs) (202354) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:08,798::__init__::232::IOProcess::(_processLogs) (202354) Queuing response >Detector thread::DEBUG::2014-10-29 11:27:10,405::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54788 >Detector thread::DEBUG::2014-10-29 11:27:10,406::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54788 >Detector thread::DEBUG::2014-10-29 11:27:10,407::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54788 >Detector thread::DEBUG::2014-10-29 11:27:10,407::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54788) >Detector thread::DEBUG::2014-10-29 11:27:10,424::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54790 >Detector thread::DEBUG::2014-10-29 11:27:10,424::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54790 >Detector thread::DEBUG::2014-10-29 11:27:10,425::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54790 >Detector thread::DEBUG::2014-10-29 11:27:10,425::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54790) >Thread-137279::DEBUG::2014-10-29 11:27:10,446::task::595::Storage.TaskManager.Task::(_updateState) Task=`20e17e6f-fec9-4bc5-ac5f-5ade441a8851`::moving from state init -> state preparing >Thread-137279::INFO::2014-10-29 11:27:10,447::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137279::INFO::2014-10-29 11:27:10,448::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000774615', 'lastCheck': '1.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502776', 'lastCheck': '1.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463879', 'lastCheck': '2.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000462541', 'lastCheck': '2.3', 'valid': True}} >Thread-137279::DEBUG::2014-10-29 11:27:10,448::task::1191::Storage.TaskManager.Task::(prepare) Task=`20e17e6f-fec9-4bc5-ac5f-5ade441a8851`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000774615', 'lastCheck': '1.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502776', 'lastCheck': '1.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463879', 'lastCheck': '2.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000462541', 'lastCheck': '2.3', 'valid': True}} >Thread-137279::DEBUG::2014-10-29 11:27:10,448::task::595::Storage.TaskManager.Task::(_updateState) Task=`20e17e6f-fec9-4bc5-ac5f-5ade441a8851`::moving from state preparing -> state finished >Thread-137279::DEBUG::2014-10-29 11:27:10,448::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137279::DEBUG::2014-10-29 11:27:10,449::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137279::DEBUG::2014-10-29 11:27:10,449::task::993::Storage.TaskManager.Task::(_decref) Task=`20e17e6f-fec9-4bc5-ac5f-5ade441a8851`::ref 0 aborting False >Thread-137280::DEBUG::2014-10-29 11:27:10,465::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137280::DEBUG::2014-10-29 11:27:10,466::task::595::Storage.TaskManager.Task::(_updateState) Task=`11ec6510-b7be-44a1-9e54-46fb10056cc5`::moving from state init -> state preparing >Thread-137280::INFO::2014-10-29 11:27:10,467::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137280::DEBUG::2014-10-29 11:27:10,475::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:27:10,481::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:10,482::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:10,485::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-137280::DEBUG::2014-10-29 11:27:10,485::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:27:10,488::__init__::232::IOProcess::(_processLogs) (202355) Got request for method 'glob' >Thread-137280::DEBUG::2014-10-29 11:27:10,489::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-17::DEBUG::2014-10-29 11:27:10,491::__init__::232::IOProcess::(_processLogs) (202355) Queuing response >Thread-137280::INFO::2014-10-29 11:27:10,492::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137280::DEBUG::2014-10-29 11:27:10,494::task::1191::Storage.TaskManager.Task::(prepare) Task=`11ec6510-b7be-44a1-9e54-46fb10056cc5`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137280::DEBUG::2014-10-29 11:27:10,495::task::595::Storage.TaskManager.Task::(_updateState) Task=`11ec6510-b7be-44a1-9e54-46fb10056cc5`::moving from state preparing -> state finished >Thread-137280::DEBUG::2014-10-29 11:27:10,497::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137280::DEBUG::2014-10-29 11:27:10,498::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137280::DEBUG::2014-10-29 11:27:10,500::task::993::Storage.TaskManager.Task::(_decref) Task=`11ec6510-b7be-44a1-9e54-46fb10056cc5`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:27:10,549::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54791 >Detector thread::DEBUG::2014-10-29 11:27:10,550::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54791 >Detector thread::DEBUG::2014-10-29 11:27:10,550::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54791 >Detector thread::DEBUG::2014-10-29 11:27:10,550::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54791) >Thread-137281::DEBUG::2014-10-29 11:27:10,589::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137281::DEBUG::2014-10-29 11:27:10,590::task::595::Storage.TaskManager.Task::(_updateState) Task=`daa897ba-5335-49aa-bbcf-6eaa91bd4330`::moving from state init -> state preparing >Thread-137281::INFO::2014-10-29 11:27:10,590::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137281::DEBUG::2014-10-29 11:27:10,590::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137281::DEBUG::2014-10-29 11:27:10,591::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137281::DEBUG::2014-10-29 11:27:10,591::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137281::DEBUG::2014-10-29 11:27:10,591::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137281::DEBUG::2014-10-29 11:27:10,591::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137281::DEBUG::2014-10-29 11:27:10,592::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137281::DEBUG::2014-10-29 11:27:10,676::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137281::DEBUG::2014-10-29 11:27:10,677::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Detector thread::DEBUG::2014-10-29 11:27:10,745::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54792 >Detector thread::DEBUG::2014-10-29 11:27:10,746::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54792 >Detector thread::DEBUG::2014-10-29 11:27:10,746::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54792 >Detector thread::DEBUG::2014-10-29 11:27:10,747::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54792) >Thread-137282::DEBUG::2014-10-29 11:27:10,787::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137282::DEBUG::2014-10-29 11:27:10,789::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137282::DEBUG::2014-10-29 11:27:10,790::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.30', 'elapsedTime': '514663', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '19005875', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '59411', 'readRate': '0.00', 'truesize': '6010896384', 'writeRate': '40148.74'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.21', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-137281::DEBUG::2014-10-29 11:27:10,865::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137281::DEBUG::2014-10-29 11:27:10,867::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137281::DEBUG::2014-10-29 11:27:10,867::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137281::DEBUG::2014-10-29 11:27:10,867::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137281::DEBUG::2014-10-29 11:27:10,868::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137281::DEBUG::2014-10-29 11:27:10,868::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137281::DEBUG::2014-10-29 11:27:10,869::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137281::DEBUG::2014-10-29 11:27:10,869::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:27:10,872::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:10,875::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:10,879::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:10,881::__init__::232::IOProcess::(_processLogs) (202356) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:27:10,881::__init__::232::IOProcess::(_processLogs) (202356) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:10,882::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:10,882::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:10,883::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:10,883::__init__::232::IOProcess::(_processLogs) (202357) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:27:10,883::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:10,883::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:10,884::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:10,884::__init__::232::IOProcess::(_processLogs) (202358) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:27:10,884::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:10,884::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:10,885::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:10,886::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202359) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:27:10,887::__init__::232::IOProcess::(_processLogs) (202357) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:10,889::__init__::232::IOProcess::(_processLogs) (202358) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:10,891::__init__::232::IOProcess::(_processLogs) (202359) Queuing response >Thread-137281::DEBUG::2014-10-29 11:27:10,897::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:27:10,898::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:10,898::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:10,898::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:10,898::__init__::232::IOProcess::(_processLogs) (202360) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:27:10,899::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202360) Queuing response >Thread-137281::DEBUG::2014-10-29 11:27:10,900::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:27:10,901::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:10,901::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:10,901::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:10,901::__init__::232::IOProcess::(_processLogs) (202361) Got request for method 'readfile' >Thread-137281::DEBUG::2014-10-29 11:27:10,903::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:27:10,902::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202361) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:10,905::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:10,905::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:10,906::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:10,906::__init__::232::IOProcess::(_processLogs) (202362) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:10,907::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202362) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:10,908::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:10,908::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137281::DEBUG::2014-10-29 11:27:10,909::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:27:10,909::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-137281::INFO::2014-10-29 11:27:10,910::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:27:10,911::__init__::232::IOProcess::(_processLogs) (202363) Got request for method 'glob' >Thread-137281::INFO::2014-10-29 11:27:10,911::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:27:10,912::__init__::232::IOProcess::(_processLogs) (202363) Queuing response >Thread-137281::INFO::2014-10-29 11:27:10,913::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:27:10,915::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:10,915::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:10,918::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:10,918::__init__::232::IOProcess::(_processLogs) (202364) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:27:10,919::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202364) Queuing response >Thread-137281::DEBUG::2014-10-29 11:27:10,930::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137281::DEBUG::2014-10-29 11:27:10,932::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`706b124e-9eb8-421d-ba7a-806ecde504b3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137281::DEBUG::2014-10-29 11:27:10,932::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137281::DEBUG::2014-10-29 11:27:10,933::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137281::DEBUG::2014-10-29 11:27:10,933::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`706b124e-9eb8-421d-ba7a-806ecde504b3`::Granted request >Thread-137281::DEBUG::2014-10-29 11:27:10,934::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`daa897ba-5335-49aa-bbcf-6eaa91bd4330`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137281::DEBUG::2014-10-29 11:27:10,934::task::993::Storage.TaskManager.Task::(_decref) Task=`daa897ba-5335-49aa-bbcf-6eaa91bd4330`::ref 1 aborting False >Thread-137281::INFO::2014-10-29 11:27:10,937::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137281::DEBUG::2014-10-29 11:27:10,937::task::1191::Storage.TaskManager.Task::(prepare) Task=`daa897ba-5335-49aa-bbcf-6eaa91bd4330`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137281::DEBUG::2014-10-29 11:27:10,937::task::595::Storage.TaskManager.Task::(_updateState) Task=`daa897ba-5335-49aa-bbcf-6eaa91bd4330`::moving from state preparing -> state finished >Thread-137281::DEBUG::2014-10-29 11:27:10,938::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137281::DEBUG::2014-10-29 11:27:10,938::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137281::DEBUG::2014-10-29 11:27:10,938::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137281::DEBUG::2014-10-29 11:27:10,939::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137281::DEBUG::2014-10-29 11:27:10,939::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137281::DEBUG::2014-10-29 11:27:10,939::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137281::DEBUG::2014-10-29 11:27:10,939::task::993::Storage.TaskManager.Task::(_decref) Task=`daa897ba-5335-49aa-bbcf-6eaa91bd4330`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:27:10,955::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54794 >Detector thread::DEBUG::2014-10-29 11:27:10,956::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54794 >Detector thread::DEBUG::2014-10-29 11:27:10,956::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54794 >Detector thread::DEBUG::2014-10-29 11:27:10,957::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54794) >Detector thread::DEBUG::2014-10-29 11:27:10,974::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54795 >Detector thread::DEBUG::2014-10-29 11:27:10,975::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54795 >Detector thread::DEBUG::2014-10-29 11:27:10,975::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54795 >Detector thread::DEBUG::2014-10-29 11:27:10,976::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54795) >Thread-137287::DEBUG::2014-10-29 11:27:10,996::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137287::DEBUG::2014-10-29 11:27:10,998::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137288::DEBUG::2014-10-29 11:27:11,016::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137288::DEBUG::2014-10-29 11:27:11,019::task::595::Storage.TaskManager.Task::(_updateState) Task=`29892494-68ed-4650-adad-ba44aec4f957`::moving from state init -> state preparing >Thread-137287::DEBUG::2014-10-29 11:27:11,019::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137288::INFO::2014-10-29 11:27:11,020::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137288::INFO::2014-10-29 11:27:11,023::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000774615', 'lastCheck': '2.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502776', 'lastCheck': '2.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463879', 'lastCheck': '2.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000462541', 'lastCheck': '2.9', 'valid': True}} >Thread-137288::DEBUG::2014-10-29 11:27:11,025::task::1191::Storage.TaskManager.Task::(prepare) Task=`29892494-68ed-4650-adad-ba44aec4f957`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000774615', 'lastCheck': '2.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502776', 'lastCheck': '2.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463879', 'lastCheck': '2.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000462541', 'lastCheck': '2.9', 'valid': True}} >Thread-137288::DEBUG::2014-10-29 11:27:11,026::task::595::Storage.TaskManager.Task::(_updateState) Task=`29892494-68ed-4650-adad-ba44aec4f957`::moving from state preparing -> state finished >Thread-137288::DEBUG::2014-10-29 11:27:11,028::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137288::DEBUG::2014-10-29 11:27:11,029::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137288::DEBUG::2014-10-29 11:27:11,032::task::993::Storage.TaskManager.Task::(_decref) Task=`29892494-68ed-4650-adad-ba44aec4f957`::ref 0 aborting False >Thread-137287::DEBUG::2014-10-29 11:27:11,081::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '33', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '33', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:11,575::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:11,577::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:11,580::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:11,610::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:11,612::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137289::DEBUG::2014-10-29 11:27:11,615::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:11,618::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:11,620::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137290::DEBUG::2014-10-29 11:27:11,622::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137290::DEBUG::2014-10-29 11:27:11,625::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:14,644::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:14,647::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137291::DEBUG::2014-10-29 11:27:14,650::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:14,652::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:14,654::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137292::DEBUG::2014-10-29 11:27:14,657::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137292::DEBUG::2014-10-29 11:27:14,659::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:16,590::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:16,596::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:16,601::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:17,673::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:17,676::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137293::DEBUG::2014-10-29 11:27:17,679::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:17,681::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:17,683::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137294::DEBUG::2014-10-29 11:27:17,686::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137294::DEBUG::2014-10-29 11:27:17,688::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:27:18,147::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:18,148::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:18,148::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:18,148::__init__::232::IOProcess::(_processLogs) (202365) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:18,149::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202365) Queuing response >Thread-10269::DEBUG::2014-10-29 11:27:18,151::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:27:18,170::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000554999 s, 905 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:27:18,172::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:18,172::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:18,174::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:18,176::__init__::232::IOProcess::(_processLogs) (202366) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:18,176::__init__::232::IOProcess::(_processLogs) (202366) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:18,180::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:18,182::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-179::DEBUG::2014-10-29 11:27:18,183::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:27:18,201::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:18,202::__init__::232::IOProcess::(_processLogs) (202367) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:18,204::__init__::232::IOProcess::(_processLogs) (202367) Queuing response >Thread-179::DEBUG::2014-10-29 11:27:18,204::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000522569 s, 712 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:27:18,206::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:18,206::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:18,207::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:18,207::__init__::232::IOProcess::(_processLogs) (202368) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:18,208::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202368) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:18,795::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:18,796::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:18,797::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-33::DEBUG::2014-10-29 11:27:18,799::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:27:18,799::__init__::232::IOProcess::(_processLogs) (202369) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:18,815::__init__::232::IOProcess::(_processLogs) (202369) Queuing response >Thread-33::DEBUG::2014-10-29 11:27:18,819::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000538051 s, 905 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:27:18,819::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:18,822::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:18,822::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:18,822::__init__::232::IOProcess::(_processLogs) (202370) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:18,824::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202370) Queuing response >Thread-178::DEBUG::2014-10-29 11:27:18,826::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:27:18,826::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:18,841::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:18,841::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-178::DEBUG::2014-10-29 11:27:18,845::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000517874 s, 981 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:27:18,849::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202371) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:18,850::__init__::232::IOProcess::(_processLogs) (202371) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:18,851::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:18,851::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:18,852::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:18,852::__init__::232::IOProcess::(_processLogs) (202372) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:18,854::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202372) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:18,855::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:18,855::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:18,856::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:18,856::__init__::232::IOProcess::(_processLogs) (202373) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:18,856::__init__::232::IOProcess::(_processLogs) (202373) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:18,858::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:18,859::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:18,860::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:18,861::__init__::232::IOProcess::(_processLogs) (202374) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:18,861::__init__::232::IOProcess::(_processLogs) (202374) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:18,861::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:18,862::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:18,862::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:18,862::__init__::232::IOProcess::(_processLogs) (202375) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:18,863::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202375) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:18,864::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:18,864::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:18,865::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:18,865::__init__::232::IOProcess::(_processLogs) (202376) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:18,866::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202376) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:18,867::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:18,867::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:18,867::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:18,868::__init__::232::IOProcess::(_processLogs) (202377) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:18,869::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202377) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:18,869::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:18,870::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:18,871::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:18,871::__init__::232::IOProcess::(_processLogs) (202378) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:18,872::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202378) Queuing response >Detector thread::DEBUG::2014-10-29 11:27:20,555::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54796 >Detector thread::DEBUG::2014-10-29 11:27:20,556::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54796 >Detector thread::DEBUG::2014-10-29 11:27:20,556::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54796 >Detector thread::DEBUG::2014-10-29 11:27:20,557::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54796) >Thread-137295::DEBUG::2014-10-29 11:27:20,598::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a25f290-c12d-41c2-a6e7-4541a7d52054`::moving from state init -> state preparing >Thread-137295::INFO::2014-10-29 11:27:20,601::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137295::INFO::2014-10-29 11:27:20,601::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517874', 'lastCheck': '1.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538051', 'lastCheck': '1.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522569', 'lastCheck': '2.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000554999', 'lastCheck': '2.4', 'valid': True}} >Thread-137295::DEBUG::2014-10-29 11:27:20,602::task::1191::Storage.TaskManager.Task::(prepare) Task=`9a25f290-c12d-41c2-a6e7-4541a7d52054`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517874', 'lastCheck': '1.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538051', 'lastCheck': '1.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522569', 'lastCheck': '2.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000554999', 'lastCheck': '2.4', 'valid': True}} >Thread-137295::DEBUG::2014-10-29 11:27:20,602::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a25f290-c12d-41c2-a6e7-4541a7d52054`::moving from state preparing -> state finished >Thread-137295::DEBUG::2014-10-29 11:27:20,602::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137295::DEBUG::2014-10-29 11:27:20,603::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137295::DEBUG::2014-10-29 11:27:20,603::task::993::Storage.TaskManager.Task::(_decref) Task=`9a25f290-c12d-41c2-a6e7-4541a7d52054`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:27:20,613::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:20,703::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:20,705::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137296::DEBUG::2014-10-29 11:27:20,709::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:20,711::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:20,713::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137297::DEBUG::2014-10-29 11:27:20,717::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137297::DEBUG::2014-10-29 11:27:20,719::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:27:20,968::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54797 >Detector thread::DEBUG::2014-10-29 11:27:20,968::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54797 >Detector thread::DEBUG::2014-10-29 11:27:20,968::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54797 >Detector thread::DEBUG::2014-10-29 11:27:20,969::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54797) >Thread-137298::DEBUG::2014-10-29 11:27:21,008::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137298::DEBUG::2014-10-29 11:27:21,009::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137298::DEBUG::2014-10-29 11:27:21,010::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '6.21', 'elapsedTime': '514673', 'displayType': 'vnc', 'cpuSys': '0.60', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '19005875', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '59411', 'readRate': '0.00', 'truesize': '6010896384', 'writeRate': '40148.74'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.43', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:27:21,132::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54799 >Detector thread::DEBUG::2014-10-29 11:27:21,133::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54799 >Detector thread::DEBUG::2014-10-29 11:27:21,133::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54799 >Detector thread::DEBUG::2014-10-29 11:27:21,133::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54799) >Thread-137299::DEBUG::2014-10-29 11:27:21,172::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137299::DEBUG::2014-10-29 11:27:21,174::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137299::DEBUG::2014-10-29 11:27:21,194::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137299::DEBUG::2014-10-29 11:27:21,254::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '15', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '15', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:27:21,589::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54801 >Detector thread::DEBUG::2014-10-29 11:27:21,590::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54801 >Detector thread::DEBUG::2014-10-29 11:27:21,590::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54801 >Detector thread::DEBUG::2014-10-29 11:27:21,591::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54801) >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:21,611::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:21,612::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:21,615::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137300::DEBUG::2014-10-29 11:27:21,630::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137300::DEBUG::2014-10-29 11:27:21,631::task::595::Storage.TaskManager.Task::(_updateState) Task=`822e4b4b-61e3-4e46-bfd4-ef6c1e310847`::moving from state init -> state preparing >Thread-137300::INFO::2014-10-29 11:27:21,631::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137300::DEBUG::2014-10-29 11:27:21,635::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:27:21,636::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:21,637::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:21,637::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:21,637::__init__::232::IOProcess::(_processLogs) (202379) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:27:21,638::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202379) Queuing response >Thread-137300::DEBUG::2014-10-29 11:27:21,638::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137300::DEBUG::2014-10-29 11:27:21,640::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137300::INFO::2014-10-29 11:27:21,640::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137300::DEBUG::2014-10-29 11:27:21,640::task::1191::Storage.TaskManager.Task::(prepare) Task=`822e4b4b-61e3-4e46-bfd4-ef6c1e310847`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137300::DEBUG::2014-10-29 11:27:21,641::task::595::Storage.TaskManager.Task::(_updateState) Task=`822e4b4b-61e3-4e46-bfd4-ef6c1e310847`::moving from state preparing -> state finished >Thread-137300::DEBUG::2014-10-29 11:27:21,641::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137300::DEBUG::2014-10-29 11:27:21,641::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137300::DEBUG::2014-10-29 11:27:21,641::task::993::Storage.TaskManager.Task::(_decref) Task=`822e4b4b-61e3-4e46-bfd4-ef6c1e310847`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:27:21,684::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54802 >Detector thread::DEBUG::2014-10-29 11:27:21,685::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54802 >Detector thread::DEBUG::2014-10-29 11:27:21,685::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54802 >Detector thread::DEBUG::2014-10-29 11:27:21,686::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54802) >Thread-137301::DEBUG::2014-10-29 11:27:21,724::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137301::DEBUG::2014-10-29 11:27:21,724::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea3c961c-f82c-4bcd-b30b-75d6e6f5b1a2`::moving from state init -> state preparing >Thread-137301::INFO::2014-10-29 11:27:21,725::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137301::DEBUG::2014-10-29 11:27:21,725::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137301::DEBUG::2014-10-29 11:27:21,725::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137301::DEBUG::2014-10-29 11:27:21,726::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137301::DEBUG::2014-10-29 11:27:21,726::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137301::DEBUG::2014-10-29 11:27:21,726::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137301::DEBUG::2014-10-29 11:27:21,727::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137301::DEBUG::2014-10-29 11:27:21,803::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137301::DEBUG::2014-10-29 11:27:21,804::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137301::DEBUG::2014-10-29 11:27:21,977::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137301::DEBUG::2014-10-29 11:27:21,978::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137301::DEBUG::2014-10-29 11:27:21,978::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137301::DEBUG::2014-10-29 11:27:21,979::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137301::DEBUG::2014-10-29 11:27:21,979::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137301::DEBUG::2014-10-29 11:27:21,980::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137301::DEBUG::2014-10-29 11:27:21,980::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137301::DEBUG::2014-10-29 11:27:21,980::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:27:21,988::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:21,990::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:21,990::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:21,990::__init__::232::IOProcess::(_processLogs) (202380) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:27:21,991::__init__::232::IOProcess::(_processLogs) (202380) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:21,993::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:21,993::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:21,993::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:21,994::__init__::232::IOProcess::(_processLogs) (202381) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:27:21,994::__init__::232::IOProcess::(_processLogs) (202381) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:21,994::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:21,995::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:21,997::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:21,998::__init__::232::IOProcess::(_processLogs) (202382) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:27:22,000::__init__::232::IOProcess::(_processLogs) (202382) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:22,005::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:22,007::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137301::DEBUG::2014-10-29 11:27:22,009::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:27:22,009::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:22,011::__init__::232::IOProcess::(_processLogs) (202383) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:27:22,011::__init__::232::IOProcess::(_processLogs) (202383) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:22,013::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:22,013::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:22,013::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:22,014::__init__::232::IOProcess::(_processLogs) (202384) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:27:22,014::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202384) Queuing response >Thread-137301::DEBUG::2014-10-29 11:27:22,015::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:27:22,016::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:22,016::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:22,017::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:22,017::__init__::232::IOProcess::(_processLogs) (202385) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:27:22,018::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202385) Queuing response >Thread-137301::DEBUG::2014-10-29 11:27:22,018::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:27:22,020::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:22,020::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:22,021::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:22,022::__init__::232::IOProcess::(_processLogs) (202386) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:22,022::__init__::232::IOProcess::(_processLogs) (202386) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:22,022::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:22,023::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:22,023::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-137301::DEBUG::2014-10-29 11:27:22,024::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-137301::INFO::2014-10-29 11:27:22,025::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:27:22,025::__init__::232::IOProcess::(_processLogs) (202387) Got request for method 'glob' >Thread-137301::INFO::2014-10-29 11:27:22,026::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:27:22,027::__init__::232::IOProcess::(_processLogs) (202387) Queuing response >Thread-137301::INFO::2014-10-29 11:27:22,028::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:27:22,029::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:22,030::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:22,030::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:22,030::__init__::232::IOProcess::(_processLogs) (202388) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:27:22,031::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202388) Queuing response >Thread-137301::DEBUG::2014-10-29 11:27:22,031::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137301::DEBUG::2014-10-29 11:27:22,033::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`23d33ee7-0ac5-4e87-8239-68ee52eb1aee`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137301::DEBUG::2014-10-29 11:27:22,034::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137301::DEBUG::2014-10-29 11:27:22,034::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137301::DEBUG::2014-10-29 11:27:22,034::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`23d33ee7-0ac5-4e87-8239-68ee52eb1aee`::Granted request >Thread-137301::DEBUG::2014-10-29 11:27:22,035::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ea3c961c-f82c-4bcd-b30b-75d6e6f5b1a2`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137301::DEBUG::2014-10-29 11:27:22,035::task::993::Storage.TaskManager.Task::(_decref) Task=`ea3c961c-f82c-4bcd-b30b-75d6e6f5b1a2`::ref 1 aborting False >Thread-137301::INFO::2014-10-29 11:27:22,038::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137301::DEBUG::2014-10-29 11:27:22,038::task::1191::Storage.TaskManager.Task::(prepare) Task=`ea3c961c-f82c-4bcd-b30b-75d6e6f5b1a2`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137301::DEBUG::2014-10-29 11:27:22,039::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea3c961c-f82c-4bcd-b30b-75d6e6f5b1a2`::moving from state preparing -> state finished >Thread-137301::DEBUG::2014-10-29 11:27:22,039::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137301::DEBUG::2014-10-29 11:27:22,039::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137301::DEBUG::2014-10-29 11:27:22,040::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137301::DEBUG::2014-10-29 11:27:22,040::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137301::DEBUG::2014-10-29 11:27:22,040::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137301::DEBUG::2014-10-29 11:27:22,040::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137301::DEBUG::2014-10-29 11:27:22,041::task::993::Storage.TaskManager.Task::(_decref) Task=`ea3c961c-f82c-4bcd-b30b-75d6e6f5b1a2`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:27:22,064::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54803 >Detector thread::DEBUG::2014-10-29 11:27:22,064::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54803 >Detector thread::DEBUG::2014-10-29 11:27:22,064::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54803 >Detector thread::DEBUG::2014-10-29 11:27:22,065::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54803) >Thread-137306::DEBUG::2014-10-29 11:27:22,104::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137306::DEBUG::2014-10-29 11:27:22,105::task::595::Storage.TaskManager.Task::(_updateState) Task=`00a3b035-e6a7-40ec-9987-5f3e7c1c18ca`::moving from state init -> state preparing >Thread-137306::INFO::2014-10-29 11:27:22,105::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137306::INFO::2014-10-29 11:27:22,106::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517874', 'lastCheck': '3.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538051', 'lastCheck': '3.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522569', 'lastCheck': '3.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000554999', 'lastCheck': '3.9', 'valid': True}} >Thread-137306::DEBUG::2014-10-29 11:27:22,106::task::1191::Storage.TaskManager.Task::(prepare) Task=`00a3b035-e6a7-40ec-9987-5f3e7c1c18ca`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517874', 'lastCheck': '3.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538051', 'lastCheck': '3.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522569', 'lastCheck': '3.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000554999', 'lastCheck': '3.9', 'valid': True}} >Thread-137306::DEBUG::2014-10-29 11:27:22,106::task::595::Storage.TaskManager.Task::(_updateState) Task=`00a3b035-e6a7-40ec-9987-5f3e7c1c18ca`::moving from state preparing -> state finished >Thread-137306::DEBUG::2014-10-29 11:27:22,106::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137306::DEBUG::2014-10-29 11:27:22,107::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137306::DEBUG::2014-10-29 11:27:22,107::task::993::Storage.TaskManager.Task::(_decref) Task=`00a3b035-e6a7-40ec-9987-5f3e7c1c18ca`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:23,732::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:23,734::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137307::DEBUG::2014-10-29 11:27:23,738::task::595::Storage.TaskManager.Task::(_updateState) Task=`c9272a69-00cb-4a38-9b77-c5fe88c53b7b`::moving from state init -> state preparing >Thread-137307::INFO::2014-10-29 11:27:23,738::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137307::INFO::2014-10-29 11:27:23,739::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517874', 'lastCheck': '4.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538051', 'lastCheck': '4.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522569', 'lastCheck': '5.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000554999', 'lastCheck': '5.6', 'valid': True}} >Thread-137307::DEBUG::2014-10-29 11:27:23,739::task::1191::Storage.TaskManager.Task::(prepare) Task=`c9272a69-00cb-4a38-9b77-c5fe88c53b7b`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517874', 'lastCheck': '4.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538051', 'lastCheck': '4.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522569', 'lastCheck': '5.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000554999', 'lastCheck': '5.6', 'valid': True}} >Thread-137307::DEBUG::2014-10-29 11:27:23,739::task::595::Storage.TaskManager.Task::(_updateState) Task=`c9272a69-00cb-4a38-9b77-c5fe88c53b7b`::moving from state preparing -> state finished >Thread-137307::DEBUG::2014-10-29 11:27:23,739::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137307::DEBUG::2014-10-29 11:27:23,740::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137307::DEBUG::2014-10-29 11:27:23,740::task::993::Storage.TaskManager.Task::(_decref) Task=`c9272a69-00cb-4a38-9b77-c5fe88c53b7b`::ref 0 aborting False >Thread-137307::DEBUG::2014-10-29 11:27:23,762::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:23,784::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:23,786::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137308::DEBUG::2014-10-29 11:27:23,789::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137308::DEBUG::2014-10-29 11:27:23,792::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:26,618::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:26,620::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:26,621::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:26,840::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:26,843::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137309::DEBUG::2014-10-29 11:27:26,846::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:26,848::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:26,850::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137310::DEBUG::2014-10-29 11:27:26,853::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137310::DEBUG::2014-10-29 11:27:26,855::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:27:28,177::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:28,177::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:28,177::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:28,178::__init__::232::IOProcess::(_processLogs) (202389) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:28,179::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202389) Queuing response >Thread-10269::DEBUG::2014-10-29 11:27:28,181::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:27:28,198::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000477011 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:27:28,200::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:28,201::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:28,201::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:28,201::__init__::232::IOProcess::(_processLogs) (202390) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:28,203::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202390) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:28,212::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:28,212::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:28,213::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:28,213::__init__::232::IOProcess::(_processLogs) (202391) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:28,213::__init__::232::IOProcess::(_processLogs) (202391) Queuing response >Thread-179::DEBUG::2014-10-29 11:27:28,215::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:27:28,231::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000543968 s, 684 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:27:28,233::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:28,233::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:28,234::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:28,234::__init__::232::IOProcess::(_processLogs) (202392) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:28,234::__init__::232::IOProcess::(_processLogs) (202392) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:28,871::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:28,872::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:28,875::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-33::DEBUG::2014-10-29 11:27:28,876::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:27:28,876::__init__::232::IOProcess::(_processLogs) (202393) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:28,893::__init__::232::IOProcess::(_processLogs) (202393) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:28,894::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:28,895::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:28,895::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:28,895::__init__::232::IOProcess::(_processLogs) (202394) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:28,898::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202394) Queuing response >Thread-33::DEBUG::2014-10-29 11:27:28,899::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00221445 s, 220 kB/s\n'; <rc> = 0 >Thread-178::DEBUG::2014-10-29 11:27:28,901::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:27:28,923::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-178::DEBUG::2014-10-29 11:27:28,926::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000581493 s, 874 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:27:28,926::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:28,927::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:28,927::__init__::232::IOProcess::(_processLogs) (202395) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:28,928::__init__::232::IOProcess::(_processLogs) (202395) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:28,928::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:28,929::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:28,929::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:28,929::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:28,930::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:28,931::__init__::232::IOProcess::(_processLogs) (202396) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:28,931::__init__::232::IOProcess::(_processLogs) (202396) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:28,931::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:28,932::__init__::232::IOProcess::(_processLogs) (202397) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:28,932::__init__::232::IOProcess::(_processLogs) (202397) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:28,935::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:28,936::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:28,936::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:28,936::__init__::232::IOProcess::(_processLogs) (202398) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:28,936::__init__::232::IOProcess::(_processLogs) (202398) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:28,937::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:28,937::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:28,938::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:28,939::__init__::232::IOProcess::(_processLogs) (202399) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:28,939::__init__::232::IOProcess::(_processLogs) (202399) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:28,939::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:28,940::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:28,940::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:28,940::__init__::232::IOProcess::(_processLogs) (202400) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:28,940::__init__::232::IOProcess::(_processLogs) (202400) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:28,942::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:28,943::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:28,943::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:28,944::__init__::232::IOProcess::(_processLogs) (202401) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:28,945::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202401) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:28,946::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:28,946::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:28,947::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:28,948::__init__::232::IOProcess::(_processLogs) (202402) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:28,948::__init__::232::IOProcess::(_processLogs) (202402) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:29,873::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:29,875::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137311::DEBUG::2014-10-29 11:27:29,879::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:29,882::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:29,883::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137312::DEBUG::2014-10-29 11:27:29,887::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137312::DEBUG::2014-10-29 11:27:29,889::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:27:30,313::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54804 >Detector thread::DEBUG::2014-10-29 11:27:30,313::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54804 >Detector thread::DEBUG::2014-10-29 11:27:30,313::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54804 >Detector thread::DEBUG::2014-10-29 11:27:30,314::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54804) >Thread-137313::DEBUG::2014-10-29 11:27:30,353::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137313::DEBUG::2014-10-29 11:27:30,355::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137313::DEBUG::2014-10-29 11:27:30,372::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137313::DEBUG::2014-10-29 11:27:30,437::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '99', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '99', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:27:30,686::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54805 >Detector thread::DEBUG::2014-10-29 11:27:30,688::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54805 >Detector thread::DEBUG::2014-10-29 11:27:30,688::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54805 >Detector thread::DEBUG::2014-10-29 11:27:30,689::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54805) >Thread-137314::DEBUG::2014-10-29 11:27:30,727::task::595::Storage.TaskManager.Task::(_updateState) Task=`1743eb31-0f26-4b74-874e-bf4d0f103fdb`::moving from state init -> state preparing >Thread-137314::INFO::2014-10-29 11:27:30,728::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137314::INFO::2014-10-29 11:27:30,729::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581493', 'lastCheck': '1.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00221445', 'lastCheck': '1.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543968', 'lastCheck': '2.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000477011', 'lastCheck': '2.5', 'valid': True}} >Thread-137314::DEBUG::2014-10-29 11:27:30,729::task::1191::Storage.TaskManager.Task::(prepare) Task=`1743eb31-0f26-4b74-874e-bf4d0f103fdb`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581493', 'lastCheck': '1.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00221445', 'lastCheck': '1.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543968', 'lastCheck': '2.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000477011', 'lastCheck': '2.5', 'valid': True}} >Thread-137314::DEBUG::2014-10-29 11:27:30,729::task::595::Storage.TaskManager.Task::(_updateState) Task=`1743eb31-0f26-4b74-874e-bf4d0f103fdb`::moving from state preparing -> state finished >Thread-137314::DEBUG::2014-10-29 11:27:30,730::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137314::DEBUG::2014-10-29 11:27:30,730::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137314::DEBUG::2014-10-29 11:27:30,730::task::993::Storage.TaskManager.Task::(_decref) Task=`1743eb31-0f26-4b74-874e-bf4d0f103fdb`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:27:31,159::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54806 >Detector thread::DEBUG::2014-10-29 11:27:31,159::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54806 >Detector thread::DEBUG::2014-10-29 11:27:31,160::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54806 >Detector thread::DEBUG::2014-10-29 11:27:31,160::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54806) >Thread-137315::DEBUG::2014-10-29 11:27:31,199::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137315::DEBUG::2014-10-29 11:27:31,200::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137315::DEBUG::2014-10-29 11:27:31,201::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '6.21', 'elapsedTime': '514683', 'displayType': 'vnc', 'cpuSys': '0.60', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '19005875', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '59411', 'readRate': '0.00', 'truesize': '6010896384', 'writeRate': '40148.74'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.58', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:31,628::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:31,629::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:31,630::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:32,901::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:32,904::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137316::DEBUG::2014-10-29 11:27:32,907::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:32,910::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:32,911::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137317::DEBUG::2014-10-29 11:27:32,914::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137317::DEBUG::2014-10-29 11:27:32,917::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:27:34,139::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54809 >Detector thread::DEBUG::2014-10-29 11:27:34,140::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54809 >Detector thread::DEBUG::2014-10-29 11:27:34,140::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54809 >Detector thread::DEBUG::2014-10-29 11:27:34,141::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54809) >Thread-137318::DEBUG::2014-10-29 11:27:34,180::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137318::DEBUG::2014-10-29 11:27:34,181::task::595::Storage.TaskManager.Task::(_updateState) Task=`be4d3366-7043-4a1c-aa34-443969789473`::moving from state init -> state preparing >Thread-137318::INFO::2014-10-29 11:27:34,181::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137318::DEBUG::2014-10-29 11:27:34,184::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:27:34,185::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:34,185::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:34,185::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:34,186::__init__::232::IOProcess::(_processLogs) (202403) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:27:34,187::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202403) Queuing response >Thread-137318::DEBUG::2014-10-29 11:27:34,188::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137318::DEBUG::2014-10-29 11:27:34,188::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137318::INFO::2014-10-29 11:27:34,189::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137318::DEBUG::2014-10-29 11:27:34,189::task::1191::Storage.TaskManager.Task::(prepare) Task=`be4d3366-7043-4a1c-aa34-443969789473`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137318::DEBUG::2014-10-29 11:27:34,189::task::595::Storage.TaskManager.Task::(_updateState) Task=`be4d3366-7043-4a1c-aa34-443969789473`::moving from state preparing -> state finished >Thread-137318::DEBUG::2014-10-29 11:27:34,189::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137318::DEBUG::2014-10-29 11:27:34,190::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137318::DEBUG::2014-10-29 11:27:34,190::task::993::Storage.TaskManager.Task::(_decref) Task=`be4d3366-7043-4a1c-aa34-443969789473`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:27:34,233::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54810 >Detector thread::DEBUG::2014-10-29 11:27:34,234::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54810 >Detector thread::DEBUG::2014-10-29 11:27:34,234::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54810 >Detector thread::DEBUG::2014-10-29 11:27:34,234::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54810) >Thread-137319::DEBUG::2014-10-29 11:27:34,273::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137319::DEBUG::2014-10-29 11:27:34,274::task::595::Storage.TaskManager.Task::(_updateState) Task=`62045297-7767-43d5-9868-d37b0399fa25`::moving from state init -> state preparing >Thread-137319::INFO::2014-10-29 11:27:34,274::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137319::DEBUG::2014-10-29 11:27:34,274::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137319::DEBUG::2014-10-29 11:27:34,275::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137319::DEBUG::2014-10-29 11:27:34,275::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137319::DEBUG::2014-10-29 11:27:34,275::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137319::DEBUG::2014-10-29 11:27:34,275::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137319::DEBUG::2014-10-29 11:27:34,276::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137319::DEBUG::2014-10-29 11:27:34,367::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137319::DEBUG::2014-10-29 11:27:34,368::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137319::DEBUG::2014-10-29 11:27:34,543::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137319::DEBUG::2014-10-29 11:27:34,544::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137319::DEBUG::2014-10-29 11:27:34,544::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137319::DEBUG::2014-10-29 11:27:34,545::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137319::DEBUG::2014-10-29 11:27:34,545::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137319::DEBUG::2014-10-29 11:27:34,546::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137319::DEBUG::2014-10-29 11:27:34,546::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137319::DEBUG::2014-10-29 11:27:34,546::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:27:34,554::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:34,557::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:34,558::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:34,558::__init__::232::IOProcess::(_processLogs) (202404) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:27:34,559::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202404) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:34,563::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:34,563::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:34,563::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:34,563::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:34,564::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:34,564::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:34,564::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:34,564::__init__::232::IOProcess::(_processLogs) (202405) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:27:34,565::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-137319::DEBUG::2014-10-29 11:27:34,571::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:27:34,566::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202406) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:27:34,572::__init__::232::IOProcess::(_processLogs) (202405) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:34,572::__init__::232::IOProcess::(_processLogs) (202406) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:34,572::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:34,573::__init__::232::IOProcess::(_processLogs) (202407) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:27:34,573::__init__::232::IOProcess::(_processLogs) (202407) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:34,575::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:34,576::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:34,576::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:34,577::__init__::232::IOProcess::(_processLogs) (202408) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:27:34,578::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202408) Queuing response >Thread-137319::DEBUG::2014-10-29 11:27:34,578::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:27:34,580::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:34,580::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:34,580::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:34,581::__init__::232::IOProcess::(_processLogs) (202409) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:27:34,582::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202409) Queuing response >Thread-137319::DEBUG::2014-10-29 11:27:34,582::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:27:34,584::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:34,584::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:34,585::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:34,585::__init__::232::IOProcess::(_processLogs) (202410) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:34,586::__init__::232::IOProcess::(_processLogs) (202410) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:34,586::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:34,586::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:34,587::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-137319::DEBUG::2014-10-29 11:27:34,587::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:27:34,588::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202411) Got request for method 'glob' >Thread-137319::INFO::2014-10-29 11:27:34,589::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:27:34,590::__init__::232::IOProcess::(_processLogs) (202411) Queuing response >Thread-137319::INFO::2014-10-29 11:27:34,590::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137319::INFO::2014-10-29 11:27:34,591::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:27:34,592::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:34,592::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:34,592::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:34,593::__init__::232::IOProcess::(_processLogs) (202412) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:27:34,593::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202412) Queuing response >Thread-137319::DEBUG::2014-10-29 11:27:34,594::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137319::DEBUG::2014-10-29 11:27:34,596::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`c61549d7-97e0-4c31-b51c-2060534c7e29`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137319::DEBUG::2014-10-29 11:27:34,596::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137319::DEBUG::2014-10-29 11:27:34,597::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137319::DEBUG::2014-10-29 11:27:34,597::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`c61549d7-97e0-4c31-b51c-2060534c7e29`::Granted request >Thread-137319::DEBUG::2014-10-29 11:27:34,598::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`62045297-7767-43d5-9868-d37b0399fa25`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137319::DEBUG::2014-10-29 11:27:34,598::task::993::Storage.TaskManager.Task::(_decref) Task=`62045297-7767-43d5-9868-d37b0399fa25`::ref 1 aborting False >Thread-137319::INFO::2014-10-29 11:27:34,601::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137319::DEBUG::2014-10-29 11:27:34,601::task::1191::Storage.TaskManager.Task::(prepare) Task=`62045297-7767-43d5-9868-d37b0399fa25`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137319::DEBUG::2014-10-29 11:27:34,601::task::595::Storage.TaskManager.Task::(_updateState) Task=`62045297-7767-43d5-9868-d37b0399fa25`::moving from state preparing -> state finished >Thread-137319::DEBUG::2014-10-29 11:27:34,602::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137319::DEBUG::2014-10-29 11:27:34,602::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137319::DEBUG::2014-10-29 11:27:34,602::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137319::DEBUG::2014-10-29 11:27:34,603::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137319::DEBUG::2014-10-29 11:27:34,603::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137319::DEBUG::2014-10-29 11:27:34,603::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137319::DEBUG::2014-10-29 11:27:34,603::task::993::Storage.TaskManager.Task::(_decref) Task=`62045297-7767-43d5-9868-d37b0399fa25`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:27:34,636::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54811 >Detector thread::DEBUG::2014-10-29 11:27:34,637::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54811 >Detector thread::DEBUG::2014-10-29 11:27:34,637::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54811 >Detector thread::DEBUG::2014-10-29 11:27:34,638::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54811) >Thread-137324::DEBUG::2014-10-29 11:27:34,676::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137324::DEBUG::2014-10-29 11:27:34,677::task::595::Storage.TaskManager.Task::(_updateState) Task=`b57d8a9d-5f04-4c05-9b65-340f84ae9cd2`::moving from state init -> state preparing >Thread-137324::INFO::2014-10-29 11:27:34,677::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137324::INFO::2014-10-29 11:27:34,678::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581493', 'lastCheck': '5.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00221445', 'lastCheck': '5.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543968', 'lastCheck': '6.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000477011', 'lastCheck': '6.5', 'valid': True}} >Thread-137324::DEBUG::2014-10-29 11:27:34,678::task::1191::Storage.TaskManager.Task::(prepare) Task=`b57d8a9d-5f04-4c05-9b65-340f84ae9cd2`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581493', 'lastCheck': '5.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00221445', 'lastCheck': '5.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543968', 'lastCheck': '6.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000477011', 'lastCheck': '6.5', 'valid': True}} >Thread-137324::DEBUG::2014-10-29 11:27:34,678::task::595::Storage.TaskManager.Task::(_updateState) Task=`b57d8a9d-5f04-4c05-9b65-340f84ae9cd2`::moving from state preparing -> state finished >Thread-137324::DEBUG::2014-10-29 11:27:34,678::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137324::DEBUG::2014-10-29 11:27:34,679::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137324::DEBUG::2014-10-29 11:27:34,679::task::993::Storage.TaskManager.Task::(_decref) Task=`b57d8a9d-5f04-4c05-9b65-340f84ae9cd2`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-10-29 11:27:34,691::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >Thread-22::DEBUG::2014-10-29 11:27:35,640::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:35,930::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:35,933::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137325::DEBUG::2014-10-29 11:27:35,937::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:35,939::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:35,941::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137326::DEBUG::2014-10-29 11:27:35,944::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137326::DEBUG::2014-10-29 11:27:35,946::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:36,633::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:36,634::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:36,636::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:27:38,206::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:38,206::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:38,206::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:38,207::__init__::232::IOProcess::(_processLogs) (202413) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:38,207::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202413) Queuing response >Thread-10269::DEBUG::2014-10-29 11:27:38,209::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:27:38,226::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000522896 s, 960 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:27:38,228::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:38,228::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:38,229::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:38,229::__init__::232::IOProcess::(_processLogs) (202414) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:38,231::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202414) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:38,238::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:38,238::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:38,239::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:38,239::__init__::232::IOProcess::(_processLogs) (202415) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:38,240::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202415) Queuing response >Thread-179::DEBUG::2014-10-29 11:27:38,242::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:27:38,259::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000464182 s, 801 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:27:38,261::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:38,261::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:38,262::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:38,262::__init__::232::IOProcess::(_processLogs) (202416) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:38,264::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202416) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:38,944::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:38,944::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:38,945::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:38,945::__init__::232::IOProcess::(_processLogs) (202417) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:38,945::__init__::232::IOProcess::(_processLogs) (202417) Queuing response >Thread-33::DEBUG::2014-10-29 11:27:38,947::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:38,972::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-17::DEBUG::2014-10-29 11:27:38,974::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-33::DEBUG::2014-10-29 11:27:38,974::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000487672 s, 999 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:27:38,980::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >JsonRpcServer::DEBUG::2014-10-29 11:27:38,982::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:27:38,983::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:38,987::__init__::232::IOProcess::(_processLogs) (202418) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:38,988::__init__::232::IOProcess::(_processLogs) (202418) Queuing response >Thread-137327::DEBUG::2014-10-29 11:27:38,995::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8fce154-2e22-44fb-8aab-2ec72b61445f`::moving from state init -> state preparing >Thread-178::DEBUG::2014-10-29 11:27:38,997::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:27:39,013::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-137327::INFO::2014-10-29 11:27:39,014::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-17::DEBUG::2014-10-29 11:27:39,016::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-178::DEBUG::2014-10-29 11:27:39,017::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000631939 s, 804 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:27:39,018::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:39,021::__init__::232::IOProcess::(_processLogs) (202419) Got request for method 'statvfs' >Thread-137327::INFO::2014-10-29 11:27:39,022::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581493', 'lastCheck': '10.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00221445', 'lastCheck': '10.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464182', 'lastCheck': '0.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000522896', 'lastCheck': '0.8', 'valid': True}} >Thread-137327::DEBUG::2014-10-29 11:27:39,024::task::1191::Storage.TaskManager.Task::(prepare) Task=`d8fce154-2e22-44fb-8aab-2ec72b61445f`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581493', 'lastCheck': '10.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00221445', 'lastCheck': '10.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464182', 'lastCheck': '0.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000522896', 'lastCheck': '0.8', 'valid': True}} >Thread-17::DEBUG::2014-10-29 11:27:39,027::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202419) Queuing response >Thread-137327::DEBUG::2014-10-29 11:27:39,028::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8fce154-2e22-44fb-8aab-2ec72b61445f`::moving from state preparing -> state finished >Thread-137327::DEBUG::2014-10-29 11:27:39,031::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17::DEBUG::2014-10-29 11:27:39,031::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-137327::DEBUG::2014-10-29 11:27:39,032::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17::DEBUG::2014-10-29 11:27:39,033::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137327::DEBUG::2014-10-29 11:27:39,034::task::993::Storage.TaskManager.Task::(_decref) Task=`d8fce154-2e22-44fb-8aab-2ec72b61445f`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:27:39,039::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:39,042::__init__::232::IOProcess::(_processLogs) (202420) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:39,044::__init__::232::IOProcess::(_processLogs) (202420) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:39,046::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:39,047::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:39,047::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:39,047::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:39,048::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:39,048::__init__::232::IOProcess::(_processLogs) (202421) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:39,048::__init__::232::IOProcess::(_processLogs) (202421) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:39,049::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:39,049::__init__::232::IOProcess::(_processLogs) (202422) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:39,049::__init__::232::IOProcess::(_processLogs) (202422) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:39,062::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:39,063::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:39,063::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:39,063::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:39,064::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:39,065::__init__::232::IOProcess::(_processLogs) (202423) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:39,065::__init__::232::IOProcess::(_processLogs) (202423) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:39,066::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:39,066::__init__::232::IOProcess::(_processLogs) (202424) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:39,066::__init__::232::IOProcess::(_processLogs) (202424) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:39,069::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:39,069::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:39,070::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:39,072::__init__::232::IOProcess::(_processLogs) (202425) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:39,072::__init__::232::IOProcess::(_processLogs) (202425) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:39,073::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:39,073::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:39,073::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:39,073::__init__::232::IOProcess::(_processLogs) (202426) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:39,074::__init__::232::IOProcess::(_processLogs) (202426) Queuing response >Thread-137327::DEBUG::2014-10-29 11:27:39,090::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:39,114::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:39,119::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137328::DEBUG::2014-10-29 11:27:39,125::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137328::DEBUG::2014-10-29 11:27:39,128::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:27:40,357::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54812 >Detector thread::DEBUG::2014-10-29 11:27:40,358::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54812 >Detector thread::DEBUG::2014-10-29 11:27:40,358::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54812 >Detector thread::DEBUG::2014-10-29 11:27:40,359::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54812) >Thread-137329::DEBUG::2014-10-29 11:27:40,397::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137329::DEBUG::2014-10-29 11:27:40,398::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137329::DEBUG::2014-10-29 11:27:40,399::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.90', 'elapsedTime': '514692', 'displayType': 'vnc', 'cpuSys': '1.26', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '19005875', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '59411', 'readRate': '0.00', 'truesize': '6010896384', 'writeRate': '40148.74'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.76', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:27:40,500::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54813 >Detector thread::DEBUG::2014-10-29 11:27:40,501::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54813 >Detector thread::DEBUG::2014-10-29 11:27:40,501::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54813 >Detector thread::DEBUG::2014-10-29 11:27:40,502::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54813) >Thread-137330::DEBUG::2014-10-29 11:27:40,541::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137330::DEBUG::2014-10-29 11:27:40,543::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137330::DEBUG::2014-10-29 11:27:40,563::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137330::DEBUG::2014-10-29 11:27:40,623::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '80', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '80', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:27:40,784::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54815 >Detector thread::DEBUG::2014-10-29 11:27:40,785::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54815 >Detector thread::DEBUG::2014-10-29 11:27:40,785::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54815 >Detector thread::DEBUG::2014-10-29 11:27:40,786::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54815) >Thread-137331::DEBUG::2014-10-29 11:27:40,825::task::595::Storage.TaskManager.Task::(_updateState) Task=`d6a86550-e11d-419e-a4dd-1002f4e7e619`::moving from state init -> state preparing >Thread-137331::INFO::2014-10-29 11:27:40,825::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137331::INFO::2014-10-29 11:27:40,826::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631939', 'lastCheck': '1.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487672', 'lastCheck': '1.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464182', 'lastCheck': '2.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000522896', 'lastCheck': '2.6', 'valid': True}} >Thread-137331::DEBUG::2014-10-29 11:27:40,826::task::1191::Storage.TaskManager.Task::(prepare) Task=`d6a86550-e11d-419e-a4dd-1002f4e7e619`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631939', 'lastCheck': '1.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487672', 'lastCheck': '1.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464182', 'lastCheck': '2.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000522896', 'lastCheck': '2.6', 'valid': True}} >Thread-137331::DEBUG::2014-10-29 11:27:40,827::task::595::Storage.TaskManager.Task::(_updateState) Task=`d6a86550-e11d-419e-a4dd-1002f4e7e619`::moving from state preparing -> state finished >Thread-137331::DEBUG::2014-10-29 11:27:40,827::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137331::DEBUG::2014-10-29 11:27:40,827::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137331::DEBUG::2014-10-29 11:27:40,828::task::993::Storage.TaskManager.Task::(_decref) Task=`d6a86550-e11d-419e-a4dd-1002f4e7e619`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:41,643::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:41,644::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:41,646::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:42,204::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:42,206::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137332::DEBUG::2014-10-29 11:27:42,209::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:42,211::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:42,213::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137333::DEBUG::2014-10-29 11:27:42,216::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137333::DEBUG::2014-10-29 11:27:42,218::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:45,240::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:45,243::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137334::DEBUG::2014-10-29 11:27:45,247::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:45,249::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:45,250::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137335::DEBUG::2014-10-29 11:27:45,253::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137335::DEBUG::2014-10-29 11:27:45,256::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:27:45,259::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54817 >Detector thread::DEBUG::2014-10-29 11:27:45,260::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54817 >Detector thread::DEBUG::2014-10-29 11:27:45,260::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54817 >Detector thread::DEBUG::2014-10-29 11:27:45,260::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54817) >Thread-137336::DEBUG::2014-10-29 11:27:45,300::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137336::DEBUG::2014-10-29 11:27:45,300::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e5ca843-ba74-4197-927a-35b64244d705`::moving from state init -> state preparing >Thread-137336::INFO::2014-10-29 11:27:45,301::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137336::DEBUG::2014-10-29 11:27:45,304::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:27:45,305::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:45,306::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:45,306::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:45,306::__init__::232::IOProcess::(_processLogs) (202427) Got request for method 'glob' >Thread-137336::DEBUG::2014-10-29 11:27:45,307::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:27:45,307::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202427) Queuing response >Thread-137336::DEBUG::2014-10-29 11:27:45,309::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137336::INFO::2014-10-29 11:27:45,309::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137336::DEBUG::2014-10-29 11:27:45,310::task::1191::Storage.TaskManager.Task::(prepare) Task=`0e5ca843-ba74-4197-927a-35b64244d705`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137336::DEBUG::2014-10-29 11:27:45,310::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e5ca843-ba74-4197-927a-35b64244d705`::moving from state preparing -> state finished >Thread-137336::DEBUG::2014-10-29 11:27:45,310::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137336::DEBUG::2014-10-29 11:27:45,310::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137336::DEBUG::2014-10-29 11:27:45,311::task::993::Storage.TaskManager.Task::(_decref) Task=`0e5ca843-ba74-4197-927a-35b64244d705`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:27:45,354::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54818 >Detector thread::DEBUG::2014-10-29 11:27:45,355::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54818 >Detector thread::DEBUG::2014-10-29 11:27:45,355::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54818 >Detector thread::DEBUG::2014-10-29 11:27:45,356::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54818) >Thread-137337::DEBUG::2014-10-29 11:27:45,394::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137337::DEBUG::2014-10-29 11:27:45,394::task::595::Storage.TaskManager.Task::(_updateState) Task=`637245a9-56e1-4c5d-bc56-14f60c4e54dc`::moving from state init -> state preparing >Thread-137337::INFO::2014-10-29 11:27:45,395::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137337::DEBUG::2014-10-29 11:27:45,395::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137337::DEBUG::2014-10-29 11:27:45,395::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137337::DEBUG::2014-10-29 11:27:45,396::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137337::DEBUG::2014-10-29 11:27:45,396::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137337::DEBUG::2014-10-29 11:27:45,396::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137337::DEBUG::2014-10-29 11:27:45,397::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137337::DEBUG::2014-10-29 11:27:45,484::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137337::DEBUG::2014-10-29 11:27:45,485::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137337::DEBUG::2014-10-29 11:27:45,681::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137337::DEBUG::2014-10-29 11:27:45,688::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137337::DEBUG::2014-10-29 11:27:45,688::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137337::DEBUG::2014-10-29 11:27:45,689::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137337::DEBUG::2014-10-29 11:27:45,691::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137337::DEBUG::2014-10-29 11:27:45,694::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137337::DEBUG::2014-10-29 11:27:45,697::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137337::DEBUG::2014-10-29 11:27:45,699::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:27:45,711::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:45,716::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:45,719::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:45,720::__init__::232::IOProcess::(_processLogs) (202428) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:27:45,724::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202428) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:45,728::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:45,730::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:45,732::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:45,739::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202429) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:27:45,741::__init__::232::IOProcess::(_processLogs) (202429) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:45,746::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:45,762::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:45,766::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:45,768::__init__::232::IOProcess::(_processLogs) (202430) Got request for method 'glob' >Thread-137337::DEBUG::2014-10-29 11:27:45,777::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:27:45,776::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202430) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:45,783::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:45,785::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:45,789::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:45,792::__init__::232::IOProcess::(_processLogs) (202431) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:27:45,793::__init__::232::IOProcess::(_processLogs) (202431) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:45,796::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:45,798::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:45,799::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:45,801::__init__::232::IOProcess::(_processLogs) (202432) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:27:45,805::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202432) Queuing response >Thread-137337::DEBUG::2014-10-29 11:27:45,806::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:27:45,811::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:45,812::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:45,814::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:45,815::__init__::232::IOProcess::(_processLogs) (202433) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:27:45,819::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202433) Queuing response >Thread-137337::DEBUG::2014-10-29 11:27:45,820::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:27:45,827::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:45,828::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:45,830::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:45,832::__init__::232::IOProcess::(_processLogs) (202434) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:45,835::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202434) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:45,838::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:45,840::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:45,843::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-137337::DEBUG::2014-10-29 11:27:45,843::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-137337::INFO::2014-10-29 11:27:45,846::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:27:45,846::__init__::232::IOProcess::(_processLogs) (202435) Got request for method 'glob' >Thread-137337::INFO::2014-10-29 11:27:45,848::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:27:45,849::__init__::232::IOProcess::(_processLogs) (202435) Queuing response >Thread-137337::INFO::2014-10-29 11:27:45,851::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:27:45,855::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:45,857::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:45,858::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:45,860::__init__::232::IOProcess::(_processLogs) (202436) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:27:45,864::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202436) Queuing response >Thread-137337::DEBUG::2014-10-29 11:27:45,865::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137337::DEBUG::2014-10-29 11:27:45,873::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`7efada1f-40f3-4ccd-97c8-1d014fa38f55`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137337::DEBUG::2014-10-29 11:27:45,875::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137337::DEBUG::2014-10-29 11:27:45,878::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137337::DEBUG::2014-10-29 11:27:45,879::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`7efada1f-40f3-4ccd-97c8-1d014fa38f55`::Granted request >Thread-137337::DEBUG::2014-10-29 11:27:45,883::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`637245a9-56e1-4c5d-bc56-14f60c4e54dc`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137337::DEBUG::2014-10-29 11:27:45,885::task::993::Storage.TaskManager.Task::(_decref) Task=`637245a9-56e1-4c5d-bc56-14f60c4e54dc`::ref 1 aborting False >Thread-137337::INFO::2014-10-29 11:27:45,900::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137337::DEBUG::2014-10-29 11:27:45,901::task::1191::Storage.TaskManager.Task::(prepare) Task=`637245a9-56e1-4c5d-bc56-14f60c4e54dc`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137337::DEBUG::2014-10-29 11:27:45,903::task::595::Storage.TaskManager.Task::(_updateState) Task=`637245a9-56e1-4c5d-bc56-14f60c4e54dc`::moving from state preparing -> state finished >Thread-137337::DEBUG::2014-10-29 11:27:45,904::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137337::DEBUG::2014-10-29 11:27:45,906::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137337::DEBUG::2014-10-29 11:27:45,909::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137337::DEBUG::2014-10-29 11:27:45,911::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137337::DEBUG::2014-10-29 11:27:45,912::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137337::DEBUG::2014-10-29 11:27:45,913::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137337::DEBUG::2014-10-29 11:27:45,916::task::993::Storage.TaskManager.Task::(_decref) Task=`637245a9-56e1-4c5d-bc56-14f60c4e54dc`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:27:45,948::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54819 >Detector thread::DEBUG::2014-10-29 11:27:45,951::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54819 >Detector thread::DEBUG::2014-10-29 11:27:45,952::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54819 >Detector thread::DEBUG::2014-10-29 11:27:45,954::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54819) >Thread-137342::DEBUG::2014-10-29 11:27:45,988::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137342::DEBUG::2014-10-29 11:27:45,989::task::595::Storage.TaskManager.Task::(_updateState) Task=`bf5a5b41-650a-4522-97b0-8b09d82923a9`::moving from state init -> state preparing >Thread-137342::INFO::2014-10-29 11:27:45,989::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137342::INFO::2014-10-29 11:27:45,990::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631939', 'lastCheck': '6.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487672', 'lastCheck': '6.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464182', 'lastCheck': '7.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000522896', 'lastCheck': '7.8', 'valid': True}} >Thread-137342::DEBUG::2014-10-29 11:27:45,990::task::1191::Storage.TaskManager.Task::(prepare) Task=`bf5a5b41-650a-4522-97b0-8b09d82923a9`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631939', 'lastCheck': '6.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487672', 'lastCheck': '6.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464182', 'lastCheck': '7.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000522896', 'lastCheck': '7.8', 'valid': True}} >Thread-137342::DEBUG::2014-10-29 11:27:45,991::task::595::Storage.TaskManager.Task::(_updateState) Task=`bf5a5b41-650a-4522-97b0-8b09d82923a9`::moving from state preparing -> state finished >Thread-137342::DEBUG::2014-10-29 11:27:45,991::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137342::DEBUG::2014-10-29 11:27:45,991::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137342::DEBUG::2014-10-29 11:27:45,991::task::993::Storage.TaskManager.Task::(_decref) Task=`bf5a5b41-650a-4522-97b0-8b09d82923a9`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:46,655::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:46,661::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:46,666::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:27:48,234::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:48,234::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:48,234::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:48,235::__init__::232::IOProcess::(_processLogs) (202437) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:48,268::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:48,268::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:48,269::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:48,270::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-17::DEBUG::2014-10-29 11:27:48,271::__init__::232::IOProcess::(_processLogs) (202438) Got request for method 'statvfs' >JsonRpcServer::DEBUG::2014-10-29 11:27:48,273::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137343::DEBUG::2014-10-29 11:27:48,277::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:48,279::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:48,281::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137344::DEBUG::2014-10-29 11:27:48,284::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137344::DEBUG::2014-10-29 11:27:48,286::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:27:49,072::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:49,072::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:49,073::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:49,073::__init__::232::IOProcess::(_processLogs) (202439) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:49,076::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:49,076::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:49,077::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:49,077::__init__::232::IOProcess::(_processLogs) (202440) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:49,271::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202438) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:49,272::__init__::232::IOProcess::(_processLogs) (202437) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:49,273::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202439) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:49,276::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202440) Queuing response >Thread-179::DEBUG::2014-10-29 11:27:49,278::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:27:49,280::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:27:49,320::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000505238 s, 736 kB/s\n'; <rc> = 0 >Thread-10269::DEBUG::2014-10-29 11:27:49,325::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000486621 s, 1.0 MB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-10-29 11:27:49,327::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:27:49,347::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:27:49,350::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-33::DEBUG::2014-10-29 11:27:49,366::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000664997 s, 732 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:27:49,367::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-178::DEBUG::2014-10-29 11:27:49,369::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000433768 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:27:49,372::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:49,373::__init__::232::IOProcess::(_processLogs) (202441) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:49,373::__init__::232::IOProcess::(_processLogs) (202441) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:49,377::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:49,378::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:49,378::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:49,378::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:49,379::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:49,379::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:49,379::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:49,381::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:49,381::__init__::232::IOProcess::(_processLogs) (202443) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:49,381::__init__::232::IOProcess::(_processLogs) (202442) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:49,383::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:49,384::__init__::232::IOProcess::(_processLogs) (202444) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:49,384::__init__::232::IOProcess::(_processLogs) (202443) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:49,385::__init__::232::IOProcess::(_processLogs) (202442) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:49,385::__init__::232::IOProcess::(_processLogs) (202444) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:49,390::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:49,391::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:49,391::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:49,391::__init__::232::IOProcess::(_processLogs) (202445) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:49,392::__init__::232::IOProcess::(_processLogs) (202445) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:49,394::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:49,395::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:49,395::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:49,395::__init__::232::IOProcess::(_processLogs) (202446) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:49,395::__init__::232::IOProcess::(_processLogs) (202446) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:49,396::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:49,396::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:49,397::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:49,398::__init__::232::IOProcess::(_processLogs) (202447) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:49,398::__init__::232::IOProcess::(_processLogs) (202447) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:49,399::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:49,400::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:49,400::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:49,400::__init__::232::IOProcess::(_processLogs) (202448) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:49,401::__init__::232::IOProcess::(_processLogs) (202448) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:49,402::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:49,402::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:49,403::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:49,403::__init__::232::IOProcess::(_processLogs) (202449) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:49,404::__init__::232::IOProcess::(_processLogs) (202449) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:49,404::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:49,404::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:49,405::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:49,405::__init__::232::IOProcess::(_processLogs) (202450) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:49,406::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202450) Queuing response >Detector thread::DEBUG::2014-10-29 11:27:50,561::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54820 >Detector thread::DEBUG::2014-10-29 11:27:50,562::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54820 >Detector thread::DEBUG::2014-10-29 11:27:50,562::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54820 >Detector thread::DEBUG::2014-10-29 11:27:50,563::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54820) >Thread-137345::DEBUG::2014-10-29 11:27:50,601::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137345::DEBUG::2014-10-29 11:27:50,602::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137345::DEBUG::2014-10-29 11:27:50,603::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '4.90', 'elapsedTime': '514703', 'displayType': 'vnc', 'cpuSys': '1.26', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '19005875', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '59411', 'readRate': '0.00', 'truesize': '6010896384', 'writeRate': '40148.74'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.96', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-22::DEBUG::2014-10-29 11:27:50,646::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac55b63a-9cef-4d9e-9648-89bc50192b25`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:27:50,646::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:27:50,647::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:50,648::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:50,648::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:50,649::__init__::232::IOProcess::(_processLogs) (202451) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:27:50,649::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202451) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:50,651::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:50,651::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:50,653::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-22::INFO::2014-10-29 11:27:50,653::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010904576', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:27:50,654::__init__::232::IOProcess::(_processLogs) (202452) Got request for method 'stat' >Thread-22::DEBUG::2014-10-29 11:27:50,655::task::1191::Storage.TaskManager.Task::(prepare) Task=`ac55b63a-9cef-4d9e-9648-89bc50192b25`::finished: {'truesize': '6010904576', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:27:50,655::__init__::232::IOProcess::(_processLogs) (202452) Queuing response >Thread-22::DEBUG::2014-10-29 11:27:50,656::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac55b63a-9cef-4d9e-9648-89bc50192b25`::moving from state preparing -> state finished >Thread-22::DEBUG::2014-10-29 11:27:50,657::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-10-29 11:27:50,657::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2014-10-29 11:27:50,657::task::993::Storage.TaskManager.Task::(_decref) Task=`ac55b63a-9cef-4d9e-9648-89bc50192b25`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:27:50,703::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54821 >Detector thread::DEBUG::2014-10-29 11:27:50,704::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54821 >Detector thread::DEBUG::2014-10-29 11:27:50,704::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54821 >Detector thread::DEBUG::2014-10-29 11:27:50,705::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54821) >Thread-137346::DEBUG::2014-10-29 11:27:50,744::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137346::DEBUG::2014-10-29 11:27:50,747::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137346::DEBUG::2014-10-29 11:27:50,765::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-10-29 11:27:50,770::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-137346::DEBUG::2014-10-29 11:27:50,831::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '58', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '58', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:27:50,894::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54823 >Detector thread::DEBUG::2014-10-29 11:27:50,895::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54823 >Detector thread::DEBUG::2014-10-29 11:27:50,896::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54823 >Detector thread::DEBUG::2014-10-29 11:27:50,896::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54823) >Thread-137347::DEBUG::2014-10-29 11:27:50,936::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f7a625f-d903-4710-96c0-332937ee90ea`::moving from state init -> state preparing >Thread-137347::INFO::2014-10-29 11:27:50,937::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137347::INFO::2014-10-29 11:27:50,938::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000433768', 'lastCheck': '1.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664997', 'lastCheck': '1.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505238', 'lastCheck': '1.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000486621', 'lastCheck': '1.5', 'valid': True}} >Thread-137347::DEBUG::2014-10-29 11:27:50,938::task::1191::Storage.TaskManager.Task::(prepare) Task=`1f7a625f-d903-4710-96c0-332937ee90ea`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000433768', 'lastCheck': '1.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664997', 'lastCheck': '1.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505238', 'lastCheck': '1.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000486621', 'lastCheck': '1.5', 'valid': True}} >Thread-137347::DEBUG::2014-10-29 11:27:50,938::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f7a625f-d903-4710-96c0-332937ee90ea`::moving from state preparing -> state finished >Thread-137347::DEBUG::2014-10-29 11:27:50,938::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137347::DEBUG::2014-10-29 11:27:50,939::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137347::DEBUG::2014-10-29 11:27:50,939::task::993::Storage.TaskManager.Task::(_decref) Task=`1f7a625f-d903-4710-96c0-332937ee90ea`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:51,300::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:51,302::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137348::DEBUG::2014-10-29 11:27:51,306::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:51,308::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:51,310::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137349::DEBUG::2014-10-29 11:27:51,313::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137349::DEBUG::2014-10-29 11:27:51,315::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:51,674::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:51,675::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:51,676::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:54,328::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:54,330::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137350::DEBUG::2014-10-29 11:27:54,334::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7124a82-4909-44a6-8de8-3d2d05a83656`::moving from state init -> state preparing >Thread-137350::INFO::2014-10-29 11:27:54,334::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137350::INFO::2014-10-29 11:27:54,335::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000433768', 'lastCheck': '4.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664997', 'lastCheck': '4.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505238', 'lastCheck': '5.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000486621', 'lastCheck': '4.9', 'valid': True}} >Thread-137350::DEBUG::2014-10-29 11:27:54,335::task::1191::Storage.TaskManager.Task::(prepare) Task=`e7124a82-4909-44a6-8de8-3d2d05a83656`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000433768', 'lastCheck': '4.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664997', 'lastCheck': '4.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505238', 'lastCheck': '5.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000486621', 'lastCheck': '4.9', 'valid': True}} >Thread-137350::DEBUG::2014-10-29 11:27:54,335::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7124a82-4909-44a6-8de8-3d2d05a83656`::moving from state preparing -> state finished >Thread-137350::DEBUG::2014-10-29 11:27:54,335::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137350::DEBUG::2014-10-29 11:27:54,336::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137350::DEBUG::2014-10-29 11:27:54,336::task::993::Storage.TaskManager.Task::(_decref) Task=`e7124a82-4909-44a6-8de8-3d2d05a83656`::ref 0 aborting False >Thread-137350::DEBUG::2014-10-29 11:27:54,356::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:54,378::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:54,380::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137351::DEBUG::2014-10-29 11:27:54,383::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137351::DEBUG::2014-10-29 11:27:54,385::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:27:56,575::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54825 >Detector thread::DEBUG::2014-10-29 11:27:56,576::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54825 >Detector thread::DEBUG::2014-10-29 11:27:56,576::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54825 >Detector thread::DEBUG::2014-10-29 11:27:56,577::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54825) >Thread-137352::DEBUG::2014-10-29 11:27:56,616::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137352::DEBUG::2014-10-29 11:27:56,617::task::595::Storage.TaskManager.Task::(_updateState) Task=`b16f2858-1f37-46c9-ba51-b41e4a8819b3`::moving from state init -> state preparing >Thread-137352::INFO::2014-10-29 11:27:56,617::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137352::DEBUG::2014-10-29 11:27:56,622::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:27:56,623::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:56,623::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:56,623::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:56,624::__init__::232::IOProcess::(_processLogs) (202453) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:27:56,625::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202453) Queuing response >Thread-137352::DEBUG::2014-10-29 11:27:56,625::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137352::DEBUG::2014-10-29 11:27:56,626::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137352::INFO::2014-10-29 11:27:56,627::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137352::DEBUG::2014-10-29 11:27:56,627::task::1191::Storage.TaskManager.Task::(prepare) Task=`b16f2858-1f37-46c9-ba51-b41e4a8819b3`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137352::DEBUG::2014-10-29 11:27:56,627::task::595::Storage.TaskManager.Task::(_updateState) Task=`b16f2858-1f37-46c9-ba51-b41e4a8819b3`::moving from state preparing -> state finished >Thread-137352::DEBUG::2014-10-29 11:27:56,627::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137352::DEBUG::2014-10-29 11:27:56,628::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137352::DEBUG::2014-10-29 11:27:56,628::task::993::Storage.TaskManager.Task::(_decref) Task=`b16f2858-1f37-46c9-ba51-b41e4a8819b3`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:27:56,671::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54826 >Detector thread::DEBUG::2014-10-29 11:27:56,672::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54826 >Detector thread::DEBUG::2014-10-29 11:27:56,672::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54826 >Detector thread::DEBUG::2014-10-29 11:27:56,673::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54826) >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:56,683::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:56,684::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:27:56,685::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137353::DEBUG::2014-10-29 11:27:56,712::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137353::DEBUG::2014-10-29 11:27:56,712::task::595::Storage.TaskManager.Task::(_updateState) Task=`243ba2c9-da70-4693-9ace-71e5b8c96eaf`::moving from state init -> state preparing >Thread-137353::INFO::2014-10-29 11:27:56,713::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137353::DEBUG::2014-10-29 11:27:56,713::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137353::DEBUG::2014-10-29 11:27:56,713::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137353::DEBUG::2014-10-29 11:27:56,714::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137353::DEBUG::2014-10-29 11:27:56,714::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137353::DEBUG::2014-10-29 11:27:56,714::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137353::DEBUG::2014-10-29 11:27:56,715::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137353::DEBUG::2014-10-29 11:27:56,808::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137353::DEBUG::2014-10-29 11:27:56,809::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137353::DEBUG::2014-10-29 11:27:56,990::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137353::DEBUG::2014-10-29 11:27:56,991::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137353::DEBUG::2014-10-29 11:27:56,992::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137353::DEBUG::2014-10-29 11:27:56,992::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137353::DEBUG::2014-10-29 11:27:56,992::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137353::DEBUG::2014-10-29 11:27:56,993::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137353::DEBUG::2014-10-29 11:27:56,993::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137353::DEBUG::2014-10-29 11:27:56,993::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:27:57,001::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:57,001::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:57,001::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:57,002::__init__::232::IOProcess::(_processLogs) (202454) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:27:57,002::__init__::232::IOProcess::(_processLogs) (202454) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:57,003::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:57,003::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:57,004::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:57,004::__init__::232::IOProcess::(_processLogs) (202455) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:27:57,005::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202455) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:57,010::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:57,011::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:57,013::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:57,015::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:57,015::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:57,015::__init__::232::IOProcess::(_processLogs) (202456) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:27:57,015::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:57,017::__init__::232::IOProcess::(_processLogs) (202457) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:27:57,020::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202457) Queuing response >Thread-137353::DEBUG::2014-10-29 11:27:57,023::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:27:57,023::__init__::232::IOProcess::(_processLogs) (202456) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:57,026::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:57,026::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:57,026::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:57,027::__init__::232::IOProcess::(_processLogs) (202458) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:27:57,028::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202458) Queuing response >Thread-137353::DEBUG::2014-10-29 11:27:57,028::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:27:57,030::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:57,030::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:57,030::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:57,031::__init__::232::IOProcess::(_processLogs) (202459) Got request for method 'readfile' >Thread-137353::DEBUG::2014-10-29 11:27:57,032::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:27:57,032::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202459) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:57,034::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:57,034::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:57,035::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:57,035::__init__::232::IOProcess::(_processLogs) (202460) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:57,036::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202460) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:57,037::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:57,037::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:57,037::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:57,037::__init__::232::IOProcess::(_processLogs) (202461) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:27:57,038::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202461) Queuing response >Thread-137353::DEBUG::2014-10-29 11:27:57,038::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-137353::INFO::2014-10-29 11:27:57,040::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137353::INFO::2014-10-29 11:27:57,040::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137353::INFO::2014-10-29 11:27:57,040::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:27:57,041::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:57,041::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:57,041::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:57,042::__init__::232::IOProcess::(_processLogs) (202462) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:27:57,042::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202462) Queuing response >Thread-137353::DEBUG::2014-10-29 11:27:57,043::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137353::DEBUG::2014-10-29 11:27:57,044::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`bb2d0c84-60de-4e4c-8da3-80f5404a6698`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137353::DEBUG::2014-10-29 11:27:57,044::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137353::DEBUG::2014-10-29 11:27:57,045::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137353::DEBUG::2014-10-29 11:27:57,045::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`bb2d0c84-60de-4e4c-8da3-80f5404a6698`::Granted request >Thread-137353::DEBUG::2014-10-29 11:27:57,046::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`243ba2c9-da70-4693-9ace-71e5b8c96eaf`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137353::DEBUG::2014-10-29 11:27:57,046::task::993::Storage.TaskManager.Task::(_decref) Task=`243ba2c9-da70-4693-9ace-71e5b8c96eaf`::ref 1 aborting False >Thread-137353::INFO::2014-10-29 11:27:57,049::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137353::DEBUG::2014-10-29 11:27:57,049::task::1191::Storage.TaskManager.Task::(prepare) Task=`243ba2c9-da70-4693-9ace-71e5b8c96eaf`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137353::DEBUG::2014-10-29 11:27:57,049::task::595::Storage.TaskManager.Task::(_updateState) Task=`243ba2c9-da70-4693-9ace-71e5b8c96eaf`::moving from state preparing -> state finished >Thread-137353::DEBUG::2014-10-29 11:27:57,050::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137353::DEBUG::2014-10-29 11:27:57,050::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137353::DEBUG::2014-10-29 11:27:57,050::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137353::DEBUG::2014-10-29 11:27:57,051::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137353::DEBUG::2014-10-29 11:27:57,051::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137353::DEBUG::2014-10-29 11:27:57,051::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137353::DEBUG::2014-10-29 11:27:57,052::task::993::Storage.TaskManager.Task::(_decref) Task=`243ba2c9-da70-4693-9ace-71e5b8c96eaf`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:27:57,083::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54827 >Detector thread::DEBUG::2014-10-29 11:27:57,083::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54827 >Detector thread::DEBUG::2014-10-29 11:27:57,084::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54827 >Detector thread::DEBUG::2014-10-29 11:27:57,084::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54827) >Thread-137358::DEBUG::2014-10-29 11:27:57,123::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137358::DEBUG::2014-10-29 11:27:57,123::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c0d6d9d-ec1b-4b32-8e32-4cc3bc9b9965`::moving from state init -> state preparing >Thread-137358::INFO::2014-10-29 11:27:57,124::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137358::INFO::2014-10-29 11:27:57,124::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000433768', 'lastCheck': '7.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664997', 'lastCheck': '7.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505238', 'lastCheck': '7.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000486621', 'lastCheck': '7.7', 'valid': True}} >Thread-137358::DEBUG::2014-10-29 11:27:57,125::task::1191::Storage.TaskManager.Task::(prepare) Task=`9c0d6d9d-ec1b-4b32-8e32-4cc3bc9b9965`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000433768', 'lastCheck': '7.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664997', 'lastCheck': '7.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505238', 'lastCheck': '7.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000486621', 'lastCheck': '7.7', 'valid': True}} >Thread-137358::DEBUG::2014-10-29 11:27:57,125::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c0d6d9d-ec1b-4b32-8e32-4cc3bc9b9965`::moving from state preparing -> state finished >Thread-137358::DEBUG::2014-10-29 11:27:57,125::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137358::DEBUG::2014-10-29 11:27:57,126::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137358::DEBUG::2014-10-29 11:27:57,126::task::993::Storage.TaskManager.Task::(_decref) Task=`9c0d6d9d-ec1b-4b32-8e32-4cc3bc9b9965`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:57,428::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:57,432::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137359::DEBUG::2014-10-29 11:27:57,435::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:27:57,437::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:27:57,439::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137360::DEBUG::2014-10-29 11:27:57,443::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137360::DEBUG::2014-10-29 11:27:57,446::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:27:59,382::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:59,382::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:59,382::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:59,383::__init__::232::IOProcess::(_processLogs) (202463) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:59,383::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202463) Queuing response >Thread-179::DEBUG::2014-10-29 11:27:59,385::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:27:59,406::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-179::DEBUG::2014-10-29 11:27:59,411::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000558793 s, 666 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:27:59,415::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:59,416::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-10269::DEBUG::2014-10-29 11:27:59,416::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:27:59,417::__init__::232::IOProcess::(_processLogs) (202464) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:59,436::__init__::232::IOProcess::(_processLogs) (202464) Queuing response >Thread-10269::DEBUG::2014-10-29 11:27:59,437::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000510866 s, 983 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:27:59,440::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:59,440::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:59,441::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:59,441::__init__::232::IOProcess::(_processLogs) (202465) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:59,443::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202465) Queuing response >Thread-33::DEBUG::2014-10-29 11:27:59,444::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:27:59,445::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:59,465::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:59,467::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-33::DEBUG::2014-10-29 11:27:59,467::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000450999 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:27:59,469::__init__::232::IOProcess::(_processLogs) (202466) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:59,472::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202466) Queuing response >Thread-178::DEBUG::2014-10-29 11:27:59,474::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:27:59,489::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:59,491::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-178::DEBUG::2014-10-29 11:27:59,493::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000506482 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:27:59,498::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:59,499::__init__::232::IOProcess::(_processLogs) (202467) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:59,499::__init__::232::IOProcess::(_processLogs) (202467) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:59,500::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:59,500::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:59,502::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:59,502::__init__::232::IOProcess::(_processLogs) (202468) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:59,503::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202468) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:59,505::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:59,505::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:59,505::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:59,506::__init__::232::IOProcess::(_processLogs) (202469) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:59,506::__init__::232::IOProcess::(_processLogs) (202469) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:59,509::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:59,511::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:59,512::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:59,512::__init__::232::IOProcess::(_processLogs) (202470) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:27:59,512::__init__::232::IOProcess::(_processLogs) (202470) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:59,513::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:59,514::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:59,515::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:59,515::__init__::232::IOProcess::(_processLogs) (202471) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:59,515::__init__::232::IOProcess::(_processLogs) (202471) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:59,515::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:59,516::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:59,517::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:59,517::__init__::232::IOProcess::(_processLogs) (202472) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:59,518::__init__::232::IOProcess::(_processLogs) (202472) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:59,518::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:59,519::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:59,520::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:59,520::__init__::232::IOProcess::(_processLogs) (202473) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:59,520::__init__::232::IOProcess::(_processLogs) (202473) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:59,520::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:59,521::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:59,522::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:59,522::__init__::232::IOProcess::(_processLogs) (202474) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:59,523::__init__::232::IOProcess::(_processLogs) (202474) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:59,523::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:59,523::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:59,524::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:59,524::__init__::232::IOProcess::(_processLogs) (202475) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:59,525::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202475) Queuing response >Thread-17::DEBUG::2014-10-29 11:27:59,526::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:27:59,526::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:27:59,527::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:27:59,527::__init__::232::IOProcess::(_processLogs) (202476) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:27:59,527::__init__::232::IOProcess::(_processLogs) (202476) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:00,469::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:00,471::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137361::DEBUG::2014-10-29 11:28:00,475::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:00,478::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:00,480::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137362::DEBUG::2014-10-29 11:28:00,483::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137362::DEBUG::2014-10-29 11:28:00,485::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:28:00,778::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54828 >Detector thread::DEBUG::2014-10-29 11:28:00,778::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54828 >Detector thread::DEBUG::2014-10-29 11:28:00,781::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54828 >Detector thread::DEBUG::2014-10-29 11:28:00,782::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54828) >Thread-137363::DEBUG::2014-10-29 11:28:00,818::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137363::DEBUG::2014-10-29 11:28:00,819::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137363::DEBUG::2014-10-29 11:28:00,819::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.42', 'elapsedTime': '514713', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '6666671', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '86562', 'readRate': '0.00', 'truesize': '6010904576', 'writeRate': '37985.86'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.04', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:28:00,917::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54829 >Detector thread::DEBUG::2014-10-29 11:28:00,918::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54829 >Detector thread::DEBUG::2014-10-29 11:28:00,918::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54829 >Detector thread::DEBUG::2014-10-29 11:28:00,918::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54829) >Thread-137364::DEBUG::2014-10-29 11:28:00,957::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137364::DEBUG::2014-10-29 11:28:00,959::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137364::DEBUG::2014-10-29 11:28:00,979::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Detector thread::DEBUG::2014-10-29 11:28:01,011::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54831 >Detector thread::DEBUG::2014-10-29 11:28:01,014::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54831 >Detector thread::DEBUG::2014-10-29 11:28:01,016::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54831 >Detector thread::DEBUG::2014-10-29 11:28:01,018::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54831) >Thread-137365::DEBUG::2014-10-29 11:28:01,084::task::595::Storage.TaskManager.Task::(_updateState) Task=`88945608-be35-4c22-aebb-a769251c3233`::moving from state init -> state preparing >Thread-137364::DEBUG::2014-10-29 11:28:01,087::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '35', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '35', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-137365::INFO::2014-10-29 11:28:01,087::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137365::INFO::2014-10-29 11:28:01,093::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506482', 'lastCheck': '1.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000450999', 'lastCheck': '1.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558793', 'lastCheck': '1.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000510866', 'lastCheck': '1.6', 'valid': True}} >Thread-137365::DEBUG::2014-10-29 11:28:01,095::task::1191::Storage.TaskManager.Task::(prepare) Task=`88945608-be35-4c22-aebb-a769251c3233`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506482', 'lastCheck': '1.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000450999', 'lastCheck': '1.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558793', 'lastCheck': '1.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000510866', 'lastCheck': '1.6', 'valid': True}} >Thread-137365::DEBUG::2014-10-29 11:28:01,096::task::595::Storage.TaskManager.Task::(_updateState) Task=`88945608-be35-4c22-aebb-a769251c3233`::moving from state preparing -> state finished >Thread-137365::DEBUG::2014-10-29 11:28:01,098::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137365::DEBUG::2014-10-29 11:28:01,099::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137365::DEBUG::2014-10-29 11:28:01,101::task::993::Storage.TaskManager.Task::(_decref) Task=`88945608-be35-4c22-aebb-a769251c3233`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:01,688::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:01,689::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:01,690::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:03,501::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:03,503::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137366::DEBUG::2014-10-29 11:28:03,506::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:03,508::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:03,510::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137367::DEBUG::2014-10-29 11:28:03,513::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137367::DEBUG::2014-10-29 11:28:03,515::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:28:04,738::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >Thread-22::DEBUG::2014-10-29 11:28:05,805::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:06,529::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:06,532::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137368::DEBUG::2014-10-29 11:28:06,536::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:06,539::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:06,541::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137369::DEBUG::2014-10-29 11:28:06,544::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137369::DEBUG::2014-10-29 11:28:06,546::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:06,697::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:06,698::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:06,699::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:28:07,677::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54833 >Detector thread::DEBUG::2014-10-29 11:28:07,678::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54833 >Detector thread::DEBUG::2014-10-29 11:28:07,678::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54833 >Detector thread::DEBUG::2014-10-29 11:28:07,679::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54833) >Thread-137370::DEBUG::2014-10-29 11:28:07,718::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137370::DEBUG::2014-10-29 11:28:07,719::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca4d7825-1b6f-469b-ab16-e18b1d44417e`::moving from state init -> state preparing >Thread-137370::INFO::2014-10-29 11:28:07,719::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137370::DEBUG::2014-10-29 11:28:07,723::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:28:07,724::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:07,724::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:07,724::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:07,724::__init__::232::IOProcess::(_processLogs) (202477) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:28:07,725::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202477) Queuing response >Thread-137370::DEBUG::2014-10-29 11:28:07,726::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137370::DEBUG::2014-10-29 11:28:07,727::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137370::INFO::2014-10-29 11:28:07,727::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137370::DEBUG::2014-10-29 11:28:07,727::task::1191::Storage.TaskManager.Task::(prepare) Task=`ca4d7825-1b6f-469b-ab16-e18b1d44417e`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137370::DEBUG::2014-10-29 11:28:07,727::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca4d7825-1b6f-469b-ab16-e18b1d44417e`::moving from state preparing -> state finished >Thread-137370::DEBUG::2014-10-29 11:28:07,728::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137370::DEBUG::2014-10-29 11:28:07,728::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137370::DEBUG::2014-10-29 11:28:07,728::task::993::Storage.TaskManager.Task::(_decref) Task=`ca4d7825-1b6f-469b-ab16-e18b1d44417e`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:28:07,775::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54834 >Detector thread::DEBUG::2014-10-29 11:28:07,776::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54834 >Detector thread::DEBUG::2014-10-29 11:28:07,776::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54834 >Detector thread::DEBUG::2014-10-29 11:28:07,777::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54834) >Thread-137371::DEBUG::2014-10-29 11:28:07,815::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137371::DEBUG::2014-10-29 11:28:07,815::task::595::Storage.TaskManager.Task::(_updateState) Task=`0df30b48-f6b2-4f3e-85db-f065a4361222`::moving from state init -> state preparing >Thread-137371::INFO::2014-10-29 11:28:07,816::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137371::DEBUG::2014-10-29 11:28:07,816::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137371::DEBUG::2014-10-29 11:28:07,816::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137371::DEBUG::2014-10-29 11:28:07,817::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137371::DEBUG::2014-10-29 11:28:07,817::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137371::DEBUG::2014-10-29 11:28:07,817::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137371::DEBUG::2014-10-29 11:28:07,818::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137371::DEBUG::2014-10-29 11:28:07,899::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137371::DEBUG::2014-10-29 11:28:07,900::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137371::DEBUG::2014-10-29 11:28:08,065::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137371::DEBUG::2014-10-29 11:28:08,066::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137371::DEBUG::2014-10-29 11:28:08,066::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137371::DEBUG::2014-10-29 11:28:08,067::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137371::DEBUG::2014-10-29 11:28:08,067::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137371::DEBUG::2014-10-29 11:28:08,067::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137371::DEBUG::2014-10-29 11:28:08,068::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137371::DEBUG::2014-10-29 11:28:08,068::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:28:08,076::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:08,080::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:08,080::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:08,080::__init__::232::IOProcess::(_processLogs) (202478) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:28:08,081::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202478) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:08,083::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:08,083::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:08,084::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:08,084::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:08,085::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:08,085::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:08,085::__init__::232::IOProcess::(_processLogs) (202479) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:28:08,086::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:08,087::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:08,089::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:08,091::__init__::232::IOProcess::(_processLogs) (202481) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:28:08,092::__init__::232::IOProcess::(_processLogs) (202480) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:28:08,094::__init__::232::IOProcess::(_processLogs) (202479) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:08,096::__init__::232::IOProcess::(_processLogs) (202481) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:08,098::__init__::232::IOProcess::(_processLogs) (202480) Queuing response >Thread-137371::DEBUG::2014-10-29 11:28:08,098::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:28:08,103::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:08,103::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:08,103::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:08,104::__init__::232::IOProcess::(_processLogs) (202482) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:28:08,104::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202482) Queuing response >Thread-137371::DEBUG::2014-10-29 11:28:08,105::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:28:08,106::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:08,106::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:08,106::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:08,107::__init__::232::IOProcess::(_processLogs) (202483) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:28:08,107::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202483) Queuing response >Thread-137371::DEBUG::2014-10-29 11:28:08,108::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:28:08,109::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:08,110::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:08,110::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:08,110::__init__::232::IOProcess::(_processLogs) (202484) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:08,111::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202484) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:08,112::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:08,112::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:08,112::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:08,113::__init__::232::IOProcess::(_processLogs) (202485) Got request for method 'glob' >Thread-137371::DEBUG::2014-10-29 11:28:08,113::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:28:08,113::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202485) Queuing response >Thread-137371::INFO::2014-10-29 11:28:08,115::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137371::INFO::2014-10-29 11:28:08,115::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137371::INFO::2014-10-29 11:28:08,116::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:28:08,117::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:08,117::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:08,117::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:08,117::__init__::232::IOProcess::(_processLogs) (202486) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:28:08,118::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202486) Queuing response >Thread-137371::DEBUG::2014-10-29 11:28:08,118::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137371::DEBUG::2014-10-29 11:28:08,121::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`feb43df2-623b-4824-9c2b-1226e8090bef`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137371::DEBUG::2014-10-29 11:28:08,121::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137371::DEBUG::2014-10-29 11:28:08,122::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137371::DEBUG::2014-10-29 11:28:08,122::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`feb43df2-623b-4824-9c2b-1226e8090bef`::Granted request >Thread-137371::DEBUG::2014-10-29 11:28:08,122::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0df30b48-f6b2-4f3e-85db-f065a4361222`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137371::DEBUG::2014-10-29 11:28:08,123::task::993::Storage.TaskManager.Task::(_decref) Task=`0df30b48-f6b2-4f3e-85db-f065a4361222`::ref 1 aborting False >Thread-137371::INFO::2014-10-29 11:28:08,125::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137371::DEBUG::2014-10-29 11:28:08,126::task::1191::Storage.TaskManager.Task::(prepare) Task=`0df30b48-f6b2-4f3e-85db-f065a4361222`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137371::DEBUG::2014-10-29 11:28:08,126::task::595::Storage.TaskManager.Task::(_updateState) Task=`0df30b48-f6b2-4f3e-85db-f065a4361222`::moving from state preparing -> state finished >Thread-137371::DEBUG::2014-10-29 11:28:08,126::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137371::DEBUG::2014-10-29 11:28:08,127::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137371::DEBUG::2014-10-29 11:28:08,127::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137371::DEBUG::2014-10-29 11:28:08,127::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137371::DEBUG::2014-10-29 11:28:08,128::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137371::DEBUG::2014-10-29 11:28:08,128::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137371::DEBUG::2014-10-29 11:28:08,128::task::993::Storage.TaskManager.Task::(_decref) Task=`0df30b48-f6b2-4f3e-85db-f065a4361222`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:28:08,150::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54835 >Detector thread::DEBUG::2014-10-29 11:28:08,151::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54835 >Detector thread::DEBUG::2014-10-29 11:28:08,151::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54835 >Detector thread::DEBUG::2014-10-29 11:28:08,152::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54835) >Thread-137376::DEBUG::2014-10-29 11:28:08,190::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137376::DEBUG::2014-10-29 11:28:08,190::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d167cd6-faac-4e53-8a2c-c276e95ee8d4`::moving from state init -> state preparing >Thread-137376::INFO::2014-10-29 11:28:08,191::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137376::INFO::2014-10-29 11:28:08,191::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506482', 'lastCheck': '8.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000450999', 'lastCheck': '8.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558793', 'lastCheck': '8.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000510866', 'lastCheck': '8.7', 'valid': True}} >Thread-137376::DEBUG::2014-10-29 11:28:08,192::task::1191::Storage.TaskManager.Task::(prepare) Task=`5d167cd6-faac-4e53-8a2c-c276e95ee8d4`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506482', 'lastCheck': '8.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000450999', 'lastCheck': '8.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558793', 'lastCheck': '8.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000510866', 'lastCheck': '8.7', 'valid': True}} >Thread-137376::DEBUG::2014-10-29 11:28:08,192::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d167cd6-faac-4e53-8a2c-c276e95ee8d4`::moving from state preparing -> state finished >Thread-137376::DEBUG::2014-10-29 11:28:08,192::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137376::DEBUG::2014-10-29 11:28:08,192::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137376::DEBUG::2014-10-29 11:28:08,193::task::993::Storage.TaskManager.Task::(_decref) Task=`5d167cd6-faac-4e53-8a2c-c276e95ee8d4`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:28:09,502::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:09,503::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:09,503::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:09,504::__init__::232::IOProcess::(_processLogs) (202487) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:09,505::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202487) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:09,509::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-179::DEBUG::2014-10-29 11:28:09,509::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:28:09,511::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-178::DEBUG::2014-10-29 11:28:09,531::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 9b5dff8d-f9a0-4e5c-8800-3a988fc12016 >Thread-17::DEBUG::2014-10-29 11:28:09,532::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-179::DEBUG::2014-10-29 11:28:09,534::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000457062 s, 814 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:28:09,538::__init__::232::IOProcess::(_processLogs) (202488) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:09,548::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202488) Queuing response >Thread-10269::DEBUG::2014-10-29 11:28:09,550::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:28:09,551::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:09,571::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:09,573::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-17::DEBUG::2014-10-29 11:28:09,574::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-10269::DEBUG::2014-10-29 11:28:09,576::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000451901 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:28:09,579::__init__::232::IOProcess::(_processLogs) (202489) Got request for method 'statvfs' >JsonRpcServer::DEBUG::2014-10-29 11:28:09,583::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:28:09,591::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202489) Queuing response >Thread-33::DEBUG::2014-10-29 11:28:09,594::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:28:09,609::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:09,615::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137381::DEBUG::2014-10-29 11:28:09,616::task::595::Storage.TaskManager.Task::(_updateState) Task=`69cfe5c6-ade8-435d-bd57-6b0e7108e92a`::moving from state init -> state preparing >Thread-33::DEBUG::2014-10-29 11:28:09,617::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00059111 s, 824 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:28:09,618::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-137381::INFO::2014-10-29 11:28:09,621::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-17::DEBUG::2014-10-29 11:28:09,623::__init__::232::IOProcess::(_processLogs) (202490) Got request for method 'statvfs' >Thread-137381::INFO::2014-10-29 11:28:09,625::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506482', 'lastCheck': '10.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000450999', 'lastCheck': '10.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558793', 'lastCheck': '10.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000510866', 'lastCheck': '10.1', 'valid': True}} >Thread-137381::DEBUG::2014-10-29 11:28:09,627::task::1191::Storage.TaskManager.Task::(prepare) Task=`69cfe5c6-ade8-435d-bd57-6b0e7108e92a`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506482', 'lastCheck': '10.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000450999', 'lastCheck': '10.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558793', 'lastCheck': '10.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000510866', 'lastCheck': '10.1', 'valid': True}} >Thread-137381::DEBUG::2014-10-29 11:28:09,629::task::595::Storage.TaskManager.Task::(_updateState) Task=`69cfe5c6-ade8-435d-bd57-6b0e7108e92a`::moving from state preparing -> state finished >Thread-17::DEBUG::2014-10-29 11:28:09,630::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202490) Queuing response >Thread-137381::DEBUG::2014-10-29 11:28:09,632::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17::DEBUG::2014-10-29 11:28:09,634::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-137381::DEBUG::2014-10-29 11:28:09,633::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137381::DEBUG::2014-10-29 11:28:09,636::task::993::Storage.TaskManager.Task::(_decref) Task=`69cfe5c6-ade8-435d-bd57-6b0e7108e92a`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:28:09,641::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:09,645::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:09,648::__init__::232::IOProcess::(_processLogs) (202491) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:28:09,651::__init__::232::IOProcess::(_processLogs) (202491) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:09,654::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:09,658::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:09,660::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:09,662::__init__::232::IOProcess::(_processLogs) (202492) Got request for method 'glob' >Thread-178::DEBUG::2014-10-29 11:28:09,665::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016 >Thread-17::DEBUG::2014-10-29 11:28:09,668::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202492) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:09,672::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:09,673::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:09,675::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:09,675::__init__::232::IOProcess::(_processLogs) (202493) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:28:09,677::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202493) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:09,679::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:09,680::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:09,681::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:09,681::__init__::232::IOProcess::(_processLogs) (202494) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:28:09,683::__init__::232::IOProcess::(_processLogs) (202494) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:09,688::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:09,694::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:09,697::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:09,698::__init__::232::IOProcess::(_processLogs) (202495) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:09,699::__init__::232::IOProcess::(_processLogs) (202495) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:09,701::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:09,702::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:09,708::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:09,710::__init__::232::IOProcess::(_processLogs) (202496) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:09,711::__init__::232::IOProcess::(_processLogs) (202496) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:09,714::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:09,715::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:09,717::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:09,718::__init__::232::IOProcess::(_processLogs) (202497) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:28:09,722::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202497) Queuing response >Thread-178::DEBUG::2014-10-29 11:28:09,723::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:28:09,726::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:09,728::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:09,730::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-137381::DEBUG::2014-10-29 11:28:09,731::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:28:09,732::__init__::232::IOProcess::(_processLogs) (202498) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:09,736::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202498) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:09,737::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:09,737::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:09,738::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:09,738::__init__::232::IOProcess::(_processLogs) (202499) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:28:09,739::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202499) Queuing response >Thread-178::DEBUG::2014-10-29 11:28:09,740::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nsednev_ovirt_3_5_HE_for_disks', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=Default', 'POOL_DOMAINS=9b5dff8d-f9a0-4e5c-8800-3a988fc12016:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=00000002-0002-0002-0002-000000000321', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_ovirt_3_5_HE_for_disks', 'ROLE=Master', 'SDUUID=9b5dff8d-f9a0-4e5c-8800-3a988fc12016', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=08256ef27d308c4f5bfe4a0974fd548f7d749489'] >Thread-17::DEBUG::2014-10-29 11:28:09,741::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:09,743::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:09,746::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:09,747::__init__::232::IOProcess::(_processLogs) (202500) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:09,747::__init__::232::IOProcess::(_processLogs) (202500) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:09,748::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:09,749::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:09,750::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:09,750::__init__::232::IOProcess::(_processLogs) (202501) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:09,750::__init__::232::IOProcess::(_processLogs) (202501) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:09,751::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:09,752::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:09,752::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:09,753::__init__::232::IOProcess::(_processLogs) (202502) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:09,754::__init__::232::IOProcess::(_processLogs) (202502) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:09,754::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:09,755::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:09,755::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:09,755::__init__::232::IOProcess::(_processLogs) (202503) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:28:09,756::__init__::232::IOProcess::(_processLogs) (202503) Queuing response >Thread-178::DEBUG::2014-10-29 11:28:09,756::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-178::INFO::2014-10-29 11:28:09,757::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9b5dff8d-f9a0-4e5c-8800-3a988fc12016_imageNS already registered >Thread-178::INFO::2014-10-29 11:28:09,757::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9b5dff8d-f9a0-4e5c-8800-3a988fc12016_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:28:09,758::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:09,758::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:09,759::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:09,762::__init__::232::IOProcess::(_processLogs) (202504) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:28:09,763::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:09,763::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-17::DEBUG::2014-10-29 11:28:09,765::__init__::232::IOProcess::(_processLogs) (202504) Queuing response >Thread-178::DEBUG::2014-10-29 11:28:09,791::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000505211 s, 1.0 MB/s\n'; <rc> = 0 >JsonRpcServer::DEBUG::2014-10-29 11:28:09,792::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:28:09,799::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:09,800::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:09,803::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-137382::DEBUG::2014-10-29 11:28:09,805::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:28:09,805::__init__::232::IOProcess::(_processLogs) (202505) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:09,807::__init__::232::IOProcess::(_processLogs) (202505) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:09,817::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:09,819::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:09,820::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:09,821::__init__::232::IOProcess::(_processLogs) (202506) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:09,823::__init__::232::IOProcess::(_processLogs) (202506) Queuing response >Thread-137382::DEBUG::2014-10-29 11:28:09,827::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:28:09,829::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:09,831::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:09,833::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:09,833::__init__::232::IOProcess::(_processLogs) (202507) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:09,834::__init__::232::IOProcess::(_processLogs) (202507) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:09,834::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:09,835::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:09,836::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:09,837::__init__::232::IOProcess::(_processLogs) (202508) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:09,837::__init__::232::IOProcess::(_processLogs) (202508) Queuing response >Detector thread::DEBUG::2014-10-29 11:28:10,973::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54836 >Detector thread::DEBUG::2014-10-29 11:28:10,973::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54836 >Detector thread::DEBUG::2014-10-29 11:28:10,976::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54836 >Detector thread::DEBUG::2014-10-29 11:28:10,977::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54836) >Thread-137383::DEBUG::2014-10-29 11:28:11,013::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137383::DEBUG::2014-10-29 11:28:11,014::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137383::DEBUG::2014-10-29 11:28:11,014::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.41', 'elapsedTime': '514723', 'displayType': 'vnc', 'cpuSys': '0.66', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '6666671', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '86562', 'readRate': '0.00', 'truesize': '6010904576', 'writeRate': '37985.86'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.21', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:28:11,164::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54838 >Detector thread::DEBUG::2014-10-29 11:28:11,166::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54838 >Detector thread::DEBUG::2014-10-29 11:28:11,166::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54838 >Detector thread::DEBUG::2014-10-29 11:28:11,167::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54838) >Detector thread::DEBUG::2014-10-29 11:28:11,182::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54839 >Detector thread::DEBUG::2014-10-29 11:28:11,192::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54839 >Detector thread::DEBUG::2014-10-29 11:28:11,194::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54839 >Detector thread::DEBUG::2014-10-29 11:28:11,196::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54839) >Thread-137384::DEBUG::2014-10-29 11:28:11,206::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137384::DEBUG::2014-10-29 11:28:11,209::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137384::DEBUG::2014-10-29 11:28:11,230::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137385::DEBUG::2014-10-29 11:28:11,234::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc15fea5-a424-494c-8640-c6127ee29b91`::moving from state init -> state preparing >Thread-137385::INFO::2014-10-29 11:28:11,237::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137385::INFO::2014-10-29 11:28:11,242::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505211', 'lastCheck': '1.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00059111', 'lastCheck': '1.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457062', 'lastCheck': '1.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000451901', 'lastCheck': '1.5', 'valid': True}} >Thread-137385::DEBUG::2014-10-29 11:28:11,245::task::1191::Storage.TaskManager.Task::(prepare) Task=`dc15fea5-a424-494c-8640-c6127ee29b91`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505211', 'lastCheck': '1.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00059111', 'lastCheck': '1.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457062', 'lastCheck': '1.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000451901', 'lastCheck': '1.5', 'valid': True}} >Thread-137385::DEBUG::2014-10-29 11:28:11,246::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc15fea5-a424-494c-8640-c6127ee29b91`::moving from state preparing -> state finished >Thread-137385::DEBUG::2014-10-29 11:28:11,248::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137385::DEBUG::2014-10-29 11:28:11,250::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137385::DEBUG::2014-10-29 11:28:11,252::task::993::Storage.TaskManager.Task::(_decref) Task=`dc15fea5-a424-494c-8640-c6127ee29b91`::ref 0 aborting False >Thread-137384::DEBUG::2014-10-29 11:28:11,347::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '10', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '10', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:11,705::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:11,706::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:11,707::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:12,871::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:12,874::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137386::DEBUG::2014-10-29 11:28:12,877::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:12,879::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:12,881::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137387::DEBUG::2014-10-29 11:28:12,884::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137387::DEBUG::2014-10-29 11:28:12,887::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:15,904::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:15,907::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137388::DEBUG::2014-10-29 11:28:15,910::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:15,912::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:15,914::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137389::DEBUG::2014-10-29 11:28:15,916::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137389::DEBUG::2014-10-29 11:28:15,919::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:16,716::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:16,721::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:16,726::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:28:18,755::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54841 >Detector thread::DEBUG::2014-10-29 11:28:18,756::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54841 >Detector thread::DEBUG::2014-10-29 11:28:18,756::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54841 >Detector thread::DEBUG::2014-10-29 11:28:18,757::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54841) >Thread-137390::DEBUG::2014-10-29 11:28:18,796::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137390::DEBUG::2014-10-29 11:28:18,797::task::595::Storage.TaskManager.Task::(_updateState) Task=`f14f8065-ab65-4f04-bfd3-4a6fca4b0123`::moving from state init -> state preparing >Thread-137390::INFO::2014-10-29 11:28:18,797::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137390::DEBUG::2014-10-29 11:28:18,802::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:28:18,806::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:18,806::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:18,806::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:18,807::__init__::232::IOProcess::(_processLogs) (202509) Got request for method 'glob' >Thread-137390::DEBUG::2014-10-29 11:28:18,808::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:28:18,808::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202509) Queuing response >Thread-137390::DEBUG::2014-10-29 11:28:18,810::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137390::INFO::2014-10-29 11:28:18,810::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137390::DEBUG::2014-10-29 11:28:18,811::task::1191::Storage.TaskManager.Task::(prepare) Task=`f14f8065-ab65-4f04-bfd3-4a6fca4b0123`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137390::DEBUG::2014-10-29 11:28:18,811::task::595::Storage.TaskManager.Task::(_updateState) Task=`f14f8065-ab65-4f04-bfd3-4a6fca4b0123`::moving from state preparing -> state finished >Thread-137390::DEBUG::2014-10-29 11:28:18,811::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137390::DEBUG::2014-10-29 11:28:18,811::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137390::DEBUG::2014-10-29 11:28:18,812::task::993::Storage.TaskManager.Task::(_decref) Task=`f14f8065-ab65-4f04-bfd3-4a6fca4b0123`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:28:18,856::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54842 >Detector thread::DEBUG::2014-10-29 11:28:18,856::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54842 >Detector thread::DEBUG::2014-10-29 11:28:18,856::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54842 >Detector thread::DEBUG::2014-10-29 11:28:18,857::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54842) >Thread-137391::DEBUG::2014-10-29 11:28:18,896::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137391::DEBUG::2014-10-29 11:28:18,897::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc256992-b67d-4eb8-a376-4dbabb63e50c`::moving from state init -> state preparing >Thread-137391::INFO::2014-10-29 11:28:18,897::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137391::DEBUG::2014-10-29 11:28:18,898::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137391::DEBUG::2014-10-29 11:28:18,898::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137391::DEBUG::2014-10-29 11:28:18,898::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137391::DEBUG::2014-10-29 11:28:18,898::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137391::DEBUG::2014-10-29 11:28:18,899::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137391::DEBUG::2014-10-29 11:28:18,899::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:18,933::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:18,936::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137392::DEBUG::2014-10-29 11:28:18,942::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:18,945::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:18,946::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137393::DEBUG::2014-10-29 11:28:18,950::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137393::DEBUG::2014-10-29 11:28:18,952::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-137391::DEBUG::2014-10-29 11:28:18,983::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137391::DEBUG::2014-10-29 11:28:18,983::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137391::DEBUG::2014-10-29 11:28:19,147::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137391::DEBUG::2014-10-29 11:28:19,148::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137391::DEBUG::2014-10-29 11:28:19,149::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137391::DEBUG::2014-10-29 11:28:19,149::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137391::DEBUG::2014-10-29 11:28:19,149::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137391::DEBUG::2014-10-29 11:28:19,150::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137391::DEBUG::2014-10-29 11:28:19,150::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137391::DEBUG::2014-10-29 11:28:19,151::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:28:19,158::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:19,160::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:19,160::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:19,161::__init__::232::IOProcess::(_processLogs) (202510) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:28:19,162::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202510) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:19,163::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:19,163::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:19,164::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:19,164::__init__::232::IOProcess::(_processLogs) (202511) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:28:19,164::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202511) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:19,165::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:19,166::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:19,167::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:19,167::__init__::232::IOProcess::(_processLogs) (202512) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:28:19,167::__init__::232::IOProcess::(_processLogs) (202512) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:19,172::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:19,174::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:19,174::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:19,174::__init__::232::IOProcess::(_processLogs) (202513) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:28:19,177::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202513) Queuing response >Thread-137391::DEBUG::2014-10-29 11:28:19,179::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:28:19,180::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:19,181::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:19,181::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:19,181::__init__::232::IOProcess::(_processLogs) (202514) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:28:19,182::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202514) Queuing response >Thread-137391::DEBUG::2014-10-29 11:28:19,183::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:28:19,183::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:19,184::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:19,184::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:19,184::__init__::232::IOProcess::(_processLogs) (202515) Got request for method 'readfile' >Thread-137391::DEBUG::2014-10-29 11:28:19,186::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:28:19,185::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202515) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:19,188::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:19,189::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:19,189::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:19,190::__init__::232::IOProcess::(_processLogs) (202516) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:19,190::__init__::232::IOProcess::(_processLogs) (202516) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:19,190::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:19,191::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-137391::DEBUG::2014-10-29 11:28:19,191::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:28:19,193::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-137391::INFO::2014-10-29 11:28:19,193::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137391::INFO::2014-10-29 11:28:19,194::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:28:19,194::__init__::232::IOProcess::(_processLogs) (202517) Got request for method 'glob' >Thread-137391::INFO::2014-10-29 11:28:19,196::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:28:19,196::__init__::232::IOProcess::(_processLogs) (202517) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:19,198::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:19,198::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:19,198::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:19,198::__init__::232::IOProcess::(_processLogs) (202518) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:28:19,199::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202518) Queuing response >Thread-137391::DEBUG::2014-10-29 11:28:19,200::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137391::DEBUG::2014-10-29 11:28:19,202::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`5c0e7729-e897-4e11-b52d-a180fb1f583c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137391::DEBUG::2014-10-29 11:28:19,202::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137391::DEBUG::2014-10-29 11:28:19,203::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137391::DEBUG::2014-10-29 11:28:19,203::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`5c0e7729-e897-4e11-b52d-a180fb1f583c`::Granted request >Thread-137391::DEBUG::2014-10-29 11:28:19,204::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`cc256992-b67d-4eb8-a376-4dbabb63e50c`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137391::DEBUG::2014-10-29 11:28:19,204::task::993::Storage.TaskManager.Task::(_decref) Task=`cc256992-b67d-4eb8-a376-4dbabb63e50c`::ref 1 aborting False >Thread-137391::INFO::2014-10-29 11:28:19,206::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137391::DEBUG::2014-10-29 11:28:19,207::task::1191::Storage.TaskManager.Task::(prepare) Task=`cc256992-b67d-4eb8-a376-4dbabb63e50c`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137391::DEBUG::2014-10-29 11:28:19,207::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc256992-b67d-4eb8-a376-4dbabb63e50c`::moving from state preparing -> state finished >Thread-137391::DEBUG::2014-10-29 11:28:19,207::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137391::DEBUG::2014-10-29 11:28:19,208::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137391::DEBUG::2014-10-29 11:28:19,208::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137391::DEBUG::2014-10-29 11:28:19,208::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137391::DEBUG::2014-10-29 11:28:19,209::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137391::DEBUG::2014-10-29 11:28:19,209::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137391::DEBUG::2014-10-29 11:28:19,209::task::993::Storage.TaskManager.Task::(_decref) Task=`cc256992-b67d-4eb8-a376-4dbabb63e50c`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:28:19,231::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54843 >Detector thread::DEBUG::2014-10-29 11:28:19,232::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54843 >Detector thread::DEBUG::2014-10-29 11:28:19,232::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54843 >Detector thread::DEBUG::2014-10-29 11:28:19,233::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54843) >Thread-137398::DEBUG::2014-10-29 11:28:19,271::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137398::DEBUG::2014-10-29 11:28:19,271::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa0a3900-1e01-4329-aa3a-fd91ce4dfb66`::moving from state init -> state preparing >Thread-137398::INFO::2014-10-29 11:28:19,272::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137398::INFO::2014-10-29 11:28:19,272::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505211', 'lastCheck': '9.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00059111', 'lastCheck': '9.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457062', 'lastCheck': '9.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000451901', 'lastCheck': '9.6', 'valid': True}} >Thread-137398::DEBUG::2014-10-29 11:28:19,273::task::1191::Storage.TaskManager.Task::(prepare) Task=`aa0a3900-1e01-4329-aa3a-fd91ce4dfb66`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505211', 'lastCheck': '9.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00059111', 'lastCheck': '9.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000457062', 'lastCheck': '9.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000451901', 'lastCheck': '9.6', 'valid': True}} >Thread-137398::DEBUG::2014-10-29 11:28:19,273::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa0a3900-1e01-4329-aa3a-fd91ce4dfb66`::moving from state preparing -> state finished >Thread-137398::DEBUG::2014-10-29 11:28:19,273::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137398::DEBUG::2014-10-29 11:28:19,273::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137398::DEBUG::2014-10-29 11:28:19,274::task::993::Storage.TaskManager.Task::(_decref) Task=`aa0a3900-1e01-4329-aa3a-fd91ce4dfb66`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:28:19,636::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:19,637::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:19,638::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:19,638::__init__::232::IOProcess::(_processLogs) (202519) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:19,639::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202519) Queuing response >Thread-179::DEBUG::2014-10-29 11:28:19,641::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:28:19,660::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000514633 s, 723 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:28:19,662::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:19,664::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:19,665::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:19,666::__init__::232::IOProcess::(_processLogs) (202520) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:19,666::__init__::232::IOProcess::(_processLogs) (202520) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:19,698::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:19,698::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:19,700::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:19,701::__init__::232::IOProcess::(_processLogs) (202521) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:19,701::__init__::232::IOProcess::(_processLogs) (202521) Queuing response >Thread-10269::DEBUG::2014-10-29 11:28:19,701::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:28:19,721::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000533288 s, 941 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:28:19,723::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:19,723::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:19,723::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:19,724::__init__::232::IOProcess::(_processLogs) (202522) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:19,724::__init__::232::IOProcess::(_processLogs) (202522) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:19,754::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:19,756::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:19,758::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-33::DEBUG::2014-10-29 11:28:19,758::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:28:19,759::__init__::232::IOProcess::(_processLogs) (202523) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:19,776::__init__::232::IOProcess::(_processLogs) (202523) Queuing response >Thread-33::DEBUG::2014-10-29 11:28:19,779::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000479323 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:28:19,780::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:19,781::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:19,781::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:19,781::__init__::232::IOProcess::(_processLogs) (202524) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:19,781::__init__::232::IOProcess::(_processLogs) (202524) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:19,784::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:19,784::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:19,784::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:19,784::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202525) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:19,785::__init__::232::IOProcess::(_processLogs) (202525) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:19,786::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:19,786::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:19,786::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:19,787::__init__::232::IOProcess::(_processLogs) (202526) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:19,787::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202526) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:19,788::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:19,789::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:19,789::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:19,789::__init__::232::IOProcess::(_processLogs) (202527) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:19,790::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202527) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:19,838::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:19,838::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:19,839::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-178::DEBUG::2014-10-29 11:28:19,841::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:28:19,841::__init__::232::IOProcess::(_processLogs) (202528) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:19,861::__init__::232::IOProcess::(_processLogs) (202528) Queuing response >Thread-178::DEBUG::2014-10-29 11:28:19,866::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00382071 s, 133 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:28:19,867::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:19,868::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:19,868::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:19,868::__init__::232::IOProcess::(_processLogs) (202529) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:19,869::__init__::232::IOProcess::(_processLogs) (202529) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:19,871::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:19,871::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:19,871::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:19,871::__init__::232::IOProcess::(_processLogs) (202530) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:19,872::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202530) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:19,873::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:19,874::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:19,874::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:19,874::__init__::232::IOProcess::(_processLogs) (202531) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:19,875::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202531) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:19,876::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:19,876::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:19,876::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:19,877::__init__::232::IOProcess::(_processLogs) (202532) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:19,878::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202532) Queuing response >Detector thread::DEBUG::2014-10-29 11:28:20,423::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54844 >Detector thread::DEBUG::2014-10-29 11:28:20,436::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54845 >Detector thread::DEBUG::2014-10-29 11:28:20,437::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54844 >Detector thread::DEBUG::2014-10-29 11:28:20,437::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54844 >Detector thread::DEBUG::2014-10-29 11:28:20,438::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54844) >Detector thread::DEBUG::2014-10-29 11:28:20,442::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54845 >Detector thread::DEBUG::2014-10-29 11:28:20,443::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54845 >Detector thread::DEBUG::2014-10-29 11:28:20,443::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54845) >Thread-137399::DEBUG::2014-10-29 11:28:20,465::task::595::Storage.TaskManager.Task::(_updateState) Task=`f38fbd20-5efc-475e-bffb-19e82968d22d`::moving from state init -> state preparing >Thread-137399::INFO::2014-10-29 11:28:20,466::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137399::INFO::2014-10-29 11:28:20,466::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00382071', 'lastCheck': '0.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479323', 'lastCheck': '0.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000514633', 'lastCheck': '0.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000533288', 'lastCheck': '0.7', 'valid': True}} >Thread-137399::DEBUG::2014-10-29 11:28:20,467::task::1191::Storage.TaskManager.Task::(prepare) Task=`f38fbd20-5efc-475e-bffb-19e82968d22d`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00382071', 'lastCheck': '0.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479323', 'lastCheck': '0.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000514633', 'lastCheck': '0.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000533288', 'lastCheck': '0.7', 'valid': True}} >Thread-137399::DEBUG::2014-10-29 11:28:20,467::task::595::Storage.TaskManager.Task::(_updateState) Task=`f38fbd20-5efc-475e-bffb-19e82968d22d`::moving from state preparing -> state finished >Thread-137399::DEBUG::2014-10-29 11:28:20,468::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137399::DEBUG::2014-10-29 11:28:20,468::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137399::DEBUG::2014-10-29 11:28:20,468::task::993::Storage.TaskManager.Task::(_decref) Task=`f38fbd20-5efc-475e-bffb-19e82968d22d`::ref 0 aborting False >Thread-137400::DEBUG::2014-10-29 11:28:20,478::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137400::DEBUG::2014-10-29 11:28:20,481::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137400::DEBUG::2014-10-29 11:28:20,504::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137400::DEBUG::2014-10-29 11:28:20,590::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '84', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '84', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-22::DEBUG::2014-10-29 11:28:20,842::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Detector thread::DEBUG::2014-10-29 11:28:21,175::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54846 >Detector thread::DEBUG::2014-10-29 11:28:21,176::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54846 >Detector thread::DEBUG::2014-10-29 11:28:21,176::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54846 >Detector thread::DEBUG::2014-10-29 11:28:21,177::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54846) >Thread-137401::DEBUG::2014-10-29 11:28:21,215::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137401::DEBUG::2014-10-29 11:28:21,216::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137401::DEBUG::2014-10-29 11:28:21,217::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '7.10', 'elapsedTime': '514733', 'displayType': 'vnc', 'cpuSys': '1.06', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '6666671', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '86562', 'readRate': '0.00', 'truesize': '6010904576', 'writeRate': '37985.86'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.41', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:21,736::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:21,737::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:21,741::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:21,978::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:21,981::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137402::DEBUG::2014-10-29 11:28:21,985::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:21,987::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:21,989::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137403::DEBUG::2014-10-29 11:28:21,992::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137403::DEBUG::2014-10-29 11:28:21,995::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:25,007::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:25,009::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137404::DEBUG::2014-10-29 11:28:25,013::task::595::Storage.TaskManager.Task::(_updateState) Task=`320abaf0-34e2-4e51-9eff-e6bd0672a1b4`::moving from state init -> state preparing >Thread-137404::INFO::2014-10-29 11:28:25,013::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137404::INFO::2014-10-29 11:28:25,014::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00382071', 'lastCheck': '5.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479323', 'lastCheck': '5.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000514633', 'lastCheck': '5.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000533288', 'lastCheck': '5.3', 'valid': True}} >Thread-137404::DEBUG::2014-10-29 11:28:25,014::task::1191::Storage.TaskManager.Task::(prepare) Task=`320abaf0-34e2-4e51-9eff-e6bd0672a1b4`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00382071', 'lastCheck': '5.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000479323', 'lastCheck': '5.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000514633', 'lastCheck': '5.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000533288', 'lastCheck': '5.3', 'valid': True}} >Thread-137404::DEBUG::2014-10-29 11:28:25,015::task::595::Storage.TaskManager.Task::(_updateState) Task=`320abaf0-34e2-4e51-9eff-e6bd0672a1b4`::moving from state preparing -> state finished >Thread-137404::DEBUG::2014-10-29 11:28:25,015::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137404::DEBUG::2014-10-29 11:28:25,015::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137404::DEBUG::2014-10-29 11:28:25,015::task::993::Storage.TaskManager.Task::(_decref) Task=`320abaf0-34e2-4e51-9eff-e6bd0672a1b4`::ref 0 aborting False >Thread-137404::DEBUG::2014-10-29 11:28:25,038::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:25,060::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:25,062::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137405::DEBUG::2014-10-29 11:28:25,065::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137405::DEBUG::2014-10-29 11:28:25,068::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:26,746::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:26,752::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:26,758::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:28,110::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:28,113::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137406::DEBUG::2014-10-29 11:28:28,116::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:28,119::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:28,120::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137407::DEBUG::2014-10-29 11:28:28,123::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137407::DEBUG::2014-10-29 11:28:28,126::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:28:29,668::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:29,669::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:29,670::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:29,670::__init__::232::IOProcess::(_processLogs) (202533) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:29,671::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202533) Queuing response >Thread-179::DEBUG::2014-10-29 11:28:29,673::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:28:29,693::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000554865 s, 670 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:28:29,694::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:29,695::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:29,695::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:29,695::__init__::232::IOProcess::(_processLogs) (202534) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:29,697::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202534) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:29,727::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:29,727::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:29,728::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:29,728::__init__::232::IOProcess::(_processLogs) (202535) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:29,730::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202535) Queuing response >Thread-10269::DEBUG::2014-10-29 11:28:29,731::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:28:29,749::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000576016 s, 872 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:28:29,751::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:29,752::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:29,753::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:29,753::__init__::232::IOProcess::(_processLogs) (202536) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:29,754::__init__::232::IOProcess::(_processLogs) (202536) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:29,792::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:29,793::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:29,794::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:29,794::__init__::232::IOProcess::(_processLogs) (202537) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:29,794::__init__::232::IOProcess::(_processLogs) (202537) Queuing response >Thread-33::DEBUG::2014-10-29 11:28:29,795::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:28:29,814::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000533811 s, 912 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:28:29,816::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:29,816::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:29,817::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:29,817::__init__::232::IOProcess::(_processLogs) (202538) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:29,819::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202538) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:29,821::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:29,822::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:29,823::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:29,823::__init__::232::IOProcess::(_processLogs) (202539) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:29,823::__init__::232::IOProcess::(_processLogs) (202539) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:29,824::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:29,825::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Detector thread::DEBUG::2014-10-29 11:28:29,825::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54849 >Thread-17::DEBUG::2014-10-29 11:28:29,827::__init__::232::IOProcess::(_processLogs) Extracting request information... >Detector thread::DEBUG::2014-10-29 11:28:29,828::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54849 >Thread-17::DEBUG::2014-10-29 11:28:29,828::__init__::232::IOProcess::(_processLogs) (202540) Got request for method 'access' >Detector thread::DEBUG::2014-10-29 11:28:29,829::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54849 >Thread-17::DEBUG::2014-10-29 11:28:29,830::__init__::232::IOProcess::(_processLogs) (202540) Queuing response >Detector thread::DEBUG::2014-10-29 11:28:29,831::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54849) >Thread-17::DEBUG::2014-10-29 11:28:29,835::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:29,837::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:29,837::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:29,838::__init__::232::IOProcess::(_processLogs) (202541) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:29,838::__init__::232::IOProcess::(_processLogs) (202541) Queuing response >Thread-137408::DEBUG::2014-10-29 11:28:29,866::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137408::DEBUG::2014-10-29 11:28:29,867::task::595::Storage.TaskManager.Task::(_updateState) Task=`21869d98-5d74-4cff-9907-0c631c4d1c8b`::moving from state init -> state preparing >Thread-137408::INFO::2014-10-29 11:28:29,867::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137408::DEBUG::2014-10-29 11:28:29,871::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:28:29,872::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:29,872::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:29,872::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:29,872::__init__::232::IOProcess::(_processLogs) (202542) Got request for method 'glob' >Thread-137408::DEBUG::2014-10-29 11:28:29,873::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:28:29,873::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202542) Queuing response >Thread-137408::DEBUG::2014-10-29 11:28:29,875::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137408::INFO::2014-10-29 11:28:29,876::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137408::DEBUG::2014-10-29 11:28:29,876::task::1191::Storage.TaskManager.Task::(prepare) Task=`21869d98-5d74-4cff-9907-0c631c4d1c8b`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137408::DEBUG::2014-10-29 11:28:29,876::task::595::Storage.TaskManager.Task::(_updateState) Task=`21869d98-5d74-4cff-9907-0c631c4d1c8b`::moving from state preparing -> state finished >Thread-137408::DEBUG::2014-10-29 11:28:29,876::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137408::DEBUG::2014-10-29 11:28:29,877::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137408::DEBUG::2014-10-29 11:28:29,877::task::993::Storage.TaskManager.Task::(_decref) Task=`21869d98-5d74-4cff-9907-0c631c4d1c8b`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:28:29,879::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:29,880::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:29,881::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-178::DEBUG::2014-10-29 11:28:29,882::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:28:29,883::__init__::232::IOProcess::(_processLogs) (202543) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:29,903::__init__::232::IOProcess::(_processLogs) (202543) Queuing response >Thread-178::DEBUG::2014-10-29 11:28:29,906::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00152909 s, 332 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:28:29,908::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:29,908::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:29,908::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:29,908::__init__::232::IOProcess::(_processLogs) (202544) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:29,910::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202544) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:29,913::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:29,913::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:29,914::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:29,915::__init__::232::IOProcess::(_processLogs) (202545) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:29,915::__init__::232::IOProcess::(_processLogs) (202545) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:29,916::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:29,917::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:29,917::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:29,918::__init__::232::IOProcess::(_processLogs) (202546) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:29,918::__init__::232::IOProcess::(_processLogs) (202546) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:29,918::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:29,919::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:29,920::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:29,921::__init__::232::IOProcess::(_processLogs) (202547) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:29,922::__init__::232::IOProcess::(_processLogs) (202547) Queuing response >Detector thread::DEBUG::2014-10-29 11:28:29,925::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54850 >Detector thread::DEBUG::2014-10-29 11:28:29,926::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54850 >Detector thread::DEBUG::2014-10-29 11:28:29,926::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54850 >Detector thread::DEBUG::2014-10-29 11:28:29,927::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54850) >Thread-137409::DEBUG::2014-10-29 11:28:29,966::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137409::DEBUG::2014-10-29 11:28:29,967::task::595::Storage.TaskManager.Task::(_updateState) Task=`33aa0444-de36-4c26-a185-0e9c91df3c7a`::moving from state init -> state preparing >Thread-137409::INFO::2014-10-29 11:28:29,967::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137409::DEBUG::2014-10-29 11:28:29,968::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137409::DEBUG::2014-10-29 11:28:29,968::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137409::DEBUG::2014-10-29 11:28:29,968::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137409::DEBUG::2014-10-29 11:28:29,968::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137409::DEBUG::2014-10-29 11:28:29,969::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137409::DEBUG::2014-10-29 11:28:29,969::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137409::DEBUG::2014-10-29 11:28:30,049::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137409::DEBUG::2014-10-29 11:28:30,050::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137409::DEBUG::2014-10-29 11:28:30,206::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137409::DEBUG::2014-10-29 11:28:30,207::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137409::DEBUG::2014-10-29 11:28:30,207::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137409::DEBUG::2014-10-29 11:28:30,208::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137409::DEBUG::2014-10-29 11:28:30,208::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137409::DEBUG::2014-10-29 11:28:30,209::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137409::DEBUG::2014-10-29 11:28:30,209::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137409::DEBUG::2014-10-29 11:28:30,209::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:28:30,216::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:30,218::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:30,218::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:30,219::__init__::232::IOProcess::(_processLogs) (202548) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:28:30,220::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202548) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:30,221::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:30,221::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:30,222::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:30,222::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:30,222::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:30,223::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:30,223::__init__::232::IOProcess::(_processLogs) (202549) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:28:30,224::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:30,226::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:30,227::__init__::232::IOProcess::(_processLogs) (202550) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:28:30,229::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:30,231::__init__::232::IOProcess::(_processLogs) (202551) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:28:30,233::__init__::232::IOProcess::(_processLogs) (202549) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:30,235::__init__::232::IOProcess::(_processLogs) (202550) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:30,237::__init__::232::IOProcess::(_processLogs) (202551) Queuing response >Thread-137409::DEBUG::2014-10-29 11:28:30,237::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:28:30,242::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:30,242::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:30,242::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:30,242::__init__::232::IOProcess::(_processLogs) (202552) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:28:30,244::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202552) Queuing response >Thread-137409::DEBUG::2014-10-29 11:28:30,244::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:28:30,246::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:30,246::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:30,247::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:30,247::__init__::232::IOProcess::(_processLogs) (202553) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:28:30,248::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202553) Queuing response >Thread-137409::DEBUG::2014-10-29 11:28:30,248::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:28:30,250::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:30,250::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:30,251::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:30,252::__init__::232::IOProcess::(_processLogs) (202554) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:30,252::__init__::232::IOProcess::(_processLogs) (202554) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:30,252::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:30,253::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:30,254::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-137409::DEBUG::2014-10-29 11:28:30,254::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-137409::INFO::2014-10-29 11:28:30,255::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:28:30,255::__init__::232::IOProcess::(_processLogs) (202555) Got request for method 'glob' >Thread-137409::INFO::2014-10-29 11:28:30,256::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:28:30,257::__init__::232::IOProcess::(_processLogs) (202555) Queuing response >Thread-137409::INFO::2014-10-29 11:28:30,258::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:28:30,259::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:30,259::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:30,259::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:30,259::__init__::232::IOProcess::(_processLogs) (202556) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:28:30,260::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202556) Queuing response >Thread-137409::DEBUG::2014-10-29 11:28:30,261::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137409::DEBUG::2014-10-29 11:28:30,263::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`da5f8d10-5575-422c-b167-be97e8cb71cd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137409::DEBUG::2014-10-29 11:28:30,263::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137409::DEBUG::2014-10-29 11:28:30,264::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137409::DEBUG::2014-10-29 11:28:30,264::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`da5f8d10-5575-422c-b167-be97e8cb71cd`::Granted request >Thread-137409::DEBUG::2014-10-29 11:28:30,265::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`33aa0444-de36-4c26-a185-0e9c91df3c7a`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137409::DEBUG::2014-10-29 11:28:30,265::task::993::Storage.TaskManager.Task::(_decref) Task=`33aa0444-de36-4c26-a185-0e9c91df3c7a`::ref 1 aborting False >Thread-137409::INFO::2014-10-29 11:28:30,267::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137409::DEBUG::2014-10-29 11:28:30,268::task::1191::Storage.TaskManager.Task::(prepare) Task=`33aa0444-de36-4c26-a185-0e9c91df3c7a`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137409::DEBUG::2014-10-29 11:28:30,268::task::595::Storage.TaskManager.Task::(_updateState) Task=`33aa0444-de36-4c26-a185-0e9c91df3c7a`::moving from state preparing -> state finished >Thread-137409::DEBUG::2014-10-29 11:28:30,268::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137409::DEBUG::2014-10-29 11:28:30,269::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137409::DEBUG::2014-10-29 11:28:30,269::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137409::DEBUG::2014-10-29 11:28:30,269::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137409::DEBUG::2014-10-29 11:28:30,269::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137409::DEBUG::2014-10-29 11:28:30,270::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137409::DEBUG::2014-10-29 11:28:30,270::task::993::Storage.TaskManager.Task::(_decref) Task=`33aa0444-de36-4c26-a185-0e9c91df3c7a`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:28:30,294::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54851 >Detector thread::DEBUG::2014-10-29 11:28:30,295::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54851 >Detector thread::DEBUG::2014-10-29 11:28:30,295::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54851 >Detector thread::DEBUG::2014-10-29 11:28:30,296::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54851) >Thread-137414::DEBUG::2014-10-29 11:28:30,335::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137414::DEBUG::2014-10-29 11:28:30,336::task::595::Storage.TaskManager.Task::(_updateState) Task=`b8f93e74-f2f9-4cdc-8887-c42d4edc063b`::moving from state init -> state preparing >Thread-137414::INFO::2014-10-29 11:28:30,336::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137414::INFO::2014-10-29 11:28:30,337::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00152909', 'lastCheck': '0.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533811', 'lastCheck': '0.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000554865', 'lastCheck': '0.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000576016', 'lastCheck': '0.6', 'valid': True}} >Thread-137414::DEBUG::2014-10-29 11:28:30,337::task::1191::Storage.TaskManager.Task::(prepare) Task=`b8f93e74-f2f9-4cdc-8887-c42d4edc063b`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00152909', 'lastCheck': '0.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533811', 'lastCheck': '0.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000554865', 'lastCheck': '0.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000576016', 'lastCheck': '0.6', 'valid': True}} >Thread-137414::DEBUG::2014-10-29 11:28:30,337::task::595::Storage.TaskManager.Task::(_updateState) Task=`b8f93e74-f2f9-4cdc-8887-c42d4edc063b`::moving from state preparing -> state finished >Thread-137414::DEBUG::2014-10-29 11:28:30,338::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137414::DEBUG::2014-10-29 11:28:30,338::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137414::DEBUG::2014-10-29 11:28:30,338::task::993::Storage.TaskManager.Task::(_decref) Task=`b8f93e74-f2f9-4cdc-8887-c42d4edc063b`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:28:30,369::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54852 >Detector thread::DEBUG::2014-10-29 11:28:30,370::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54852 >Detector thread::DEBUG::2014-10-29 11:28:30,370::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54852 >Detector thread::DEBUG::2014-10-29 11:28:30,371::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54852) >Thread-137415::DEBUG::2014-10-29 11:28:30,410::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137415::DEBUG::2014-10-29 11:28:30,411::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137415::DEBUG::2014-10-29 11:28:30,412::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '7.10', 'elapsedTime': '514742', 'displayType': 'vnc', 'cpuSys': '1.06', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '6666671', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '86562', 'readRate': '0.00', 'truesize': '6010904576', 'writeRate': '37985.86'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.57', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:28:30,621::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54854 >Detector thread::DEBUG::2014-10-29 11:28:30,621::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54854 >Detector thread::DEBUG::2014-10-29 11:28:30,621::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54854 >Detector thread::DEBUG::2014-10-29 11:28:30,622::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54854) >Detector thread::DEBUG::2014-10-29 11:28:30,637::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54855 >Detector thread::DEBUG::2014-10-29 11:28:30,637::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54855 >Detector thread::DEBUG::2014-10-29 11:28:30,638::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54855 >Detector thread::DEBUG::2014-10-29 11:28:30,638::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54855) >Thread-137416::DEBUG::2014-10-29 11:28:30,662::task::595::Storage.TaskManager.Task::(_updateState) Task=`911a8210-7248-4845-8277-3003800e4b81`::moving from state init -> state preparing >Thread-137416::INFO::2014-10-29 11:28:30,662::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137416::INFO::2014-10-29 11:28:30,663::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00152909', 'lastCheck': '0.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533811', 'lastCheck': '0.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000554865', 'lastCheck': '1.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000576016', 'lastCheck': '0.9', 'valid': True}} >Thread-137416::DEBUG::2014-10-29 11:28:30,663::task::1191::Storage.TaskManager.Task::(prepare) Task=`911a8210-7248-4845-8277-3003800e4b81`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00152909', 'lastCheck': '0.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533811', 'lastCheck': '0.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000554865', 'lastCheck': '1.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000576016', 'lastCheck': '0.9', 'valid': True}} >Thread-137416::DEBUG::2014-10-29 11:28:30,663::task::595::Storage.TaskManager.Task::(_updateState) Task=`911a8210-7248-4845-8277-3003800e4b81`::moving from state preparing -> state finished >Thread-137416::DEBUG::2014-10-29 11:28:30,663::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137416::DEBUG::2014-10-29 11:28:30,664::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137416::DEBUG::2014-10-29 11:28:30,664::task::993::Storage.TaskManager.Task::(_decref) Task=`911a8210-7248-4845-8277-3003800e4b81`::ref 0 aborting False >Thread-137417::DEBUG::2014-10-29 11:28:30,677::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137417::DEBUG::2014-10-29 11:28:30,678::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137417::DEBUG::2014-10-29 11:28:30,696::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137417::DEBUG::2014-10-29 11:28:30,754::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '65', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '65', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:31,143::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:31,146::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137418::DEBUG::2014-10-29 11:28:31,149::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:31,151::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:31,153::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137419::DEBUG::2014-10-29 11:28:31,157::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137419::DEBUG::2014-10-29 11:28:31,159::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:31,769::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:31,772::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:31,777::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:34,171::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:34,174::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137420::DEBUG::2014-10-29 11:28:34,177::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:34,179::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:34,181::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137421::DEBUG::2014-10-29 11:28:34,184::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137421::DEBUG::2014-10-29 11:28:34,186::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:28:34,772::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >Thread-22::DEBUG::2014-10-29 11:28:35,875::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:36,784::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:36,786::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:36,787::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:37,198::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:37,201::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137422::DEBUG::2014-10-29 11:28:37,205::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:37,207::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:37,209::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137423::DEBUG::2014-10-29 11:28:37,212::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137423::DEBUG::2014-10-29 11:28:37,214::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:28:39,700::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:39,701::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:39,701::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:39,701::__init__::232::IOProcess::(_processLogs) (202557) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:39,703::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202557) Queuing response >Thread-179::DEBUG::2014-10-29 11:28:39,705::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:28:39,723::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000436407 s, 852 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:28:39,724::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:39,725::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:39,725::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:39,725::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202558) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:39,727::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202558) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:39,755::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:39,756::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:39,756::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:39,756::__init__::232::IOProcess::(_processLogs) (202559) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:39,758::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202559) Queuing response >Thread-10269::DEBUG::2014-10-29 11:28:39,759::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:28:39,775::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000492226 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:28:39,777::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:39,777::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:39,777::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:39,778::__init__::232::IOProcess::(_processLogs) (202560) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:39,780::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202560) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:39,840::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:39,841::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:39,842::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-33::DEBUG::2014-10-29 11:28:39,843::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:28:39,844::__init__::232::IOProcess::(_processLogs) (202561) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:39,859::__init__::232::IOProcess::(_processLogs) (202561) Queuing response >Thread-33::DEBUG::2014-10-29 11:28:39,862::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00122202 s, 399 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:28:39,864::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:39,865::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:39,865::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:39,865::__init__::232::IOProcess::(_processLogs) (202562) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:39,867::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202562) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:39,869::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:39,869::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:39,870::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:39,871::__init__::232::IOProcess::(_processLogs) (202563) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:39,871::__init__::232::IOProcess::(_processLogs) (202563) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:39,872::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:39,872::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:39,872::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:39,873::__init__::232::IOProcess::(_processLogs) (202564) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:39,874::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202564) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:39,875::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:39,875::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:39,875::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:39,876::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202565) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:39,877::__init__::232::IOProcess::(_processLogs) (202565) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:39,922::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:39,923::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:39,925::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-178::DEBUG::2014-10-29 11:28:39,926::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:28:39,943::__init__::232::IOProcess::(_processLogs) (202566) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:39,945::__init__::232::IOProcess::(_processLogs) (202566) Queuing response >Thread-178::DEBUG::2014-10-29 11:28:39,946::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000528449 s, 961 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:28:39,949::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:39,949::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:39,951::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:39,952::__init__::232::IOProcess::(_processLogs) (202567) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:39,953::__init__::232::IOProcess::(_processLogs) (202567) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:39,953::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:39,954::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:39,954::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:39,955::__init__::232::IOProcess::(_processLogs) (202568) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:39,955::__init__::232::IOProcess::(_processLogs) (202568) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:39,956::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:39,956::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:39,957::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:39,958::__init__::232::IOProcess::(_processLogs) (202569) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:39,958::__init__::232::IOProcess::(_processLogs) (202569) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:39,959::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:39,959::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:39,960::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:39,960::__init__::232::IOProcess::(_processLogs) (202570) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:39,961::__init__::232::IOProcess::(_processLogs) (202570) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:40,228::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:40,231::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137424::DEBUG::2014-10-29 11:28:40,235::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a32dfeb-e70c-4c19-a048-9bf016a2b431`::moving from state init -> state preparing >Thread-137424::INFO::2014-10-29 11:28:40,236::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137424::INFO::2014-10-29 11:28:40,236::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528449', 'lastCheck': '0.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00122202', 'lastCheck': '0.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436407', 'lastCheck': '0.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492226', 'lastCheck': '0.5', 'valid': True}} >Thread-137424::DEBUG::2014-10-29 11:28:40,237::task::1191::Storage.TaskManager.Task::(prepare) Task=`3a32dfeb-e70c-4c19-a048-9bf016a2b431`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528449', 'lastCheck': '0.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00122202', 'lastCheck': '0.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436407', 'lastCheck': '0.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492226', 'lastCheck': '0.5', 'valid': True}} >Thread-137424::DEBUG::2014-10-29 11:28:40,237::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a32dfeb-e70c-4c19-a048-9bf016a2b431`::moving from state preparing -> state finished >Thread-137424::DEBUG::2014-10-29 11:28:40,237::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137424::DEBUG::2014-10-29 11:28:40,238::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137424::DEBUG::2014-10-29 11:28:40,238::task::993::Storage.TaskManager.Task::(_decref) Task=`3a32dfeb-e70c-4c19-a048-9bf016a2b431`::ref 0 aborting False >Thread-137424::DEBUG::2014-10-29 11:28:40,260::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:40,287::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:40,289::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137425::DEBUG::2014-10-29 11:28:40,293::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137425::DEBUG::2014-10-29 11:28:40,295::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:28:40,593::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54856 >Detector thread::DEBUG::2014-10-29 11:28:40,594::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54856 >Detector thread::DEBUG::2014-10-29 11:28:40,595::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54856 >Detector thread::DEBUG::2014-10-29 11:28:40,595::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54856) >Thread-137426::DEBUG::2014-10-29 11:28:40,634::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137426::DEBUG::2014-10-29 11:28:40,636::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137426::DEBUG::2014-10-29 11:28:40,637::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.61', 'elapsedTime': '514753', 'displayType': 'vnc', 'cpuSys': '0.40', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '6666671', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '86562', 'readRate': '0.00', 'truesize': '6010904576', 'writeRate': '37985.86'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.76', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:28:40,804::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54858 >Detector thread::DEBUG::2014-10-29 11:28:40,805::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54858 >Detector thread::DEBUG::2014-10-29 11:28:40,805::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54858 >Detector thread::DEBUG::2014-10-29 11:28:40,806::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54858) >Detector thread::DEBUG::2014-10-29 11:28:40,826::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54859 >Detector thread::DEBUG::2014-10-29 11:28:40,826::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54859 >Detector thread::DEBUG::2014-10-29 11:28:40,826::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54859 >Detector thread::DEBUG::2014-10-29 11:28:40,827::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54859) >Thread-137427::DEBUG::2014-10-29 11:28:40,846::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137427::DEBUG::2014-10-29 11:28:40,850::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137427::DEBUG::2014-10-29 11:28:40,872::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137428::DEBUG::2014-10-29 11:28:40,875::task::595::Storage.TaskManager.Task::(_updateState) Task=`09c2715c-5dca-4291-ae29-23893dc3ec01`::moving from state init -> state preparing >Thread-137428::INFO::2014-10-29 11:28:40,879::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137428::INFO::2014-10-29 11:28:40,882::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528449', 'lastCheck': '0.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00122202', 'lastCheck': '1.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436407', 'lastCheck': '1.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492226', 'lastCheck': '1.1', 'valid': True}} >Thread-137428::DEBUG::2014-10-29 11:28:40,883::task::1191::Storage.TaskManager.Task::(prepare) Task=`09c2715c-5dca-4291-ae29-23893dc3ec01`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528449', 'lastCheck': '0.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00122202', 'lastCheck': '1.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436407', 'lastCheck': '1.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492226', 'lastCheck': '1.1', 'valid': True}} >Thread-137428::DEBUG::2014-10-29 11:28:40,883::task::595::Storage.TaskManager.Task::(_updateState) Task=`09c2715c-5dca-4291-ae29-23893dc3ec01`::moving from state preparing -> state finished >Thread-137428::DEBUG::2014-10-29 11:28:40,883::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137428::DEBUG::2014-10-29 11:28:40,883::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137428::DEBUG::2014-10-29 11:28:40,884::task::993::Storage.TaskManager.Task::(_decref) Task=`09c2715c-5dca-4291-ae29-23893dc3ec01`::ref 0 aborting False >Thread-137427::DEBUG::2014-10-29 11:28:40,957::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '46', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '46', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:28:40,969::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54861 >Detector thread::DEBUG::2014-10-29 11:28:40,973::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54861 >Detector thread::DEBUG::2014-10-29 11:28:40,975::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54861 >Detector thread::DEBUG::2014-10-29 11:28:40,978::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54861) >Thread-137429::DEBUG::2014-10-29 11:28:41,013::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137429::DEBUG::2014-10-29 11:28:41,014::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1dc3d2a-38fa-4d75-900d-57ee3b44ff71`::moving from state init -> state preparing >Thread-137429::INFO::2014-10-29 11:28:41,014::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137429::DEBUG::2014-10-29 11:28:41,017::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:28:41,018::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:41,018::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:41,019::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:41,019::__init__::232::IOProcess::(_processLogs) (202571) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:28:41,020::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202571) Queuing response >Thread-137429::DEBUG::2014-10-29 11:28:41,020::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137429::DEBUG::2014-10-29 11:28:41,022::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137429::INFO::2014-10-29 11:28:41,022::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137429::DEBUG::2014-10-29 11:28:41,023::task::1191::Storage.TaskManager.Task::(prepare) Task=`b1dc3d2a-38fa-4d75-900d-57ee3b44ff71`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137429::DEBUG::2014-10-29 11:28:41,023::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1dc3d2a-38fa-4d75-900d-57ee3b44ff71`::moving from state preparing -> state finished >Thread-137429::DEBUG::2014-10-29 11:28:41,023::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137429::DEBUG::2014-10-29 11:28:41,023::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137429::DEBUG::2014-10-29 11:28:41,024::task::993::Storage.TaskManager.Task::(_decref) Task=`b1dc3d2a-38fa-4d75-900d-57ee3b44ff71`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:28:41,067::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54862 >Detector thread::DEBUG::2014-10-29 11:28:41,067::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54862 >Detector thread::DEBUG::2014-10-29 11:28:41,068::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54862 >Detector thread::DEBUG::2014-10-29 11:28:41,068::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54862) >Thread-137430::DEBUG::2014-10-29 11:28:41,107::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137430::DEBUG::2014-10-29 11:28:41,107::task::595::Storage.TaskManager.Task::(_updateState) Task=`91e3e32e-6d28-46b9-9c62-7437703b73ad`::moving from state init -> state preparing >Thread-137430::INFO::2014-10-29 11:28:41,108::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137430::DEBUG::2014-10-29 11:28:41,108::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137430::DEBUG::2014-10-29 11:28:41,108::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137430::DEBUG::2014-10-29 11:28:41,109::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137430::DEBUG::2014-10-29 11:28:41,109::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137430::DEBUG::2014-10-29 11:28:41,109::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137430::DEBUG::2014-10-29 11:28:41,110::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137430::DEBUG::2014-10-29 11:28:41,191::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137430::DEBUG::2014-10-29 11:28:41,192::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137430::DEBUG::2014-10-29 11:28:41,366::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137430::DEBUG::2014-10-29 11:28:41,367::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137430::DEBUG::2014-10-29 11:28:41,368::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137430::DEBUG::2014-10-29 11:28:41,368::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137430::DEBUG::2014-10-29 11:28:41,368::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137430::DEBUG::2014-10-29 11:28:41,369::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137430::DEBUG::2014-10-29 11:28:41,369::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137430::DEBUG::2014-10-29 11:28:41,370::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:28:41,380::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:41,381::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:41,381::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:41,382::__init__::232::IOProcess::(_processLogs) (202572) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:28:41,382::__init__::232::IOProcess::(_processLogs) (202572) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:41,383::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:41,383::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:41,383::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:41,384::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:41,384::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:41,385::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:41,386::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:41,387::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:41,387::__init__::232::IOProcess::(_processLogs) (202573) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:28:41,387::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:41,387::__init__::232::IOProcess::(_processLogs) (202574) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:28:41,388::__init__::232::IOProcess::(_processLogs) (202575) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:28:41,388::__init__::232::IOProcess::(_processLogs) (202574) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:41,388::__init__::232::IOProcess::(_processLogs) (202573) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:41,388::__init__::232::IOProcess::(_processLogs) (202575) Queuing response >Thread-137430::DEBUG::2014-10-29 11:28:41,395::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:28:41,396::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:41,396::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:41,396::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:41,396::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202576) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:28:41,397::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202576) Queuing response >Thread-137430::DEBUG::2014-10-29 11:28:41,398::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:28:41,399::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:41,399::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:41,399::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:41,400::__init__::232::IOProcess::(_processLogs) (202577) Got request for method 'readfile' >Thread-137430::DEBUG::2014-10-29 11:28:41,401::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:28:41,400::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202577) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:41,403::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:41,404::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:41,405::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:41,405::__init__::232::IOProcess::(_processLogs) (202578) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:41,405::__init__::232::IOProcess::(_processLogs) (202578) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:41,406::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:41,406::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137430::DEBUG::2014-10-29 11:28:41,407::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:28:41,407::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-137430::INFO::2014-10-29 11:28:41,408::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137430::INFO::2014-10-29 11:28:41,409::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:28:41,409::__init__::232::IOProcess::(_processLogs) (202579) Got request for method 'glob' >Thread-137430::INFO::2014-10-29 11:28:41,411::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:28:41,411::__init__::232::IOProcess::(_processLogs) (202579) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:41,413::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:41,413::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:41,413::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:41,414::__init__::232::IOProcess::(_processLogs) (202580) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:28:41,414::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202580) Queuing response >Thread-137430::DEBUG::2014-10-29 11:28:41,415::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137430::DEBUG::2014-10-29 11:28:41,417::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`334a4d79-96ba-4353-9b13-e19dd7522408`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137430::DEBUG::2014-10-29 11:28:41,417::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137430::DEBUG::2014-10-29 11:28:41,418::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137430::DEBUG::2014-10-29 11:28:41,418::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`334a4d79-96ba-4353-9b13-e19dd7522408`::Granted request >Thread-137430::DEBUG::2014-10-29 11:28:41,419::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`91e3e32e-6d28-46b9-9c62-7437703b73ad`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137430::DEBUG::2014-10-29 11:28:41,419::task::993::Storage.TaskManager.Task::(_decref) Task=`91e3e32e-6d28-46b9-9c62-7437703b73ad`::ref 1 aborting False >Thread-137430::INFO::2014-10-29 11:28:41,422::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137430::DEBUG::2014-10-29 11:28:41,422::task::1191::Storage.TaskManager.Task::(prepare) Task=`91e3e32e-6d28-46b9-9c62-7437703b73ad`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137430::DEBUG::2014-10-29 11:28:41,422::task::595::Storage.TaskManager.Task::(_updateState) Task=`91e3e32e-6d28-46b9-9c62-7437703b73ad`::moving from state preparing -> state finished >Thread-137430::DEBUG::2014-10-29 11:28:41,422::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137430::DEBUG::2014-10-29 11:28:41,423::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137430::DEBUG::2014-10-29 11:28:41,423::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137430::DEBUG::2014-10-29 11:28:41,423::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137430::DEBUG::2014-10-29 11:28:41,424::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137430::DEBUG::2014-10-29 11:28:41,424::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137430::DEBUG::2014-10-29 11:28:41,424::task::993::Storage.TaskManager.Task::(_decref) Task=`91e3e32e-6d28-46b9-9c62-7437703b73ad`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:28:41,455::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54863 >Detector thread::DEBUG::2014-10-29 11:28:41,457::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54863 >Detector thread::DEBUG::2014-10-29 11:28:41,457::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54863 >Detector thread::DEBUG::2014-10-29 11:28:41,458::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54863) >Thread-137435::DEBUG::2014-10-29 11:28:41,495::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137435::DEBUG::2014-10-29 11:28:41,495::task::595::Storage.TaskManager.Task::(_updateState) Task=`54b2ed34-78ab-40ce-b3b9-7f01f5bdae79`::moving from state init -> state preparing >Thread-137435::INFO::2014-10-29 11:28:41,496::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137435::INFO::2014-10-29 11:28:41,496::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528449', 'lastCheck': '1.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00122202', 'lastCheck': '1.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436407', 'lastCheck': '1.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492226', 'lastCheck': '1.7', 'valid': True}} >Thread-137435::DEBUG::2014-10-29 11:28:41,497::task::1191::Storage.TaskManager.Task::(prepare) Task=`54b2ed34-78ab-40ce-b3b9-7f01f5bdae79`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528449', 'lastCheck': '1.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00122202', 'lastCheck': '1.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436407', 'lastCheck': '1.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492226', 'lastCheck': '1.7', 'valid': True}} >Thread-137435::DEBUG::2014-10-29 11:28:41,497::task::595::Storage.TaskManager.Task::(_updateState) Task=`54b2ed34-78ab-40ce-b3b9-7f01f5bdae79`::moving from state preparing -> state finished >Thread-137435::DEBUG::2014-10-29 11:28:41,497::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137435::DEBUG::2014-10-29 11:28:41,497::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137435::DEBUG::2014-10-29 11:28:41,498::task::993::Storage.TaskManager.Task::(_decref) Task=`54b2ed34-78ab-40ce-b3b9-7f01f5bdae79`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:41,799::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:41,812::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:41,814::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:43,351::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:43,354::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137436::DEBUG::2014-10-29 11:28:43,358::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:43,360::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:43,363::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137437::DEBUG::2014-10-29 11:28:43,366::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137437::DEBUG::2014-10-29 11:28:43,368::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:46,388::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:46,394::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137438::DEBUG::2014-10-29 11:28:46,402::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:46,406::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:46,411::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137439::DEBUG::2014-10-29 11:28:46,419::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137439::DEBUG::2014-10-29 11:28:46,433::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:46,823::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:46,828::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:46,832::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:49,449::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:49,452::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137440::DEBUG::2014-10-29 11:28:49,456::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:49,458::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:49,460::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137441::DEBUG::2014-10-29 11:28:49,463::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137441::DEBUG::2014-10-29 11:28:49,465::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:28:49,730::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:49,730::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:49,731::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:49,731::__init__::232::IOProcess::(_processLogs) (202581) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:49,733::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202581) Queuing response >Thread-179::DEBUG::2014-10-29 11:28:49,734::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:28:49,751::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00052414 s, 710 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:28:49,753::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:49,754::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:49,754::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:49,754::__init__::232::IOProcess::(_processLogs) (202582) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:49,754::__init__::232::IOProcess::(_processLogs) (202582) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:49,783::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:49,783::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:49,783::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:49,783::__init__::232::IOProcess::(_processLogs) (202583) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:49,785::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202583) Queuing response >Thread-10269::DEBUG::2014-10-29 11:28:49,786::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:28:49,805::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000511877 s, 981 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:28:49,807::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:49,807::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:49,807::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:49,808::__init__::232::IOProcess::(_processLogs) (202584) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:49,809::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202584) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:49,879::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:49,879::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:49,879::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:49,880::__init__::232::IOProcess::(_processLogs) (202585) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:49,880::__init__::232::IOProcess::(_processLogs) (202585) Queuing response >Thread-33::DEBUG::2014-10-29 11:28:49,881::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:28:49,898::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000519877 s, 937 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:28:49,900::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:49,900::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:49,900::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:49,900::__init__::232::IOProcess::(_processLogs) (202586) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:49,901::__init__::232::IOProcess::(_processLogs) (202586) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:49,903::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:49,904::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:49,904::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:49,905::__init__::232::IOProcess::(_processLogs) (202587) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:49,905::__init__::232::IOProcess::(_processLogs) (202587) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:49,905::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:49,906::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:49,907::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:49,907::__init__::232::IOProcess::(_processLogs) (202588) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:49,907::__init__::232::IOProcess::(_processLogs) (202588) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:49,908::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:49,909::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:49,909::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:49,910::__init__::232::IOProcess::(_processLogs) (202589) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:49,911::__init__::232::IOProcess::(_processLogs) (202589) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:49,962::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:49,963::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:49,963::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:49,963::__init__::232::IOProcess::(_processLogs) (202590) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:49,964::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202590) Queuing response >Thread-178::DEBUG::2014-10-29 11:28:49,966::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:28:49,985::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00041906 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:28:49,986::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:49,987::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:49,987::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:49,987::__init__::232::IOProcess::(_processLogs) (202591) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:49,989::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202591) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:49,991::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:49,991::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:49,991::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:49,991::__init__::232::IOProcess::(_processLogs) (202592) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:49,992::__init__::232::IOProcess::(_processLogs) (202592) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:49,993::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:49,993::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:49,993::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:49,994::__init__::232::IOProcess::(_processLogs) (202593) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:49,994::__init__::232::IOProcess::(_processLogs) (202593) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:49,995::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:49,995::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:49,995::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:49,996::__init__::232::IOProcess::(_processLogs) (202594) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:49,996::__init__::232::IOProcess::(_processLogs) (202594) Queuing response >Detector thread::DEBUG::2014-10-29 11:28:50,808::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54864 >Detector thread::DEBUG::2014-10-29 11:28:50,808::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54864 >Detector thread::DEBUG::2014-10-29 11:28:50,809::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54864 >Detector thread::DEBUG::2014-10-29 11:28:50,810::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54864) >Thread-137442::DEBUG::2014-10-29 11:28:50,848::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137442::DEBUG::2014-10-29 11:28:50,849::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137442::DEBUG::2014-10-29 11:28:50,850::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.61', 'elapsedTime': '514763', 'displayType': 'vnc', 'cpuSys': '0.40', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '6666671', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '86562', 'readRate': '0.00', 'truesize': '6010904576', 'writeRate': '37985.86'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.97', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-22::DEBUG::2014-10-29 11:28:50,882::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ba25116-3eee-4740-8152-83006e28f3b1`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:28:50,883::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:28:50,884::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:50,884::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:50,884::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:50,885::__init__::232::IOProcess::(_processLogs) (202595) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:28:50,885::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202595) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:50,887::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:50,888::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-22::INFO::2014-10-29 11:28:50,889::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010904576', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:28:50,890::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-22::DEBUG::2014-10-29 11:28:50,891::task::1191::Storage.TaskManager.Task::(prepare) Task=`5ba25116-3eee-4740-8152-83006e28f3b1`::finished: {'truesize': '6010904576', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:28:50,891::__init__::232::IOProcess::(_processLogs) (202596) Got request for method 'stat' >Thread-22::DEBUG::2014-10-29 11:28:50,892::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ba25116-3eee-4740-8152-83006e28f3b1`::moving from state preparing -> state finished >Thread-17::DEBUG::2014-10-29 11:28:50,893::__init__::232::IOProcess::(_processLogs) (202596) Queuing response >Thread-22::DEBUG::2014-10-29 11:28:50,893::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-10-29 11:28:50,894::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2014-10-29 11:28:50,894::task::993::Storage.TaskManager.Task::(_decref) Task=`5ba25116-3eee-4740-8152-83006e28f3b1`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:28:50,985::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Detector thread::DEBUG::2014-10-29 11:28:51,031::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54866 >Detector thread::DEBUG::2014-10-29 11:28:51,032::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54866 >Detector thread::DEBUG::2014-10-29 11:28:51,032::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54866 >Detector thread::DEBUG::2014-10-29 11:28:51,033::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54866) >Detector thread::DEBUG::2014-10-29 11:28:51,052::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54867 >Detector thread::DEBUG::2014-10-29 11:28:51,053::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54867 >Detector thread::DEBUG::2014-10-29 11:28:51,053::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54867 >Detector thread::DEBUG::2014-10-29 11:28:51,053::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54867) >Thread-137443::DEBUG::2014-10-29 11:28:51,073::task::595::Storage.TaskManager.Task::(_updateState) Task=`317c5260-a1ab-4fe9-8c2a-355eb5d0b892`::moving from state init -> state preparing >Thread-137443::INFO::2014-10-29 11:28:51,073::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137443::INFO::2014-10-29 11:28:51,074::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00041906', 'lastCheck': '1.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519877', 'lastCheck': '1.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052414', 'lastCheck': '1.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000511877', 'lastCheck': '1.3', 'valid': True}} >Thread-137443::DEBUG::2014-10-29 11:28:51,074::task::1191::Storage.TaskManager.Task::(prepare) Task=`317c5260-a1ab-4fe9-8c2a-355eb5d0b892`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00041906', 'lastCheck': '1.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519877', 'lastCheck': '1.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052414', 'lastCheck': '1.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000511877', 'lastCheck': '1.3', 'valid': True}} >Thread-137443::DEBUG::2014-10-29 11:28:51,074::task::595::Storage.TaskManager.Task::(_updateState) Task=`317c5260-a1ab-4fe9-8c2a-355eb5d0b892`::moving from state preparing -> state finished >Thread-137443::DEBUG::2014-10-29 11:28:51,074::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137443::DEBUG::2014-10-29 11:28:51,075::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137443::DEBUG::2014-10-29 11:28:51,075::task::993::Storage.TaskManager.Task::(_decref) Task=`317c5260-a1ab-4fe9-8c2a-355eb5d0b892`::ref 0 aborting False >Thread-137444::DEBUG::2014-10-29 11:28:51,092::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137444::DEBUG::2014-10-29 11:28:51,094::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137444::DEBUG::2014-10-29 11:28:51,115::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137444::DEBUG::2014-10-29 11:28:51,177::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '23', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '23', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:51,842::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:51,843::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:51,844::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:28:52,057::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54869 >Detector thread::DEBUG::2014-10-29 11:28:52,060::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54869 >Detector thread::DEBUG::2014-10-29 11:28:52,060::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54869 >Detector thread::DEBUG::2014-10-29 11:28:52,061::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54869) >Thread-137445::DEBUG::2014-10-29 11:28:52,101::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137445::DEBUG::2014-10-29 11:28:52,102::task::595::Storage.TaskManager.Task::(_updateState) Task=`141620f6-8c9b-4e1f-99b6-d61701dfe882`::moving from state init -> state preparing >Thread-137445::INFO::2014-10-29 11:28:52,102::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137445::DEBUG::2014-10-29 11:28:52,106::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:28:52,107::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:52,107::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:52,107::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:52,108::__init__::232::IOProcess::(_processLogs) (202597) Got request for method 'glob' >Thread-137445::DEBUG::2014-10-29 11:28:52,109::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:28:52,109::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202597) Queuing response >Thread-137445::DEBUG::2014-10-29 11:28:52,110::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137445::INFO::2014-10-29 11:28:52,111::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137445::DEBUG::2014-10-29 11:28:52,111::task::1191::Storage.TaskManager.Task::(prepare) Task=`141620f6-8c9b-4e1f-99b6-d61701dfe882`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137445::DEBUG::2014-10-29 11:28:52,112::task::595::Storage.TaskManager.Task::(_updateState) Task=`141620f6-8c9b-4e1f-99b6-d61701dfe882`::moving from state preparing -> state finished >Thread-137445::DEBUG::2014-10-29 11:28:52,112::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137445::DEBUG::2014-10-29 11:28:52,112::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137445::DEBUG::2014-10-29 11:28:52,112::task::993::Storage.TaskManager.Task::(_decref) Task=`141620f6-8c9b-4e1f-99b6-d61701dfe882`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:28:52,158::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54870 >Detector thread::DEBUG::2014-10-29 11:28:52,159::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54870 >Detector thread::DEBUG::2014-10-29 11:28:52,159::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54870 >Detector thread::DEBUG::2014-10-29 11:28:52,159::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54870) >Thread-137446::DEBUG::2014-10-29 11:28:52,198::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137446::DEBUG::2014-10-29 11:28:52,199::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca55282f-d462-4442-97c2-d40bafb6ae2a`::moving from state init -> state preparing >Thread-137446::INFO::2014-10-29 11:28:52,199::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137446::DEBUG::2014-10-29 11:28:52,199::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137446::DEBUG::2014-10-29 11:28:52,200::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137446::DEBUG::2014-10-29 11:28:52,200::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137446::DEBUG::2014-10-29 11:28:52,200::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137446::DEBUG::2014-10-29 11:28:52,200::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137446::DEBUG::2014-10-29 11:28:52,201::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137446::DEBUG::2014-10-29 11:28:52,278::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137446::DEBUG::2014-10-29 11:28:52,279::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137446::DEBUG::2014-10-29 11:28:52,459::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137446::DEBUG::2014-10-29 11:28:52,460::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137446::DEBUG::2014-10-29 11:28:52,461::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137446::DEBUG::2014-10-29 11:28:52,461::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137446::DEBUG::2014-10-29 11:28:52,462::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137446::DEBUG::2014-10-29 11:28:52,462::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137446::DEBUG::2014-10-29 11:28:52,462::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137446::DEBUG::2014-10-29 11:28:52,463::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:28:52,468::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:52,469::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:52,470::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:52,470::__init__::232::IOProcess::(_processLogs) (202598) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:28:52,472::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202598) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:52,475::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:52,476::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:52,476::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:52,476::__init__::232::IOProcess::(_processLogs) (202599) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:28:52,477::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202599) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:52,479::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:52,480::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:52,483::__init__::232::IOProcess::(_processLogs) Extracting request information... >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:52,485::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-17::DEBUG::2014-10-29 11:28:52,488::__init__::232::IOProcess::(_processLogs) (202600) Got request for method 'glob' >JsonRpcServer::DEBUG::2014-10-29 11:28:52,496::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:28:52,503::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202600) Queuing response >Thread-137446::DEBUG::2014-10-29 11:28:52,507::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:28:52,512::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-137451::DEBUG::2014-10-29 11:28:52,514::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:28:52,514::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:52,519::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:52,520::__init__::232::IOProcess::(_processLogs) (202601) Got request for method 'glob' >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:52,520::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-17::DEBUG::2014-10-29 11:28:52,522::__init__::232::IOProcess::(_processLogs) (202601) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:52,526::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >JsonRpcServer::DEBUG::2014-10-29 11:28:52,526::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:28:52,529::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:52,531::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:52,532::__init__::232::IOProcess::(_processLogs) (202602) Got request for method 'touch' >Thread-137452::DEBUG::2014-10-29 11:28:52,536::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137446::DEBUG::2014-10-29 11:28:52,538::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:28:52,538::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202602) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:52,544::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:52,546::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:52,547::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-137446::DEBUG::2014-10-29 11:28:52,551::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:28:52,551::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202603) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:28:52,555::__init__::232::IOProcess::(_processLogs) (202603) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:52,559::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:52,560::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137452::DEBUG::2014-10-29 11:28:52,561::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:28:52,564::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:52,566::__init__::232::IOProcess::(_processLogs) (202604) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:52,567::__init__::232::IOProcess::(_processLogs) (202604) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:52,567::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:52,568::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:52,569::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-137446::DEBUG::2014-10-29 11:28:52,569::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:28:52,570::__init__::232::IOProcess::(_processLogs) (202605) Got request for method 'glob' >Thread-137446::INFO::2014-10-29 11:28:52,571::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:28:52,572::__init__::232::IOProcess::(_processLogs) (202605) Queuing response >Thread-137446::INFO::2014-10-29 11:28:52,572::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137446::INFO::2014-10-29 11:28:52,574::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:28:52,575::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:52,575::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:52,576::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:52,576::__init__::232::IOProcess::(_processLogs) (202606) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:28:52,577::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202606) Queuing response >Thread-137446::DEBUG::2014-10-29 11:28:52,577::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137446::DEBUG::2014-10-29 11:28:52,579::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`26a2243e-cc58-40a3-a317-79c626f5e67b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137446::DEBUG::2014-10-29 11:28:52,580::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137446::DEBUG::2014-10-29 11:28:52,580::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137446::DEBUG::2014-10-29 11:28:52,580::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`26a2243e-cc58-40a3-a317-79c626f5e67b`::Granted request >Thread-137446::DEBUG::2014-10-29 11:28:52,581::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ca55282f-d462-4442-97c2-d40bafb6ae2a`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137446::DEBUG::2014-10-29 11:28:52,581::task::993::Storage.TaskManager.Task::(_decref) Task=`ca55282f-d462-4442-97c2-d40bafb6ae2a`::ref 1 aborting False >Thread-137446::INFO::2014-10-29 11:28:52,584::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137446::DEBUG::2014-10-29 11:28:52,584::task::1191::Storage.TaskManager.Task::(prepare) Task=`ca55282f-d462-4442-97c2-d40bafb6ae2a`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137446::DEBUG::2014-10-29 11:28:52,585::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca55282f-d462-4442-97c2-d40bafb6ae2a`::moving from state preparing -> state finished >Thread-137446::DEBUG::2014-10-29 11:28:52,585::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137446::DEBUG::2014-10-29 11:28:52,585::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137446::DEBUG::2014-10-29 11:28:52,586::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137446::DEBUG::2014-10-29 11:28:52,586::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137446::DEBUG::2014-10-29 11:28:52,586::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137446::DEBUG::2014-10-29 11:28:52,586::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137446::DEBUG::2014-10-29 11:28:52,587::task::993::Storage.TaskManager.Task::(_decref) Task=`ca55282f-d462-4442-97c2-d40bafb6ae2a`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:28:52,608::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54871 >Detector thread::DEBUG::2014-10-29 11:28:52,609::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54871 >Detector thread::DEBUG::2014-10-29 11:28:52,609::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54871 >Detector thread::DEBUG::2014-10-29 11:28:52,610::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54871) >Thread-137453::DEBUG::2014-10-29 11:28:52,649::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137453::DEBUG::2014-10-29 11:28:52,649::task::595::Storage.TaskManager.Task::(_updateState) Task=`c8585a99-8dd9-4636-822f-9f426210b82a`::moving from state init -> state preparing >Thread-137453::INFO::2014-10-29 11:28:52,650::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137453::INFO::2014-10-29 11:28:52,650::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00041906', 'lastCheck': '2.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519877', 'lastCheck': '2.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052414', 'lastCheck': '2.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000511877', 'lastCheck': '2.8', 'valid': True}} >Thread-137453::DEBUG::2014-10-29 11:28:52,651::task::1191::Storage.TaskManager.Task::(prepare) Task=`c8585a99-8dd9-4636-822f-9f426210b82a`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00041906', 'lastCheck': '2.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519877', 'lastCheck': '2.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052414', 'lastCheck': '2.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000511877', 'lastCheck': '2.8', 'valid': True}} >Thread-137453::DEBUG::2014-10-29 11:28:52,651::task::595::Storage.TaskManager.Task::(_updateState) Task=`c8585a99-8dd9-4636-822f-9f426210b82a`::moving from state preparing -> state finished >Thread-137453::DEBUG::2014-10-29 11:28:52,651::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137453::DEBUG::2014-10-29 11:28:52,651::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137453::DEBUG::2014-10-29 11:28:52,652::task::993::Storage.TaskManager.Task::(_decref) Task=`c8585a99-8dd9-4636-822f-9f426210b82a`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:55,580::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:55,582::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137454::DEBUG::2014-10-29 11:28:55,585::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d9db66e-e068-4a0d-9713-c0f09010bfc7`::moving from state init -> state preparing >Thread-137454::INFO::2014-10-29 11:28:55,586::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137454::INFO::2014-10-29 11:28:55,587::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00041906', 'lastCheck': '5.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519877', 'lastCheck': '5.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052414', 'lastCheck': '5.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000511877', 'lastCheck': '5.8', 'valid': True}} >Thread-137454::DEBUG::2014-10-29 11:28:55,587::task::1191::Storage.TaskManager.Task::(prepare) Task=`1d9db66e-e068-4a0d-9713-c0f09010bfc7`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00041906', 'lastCheck': '5.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519877', 'lastCheck': '5.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00052414', 'lastCheck': '5.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000511877', 'lastCheck': '5.8', 'valid': True}} >Thread-137454::DEBUG::2014-10-29 11:28:55,587::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d9db66e-e068-4a0d-9713-c0f09010bfc7`::moving from state preparing -> state finished >Thread-137454::DEBUG::2014-10-29 11:28:55,587::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137454::DEBUG::2014-10-29 11:28:55,588::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137454::DEBUG::2014-10-29 11:28:55,588::task::993::Storage.TaskManager.Task::(_decref) Task=`1d9db66e-e068-4a0d-9713-c0f09010bfc7`::ref 0 aborting False >Thread-137454::DEBUG::2014-10-29 11:28:55,610::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:55,633::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:55,635::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137455::DEBUG::2014-10-29 11:28:55,638::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137455::DEBUG::2014-10-29 11:28:55,640::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:56,848::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:56,849::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:28:56,850::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:58,679::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:58,682::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137456::DEBUG::2014-10-29 11:28:58,686::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:28:58,688::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:28:58,689::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137457::DEBUG::2014-10-29 11:28:58,693::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137457::DEBUG::2014-10-29 11:28:58,695::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:28:59,759::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:59,760::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:59,760::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:59,760::__init__::232::IOProcess::(_processLogs) (202607) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:59,763::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202607) Queuing response >Thread-179::DEBUG::2014-10-29 11:28:59,764::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:28:59,781::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00049485 s, 752 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:28:59,783::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:59,783::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:59,784::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:59,785::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202608) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:59,786::__init__::232::IOProcess::(_processLogs) (202608) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:59,812::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:59,812::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:59,812::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:59,813::__init__::232::IOProcess::(_processLogs) (202609) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:59,815::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202609) Queuing response >Thread-10269::DEBUG::2014-10-29 11:28:59,816::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:28:59,833::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.0005236 s, 959 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:28:59,835::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:59,836::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:59,837::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:59,839::__init__::232::IOProcess::(_processLogs) (202610) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:59,840::__init__::232::IOProcess::(_processLogs) (202610) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:59,911::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:59,912::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:59,912::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:59,912::__init__::232::IOProcess::(_processLogs) (202611) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:59,913::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202611) Queuing response >Thread-33::DEBUG::2014-10-29 11:28:59,915::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:28:59,932::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00049094 s, 992 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:28:59,934::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:59,934::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:59,934::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:59,935::__init__::232::IOProcess::(_processLogs) (202612) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:28:59,936::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202612) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:59,938::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:59,939::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:59,939::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:59,940::__init__::232::IOProcess::(_processLogs) (202613) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:59,940::__init__::232::IOProcess::(_processLogs) (202613) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:59,940::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:59,941::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:59,942::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:59,942::__init__::232::IOProcess::(_processLogs) (202614) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:59,942::__init__::232::IOProcess::(_processLogs) (202614) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:59,943::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:59,944::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:28:59,944::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:28:59,945::__init__::232::IOProcess::(_processLogs) (202615) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:28:59,946::__init__::232::IOProcess::(_processLogs) (202615) Queuing response >Thread-17::DEBUG::2014-10-29 11:28:59,998::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:28:59,999::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:00,000::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:00,002::__init__::232::IOProcess::(_processLogs) (202616) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:29:00,002::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:29:00,003::__init__::232::IOProcess::(_processLogs) (202616) Queuing response >Thread-178::DEBUG::2014-10-29 11:29:00,019::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00060963 s, 833 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:29:00,021::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:00,021::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:00,021::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:00,021::__init__::232::IOProcess::(_processLogs) (202617) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:00,023::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202617) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:00,025::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:00,026::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:00,026::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:00,027::__init__::232::IOProcess::(_processLogs) (202618) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:00,027::__init__::232::IOProcess::(_processLogs) (202618) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:00,027::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:00,028::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:00,029::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:00,029::__init__::232::IOProcess::(_processLogs) (202619) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:00,030::__init__::232::IOProcess::(_processLogs) (202619) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:00,030::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:00,031::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:00,031::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:00,032::__init__::232::IOProcess::(_processLogs) (202620) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:00,033::__init__::232::IOProcess::(_processLogs) (202620) Queuing response >Detector thread::DEBUG::2014-10-29 11:29:01,022::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54872 >Detector thread::DEBUG::2014-10-29 11:29:01,022::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54872 >Detector thread::DEBUG::2014-10-29 11:29:01,033::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54872 >Detector thread::DEBUG::2014-10-29 11:29:01,033::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54872) >Thread-137458::DEBUG::2014-10-29 11:29:01,062::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137458::DEBUG::2014-10-29 11:29:01,063::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137458::DEBUG::2014-10-29 11:29:01,064::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '6.59', 'elapsedTime': '514773', 'displayType': 'vnc', 'cpuSys': '0.40', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '2436045', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '59879', 'readRate': '0.00', 'truesize': '6010904576', 'writeRate': '35691.50'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.08', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:29:01,182::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54873 >Detector thread::DEBUG::2014-10-29 11:29:01,182::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54873 >Detector thread::DEBUG::2014-10-29 11:29:01,183::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54873 >Detector thread::DEBUG::2014-10-29 11:29:01,183::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54873) >Thread-137459::DEBUG::2014-10-29 11:29:01,223::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c792424-776f-4874-a71c-6bb332c8031f`::moving from state init -> state preparing >Thread-137459::INFO::2014-10-29 11:29:01,224::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Detector thread::DEBUG::2014-10-29 11:29:01,225::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54875 >Thread-137459::INFO::2014-10-29 11:29:01,225::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060963', 'lastCheck': '1.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049094', 'lastCheck': '1.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049485', 'lastCheck': '1.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0005236', 'lastCheck': '1.4', 'valid': True}} >Thread-137459::DEBUG::2014-10-29 11:29:01,227::task::1191::Storage.TaskManager.Task::(prepare) Task=`7c792424-776f-4874-a71c-6bb332c8031f`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060963', 'lastCheck': '1.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049094', 'lastCheck': '1.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049485', 'lastCheck': '1.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0005236', 'lastCheck': '1.4', 'valid': True}} >Detector thread::DEBUG::2014-10-29 11:29:01,227::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54875 >Thread-137459::DEBUG::2014-10-29 11:29:01,228::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c792424-776f-4874-a71c-6bb332c8031f`::moving from state preparing -> state finished >Detector thread::DEBUG::2014-10-29 11:29:01,229::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54875 >Thread-137459::DEBUG::2014-10-29 11:29:01,230::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137459::DEBUG::2014-10-29 11:29:01,232::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Detector thread::DEBUG::2014-10-29 11:29:01,232::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54875) >Thread-137459::DEBUG::2014-10-29 11:29:01,235::task::993::Storage.TaskManager.Task::(_decref) Task=`7c792424-776f-4874-a71c-6bb332c8031f`::ref 0 aborting False >Thread-137460::DEBUG::2014-10-29 11:29:01,265::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137460::DEBUG::2014-10-29 11:29:01,266::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137460::DEBUG::2014-10-29 11:29:01,285::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137460::DEBUG::2014-10-29 11:29:01,342::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '6', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '6', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:01,716::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:01,718::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137461::DEBUG::2014-10-29 11:29:01,722::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:01,724::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:01,726::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137462::DEBUG::2014-10-29 11:29:01,729::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137462::DEBUG::2014-10-29 11:29:01,731::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:01,855::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:01,856::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:01,857::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:29:03,243::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54877 >Detector thread::DEBUG::2014-10-29 11:29:03,244::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54877 >Detector thread::DEBUG::2014-10-29 11:29:03,244::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54877 >Detector thread::DEBUG::2014-10-29 11:29:03,245::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54877) >Thread-137463::DEBUG::2014-10-29 11:29:03,284::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137463::DEBUG::2014-10-29 11:29:03,285::task::595::Storage.TaskManager.Task::(_updateState) Task=`c7dc9bdf-d6be-4070-8ba0-78328676e8e4`::moving from state init -> state preparing >Thread-137463::INFO::2014-10-29 11:29:03,286::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137463::DEBUG::2014-10-29 11:29:03,290::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:29:03,295::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:03,295::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:03,296::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-137463::DEBUG::2014-10-29 11:29:03,296::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:29:03,297::__init__::232::IOProcess::(_processLogs) (202621) Got request for method 'glob' >Thread-137463::DEBUG::2014-10-29 11:29:03,299::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-17::DEBUG::2014-10-29 11:29:03,299::__init__::232::IOProcess::(_processLogs) (202621) Queuing response >Thread-137463::INFO::2014-10-29 11:29:03,300::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137463::DEBUG::2014-10-29 11:29:03,301::task::1191::Storage.TaskManager.Task::(prepare) Task=`c7dc9bdf-d6be-4070-8ba0-78328676e8e4`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137463::DEBUG::2014-10-29 11:29:03,301::task::595::Storage.TaskManager.Task::(_updateState) Task=`c7dc9bdf-d6be-4070-8ba0-78328676e8e4`::moving from state preparing -> state finished >Thread-137463::DEBUG::2014-10-29 11:29:03,302::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137463::DEBUG::2014-10-29 11:29:03,302::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137463::DEBUG::2014-10-29 11:29:03,302::task::993::Storage.TaskManager.Task::(_decref) Task=`c7dc9bdf-d6be-4070-8ba0-78328676e8e4`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:29:03,356::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54878 >Detector thread::DEBUG::2014-10-29 11:29:03,357::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54878 >Detector thread::DEBUG::2014-10-29 11:29:03,357::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54878 >Detector thread::DEBUG::2014-10-29 11:29:03,358::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54878) >Thread-137464::DEBUG::2014-10-29 11:29:03,397::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137464::DEBUG::2014-10-29 11:29:03,397::task::595::Storage.TaskManager.Task::(_updateState) Task=`176ad7af-f795-4d51-9cd1-e0c44f225a01`::moving from state init -> state preparing >Thread-137464::INFO::2014-10-29 11:29:03,398::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137464::DEBUG::2014-10-29 11:29:03,398::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137464::DEBUG::2014-10-29 11:29:03,398::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137464::DEBUG::2014-10-29 11:29:03,399::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137464::DEBUG::2014-10-29 11:29:03,399::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137464::DEBUG::2014-10-29 11:29:03,399::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137464::DEBUG::2014-10-29 11:29:03,400::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137464::DEBUG::2014-10-29 11:29:03,482::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137464::DEBUG::2014-10-29 11:29:03,483::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137464::DEBUG::2014-10-29 11:29:03,653::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137464::DEBUG::2014-10-29 11:29:03,654::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137464::DEBUG::2014-10-29 11:29:03,654::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137464::DEBUG::2014-10-29 11:29:03,655::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137464::DEBUG::2014-10-29 11:29:03,655::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137464::DEBUG::2014-10-29 11:29:03,656::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137464::DEBUG::2014-10-29 11:29:03,656::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137464::DEBUG::2014-10-29 11:29:03,656::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:29:03,662::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:03,664::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:03,665::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:03,665::__init__::232::IOProcess::(_processLogs) (202622) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:29:03,666::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202622) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:03,668::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:03,669::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:03,670::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:03,670::__init__::232::IOProcess::(_processLogs) (202623) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:29:03,671::__init__::232::IOProcess::(_processLogs) (202623) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:03,671::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:03,674::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:03,677::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:03,679::__init__::232::IOProcess::(_processLogs) (202624) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:29:03,679::__init__::232::IOProcess::(_processLogs) (202624) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:03,680::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:03,680::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:03,682::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:03,684::__init__::232::IOProcess::(_processLogs) (202625) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:29:03,686::__init__::232::IOProcess::(_processLogs) (202625) Queuing response >Thread-137464::DEBUG::2014-10-29 11:29:03,686::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:29:03,691::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:03,691::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:03,691::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:03,691::__init__::232::IOProcess::(_processLogs) (202626) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:29:03,692::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202626) Queuing response >Thread-137464::DEBUG::2014-10-29 11:29:03,693::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:29:03,694::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:03,694::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:03,694::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:03,695::__init__::232::IOProcess::(_processLogs) (202627) Got request for method 'readfile' >Thread-137464::DEBUG::2014-10-29 11:29:03,696::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:29:03,696::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202627) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:03,698::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:03,699::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:03,699::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:03,700::__init__::232::IOProcess::(_processLogs) (202628) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:03,700::__init__::232::IOProcess::(_processLogs) (202628) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:03,701::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:03,701::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137464::DEBUG::2014-10-29 11:29:03,702::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:29:03,702::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-137464::INFO::2014-10-29 11:29:03,703::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:29:03,704::__init__::232::IOProcess::(_processLogs) (202629) Got request for method 'glob' >Thread-137464::INFO::2014-10-29 11:29:03,704::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:29:03,706::__init__::232::IOProcess::(_processLogs) (202629) Queuing response >Thread-137464::INFO::2014-10-29 11:29:03,706::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:29:03,708::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:03,708::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:03,708::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:03,708::__init__::232::IOProcess::(_processLogs) (202630) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:29:03,709::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202630) Queuing response >Thread-137464::DEBUG::2014-10-29 11:29:03,709::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137464::DEBUG::2014-10-29 11:29:03,712::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`bd2eb6e2-aaf9-4a78-b8cb-3f185fbd018e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137464::DEBUG::2014-10-29 11:29:03,712::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137464::DEBUG::2014-10-29 11:29:03,712::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137464::DEBUG::2014-10-29 11:29:03,713::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`bd2eb6e2-aaf9-4a78-b8cb-3f185fbd018e`::Granted request >Thread-137464::DEBUG::2014-10-29 11:29:03,713::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`176ad7af-f795-4d51-9cd1-e0c44f225a01`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137464::DEBUG::2014-10-29 11:29:03,714::task::993::Storage.TaskManager.Task::(_decref) Task=`176ad7af-f795-4d51-9cd1-e0c44f225a01`::ref 1 aborting False >Thread-137464::INFO::2014-10-29 11:29:03,716::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137464::DEBUG::2014-10-29 11:29:03,717::task::1191::Storage.TaskManager.Task::(prepare) Task=`176ad7af-f795-4d51-9cd1-e0c44f225a01`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137464::DEBUG::2014-10-29 11:29:03,717::task::595::Storage.TaskManager.Task::(_updateState) Task=`176ad7af-f795-4d51-9cd1-e0c44f225a01`::moving from state preparing -> state finished >Thread-137464::DEBUG::2014-10-29 11:29:03,717::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137464::DEBUG::2014-10-29 11:29:03,717::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137464::DEBUG::2014-10-29 11:29:03,718::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137464::DEBUG::2014-10-29 11:29:03,718::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137464::DEBUG::2014-10-29 11:29:03,718::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137464::DEBUG::2014-10-29 11:29:03,719::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137464::DEBUG::2014-10-29 11:29:03,719::task::993::Storage.TaskManager.Task::(_decref) Task=`176ad7af-f795-4d51-9cd1-e0c44f225a01`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:29:03,739::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54879 >Detector thread::DEBUG::2014-10-29 11:29:03,740::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54879 >Detector thread::DEBUG::2014-10-29 11:29:03,740::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54879 >Detector thread::DEBUG::2014-10-29 11:29:03,740::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54879) >Thread-137469::DEBUG::2014-10-29 11:29:03,779::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137469::DEBUG::2014-10-29 11:29:03,779::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1a5fd16-33df-4b36-92ea-3c7e53530e46`::moving from state init -> state preparing >Thread-137469::INFO::2014-10-29 11:29:03,780::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137469::INFO::2014-10-29 11:29:03,780::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060963', 'lastCheck': '3.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049094', 'lastCheck': '3.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049485', 'lastCheck': '4.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0005236', 'lastCheck': '3.9', 'valid': True}} >Thread-137469::DEBUG::2014-10-29 11:29:03,781::task::1191::Storage.TaskManager.Task::(prepare) Task=`e1a5fd16-33df-4b36-92ea-3c7e53530e46`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00060963', 'lastCheck': '3.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049094', 'lastCheck': '3.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049485', 'lastCheck': '4.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0005236', 'lastCheck': '3.9', 'valid': True}} >Thread-137469::DEBUG::2014-10-29 11:29:03,781::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1a5fd16-33df-4b36-92ea-3c7e53530e46`::moving from state preparing -> state finished >Thread-137469::DEBUG::2014-10-29 11:29:03,781::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137469::DEBUG::2014-10-29 11:29:03,781::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137469::DEBUG::2014-10-29 11:29:03,782::task::993::Storage.TaskManager.Task::(_decref) Task=`e1a5fd16-33df-4b36-92ea-3c7e53530e46`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:04,745::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:04,750::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137470::DEBUG::2014-10-29 11:29:04,753::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:04,755::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:04,757::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137471::DEBUG::2014-10-29 11:29:04,761::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137471::DEBUG::2014-10-29 11:29:04,763::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:29:04,819::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >Thread-22::DEBUG::2014-10-29 11:29:06,011::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:06,864::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:06,865::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:06,866::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:07,778::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:07,781::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137472::DEBUG::2014-10-29 11:29:07,785::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:07,787::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:07,789::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137473::DEBUG::2014-10-29 11:29:07,792::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137473::DEBUG::2014-10-29 11:29:07,795::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:29:09,800::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:09,800::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:09,800::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:09,801::__init__::232::IOProcess::(_processLogs) (202631) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:09,802::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202631) Queuing response >Thread-179::DEBUG::2014-10-29 11:29:09,803::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:29:09,822::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000412723 s, 901 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:29:09,824::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:09,824::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:09,825::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:09,825::__init__::232::IOProcess::(_processLogs) (202632) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:09,827::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202632) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:09,840::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:09,840::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:09,841::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:09,841::__init__::232::IOProcess::(_processLogs) (202633) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:09,841::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202633) Queuing response >Thread-10269::DEBUG::2014-10-29 11:29:09,843::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:29:09,859::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000444133 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:29:09,861::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:09,862::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:09,862::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:09,862::__init__::232::IOProcess::(_processLogs) (202634) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:09,864::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202634) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:09,946::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:09,947::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:09,947::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:09,947::__init__::232::IOProcess::(_processLogs) (202635) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:09,949::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202635) Queuing response >Thread-33::DEBUG::2014-10-29 11:29:09,950::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:29:09,968::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000540525 s, 901 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:29:09,970::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:09,970::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:09,970::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:09,972::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202636) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:09,973::__init__::232::IOProcess::(_processLogs) (202636) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:09,974::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:09,974::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:09,974::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:09,975::__init__::232::IOProcess::(_processLogs) (202637) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:09,975::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202637) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:09,977::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:09,977::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:09,977::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:09,977::__init__::232::IOProcess::(_processLogs) (202638) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:09,978::__init__::232::IOProcess::(_processLogs) (202638) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:09,979::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:09,979::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:09,979::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:09,980::__init__::232::IOProcess::(_processLogs) (202639) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:09,980::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202639) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:10,034::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:10,034::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:10,035::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:10,035::__init__::232::IOProcess::(_processLogs) (202640) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:10,036::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202640) Queuing response >Thread-178::DEBUG::2014-10-29 11:29:10,038::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:29:10,055::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000517408 s, 982 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:29:10,056::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:10,057::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:10,057::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:10,057::__init__::232::IOProcess::(_processLogs) (202641) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:10,058::__init__::232::IOProcess::(_processLogs) (202641) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:10,060::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:10,061::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:10,062::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:10,062::__init__::232::IOProcess::(_processLogs) (202642) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:10,062::__init__::232::IOProcess::(_processLogs) (202642) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:10,063::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:10,063::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:10,064::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:10,064::__init__::232::IOProcess::(_processLogs) (202643) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:10,065::__init__::232::IOProcess::(_processLogs) (202643) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:10,065::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:10,066::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:10,067::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:10,068::__init__::232::IOProcess::(_processLogs) (202644) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:10,068::__init__::232::IOProcess::(_processLogs) (202644) Queuing response >Detector thread::DEBUG::2014-10-29 11:29:10,304::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54880 >Detector thread::DEBUG::2014-10-29 11:29:10,304::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54880 >Detector thread::DEBUG::2014-10-29 11:29:10,305::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54880 >Detector thread::DEBUG::2014-10-29 11:29:10,305::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54880) >Thread-137474::DEBUG::2014-10-29 11:29:10,346::task::595::Storage.TaskManager.Task::(_updateState) Task=`2da2f772-20f9-4cd3-9aaa-af4d93288ffb`::moving from state init -> state preparing >Thread-137474::INFO::2014-10-29 11:29:10,347::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137474::INFO::2014-10-29 11:29:10,348::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517408', 'lastCheck': '0.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540525', 'lastCheck': '0.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000412723', 'lastCheck': '0.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000444133', 'lastCheck': '0.5', 'valid': True}} >Thread-137474::DEBUG::2014-10-29 11:29:10,348::task::1191::Storage.TaskManager.Task::(prepare) Task=`2da2f772-20f9-4cd3-9aaa-af4d93288ffb`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517408', 'lastCheck': '0.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540525', 'lastCheck': '0.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000412723', 'lastCheck': '0.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000444133', 'lastCheck': '0.5', 'valid': True}} >Thread-137474::DEBUG::2014-10-29 11:29:10,348::task::595::Storage.TaskManager.Task::(_updateState) Task=`2da2f772-20f9-4cd3-9aaa-af4d93288ffb`::moving from state preparing -> state finished >Thread-137474::DEBUG::2014-10-29 11:29:10,348::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137474::DEBUG::2014-10-29 11:29:10,349::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137474::DEBUG::2014-10-29 11:29:10,349::task::993::Storage.TaskManager.Task::(_decref) Task=`2da2f772-20f9-4cd3-9aaa-af4d93288ffb`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:10,809::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:10,812::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137475::DEBUG::2014-10-29 11:29:10,816::task::595::Storage.TaskManager.Task::(_updateState) Task=`321676ac-7cfd-406f-b8f0-68c017d0cb29`::moving from state init -> state preparing >Thread-137475::INFO::2014-10-29 11:29:10,816::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137475::INFO::2014-10-29 11:29:10,817::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517408', 'lastCheck': '0.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540525', 'lastCheck': '0.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000412723', 'lastCheck': '1.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000444133', 'lastCheck': '1.0', 'valid': True}} >Thread-137475::DEBUG::2014-10-29 11:29:10,817::task::1191::Storage.TaskManager.Task::(prepare) Task=`321676ac-7cfd-406f-b8f0-68c017d0cb29`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517408', 'lastCheck': '0.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540525', 'lastCheck': '0.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000412723', 'lastCheck': '1.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000444133', 'lastCheck': '1.0', 'valid': True}} >Thread-137475::DEBUG::2014-10-29 11:29:10,817::task::595::Storage.TaskManager.Task::(_updateState) Task=`321676ac-7cfd-406f-b8f0-68c017d0cb29`::moving from state preparing -> state finished >Thread-137475::DEBUG::2014-10-29 11:29:10,818::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137475::DEBUG::2014-10-29 11:29:10,818::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137475::DEBUG::2014-10-29 11:29:10,818::task::993::Storage.TaskManager.Task::(_decref) Task=`321676ac-7cfd-406f-b8f0-68c017d0cb29`::ref 0 aborting False >Thread-137475::DEBUG::2014-10-29 11:29:10,838::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:10,862::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:10,864::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137476::DEBUG::2014-10-29 11:29:10,868::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137476::DEBUG::2014-10-29 11:29:10,870::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:29:11,217::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54881 >Detector thread::DEBUG::2014-10-29 11:29:11,218::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54881 >Detector thread::DEBUG::2014-10-29 11:29:11,218::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54881 >Detector thread::DEBUG::2014-10-29 11:29:11,219::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54881) >Thread-137477::DEBUG::2014-10-29 11:29:11,257::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137477::DEBUG::2014-10-29 11:29:11,258::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137477::DEBUG::2014-10-29 11:29:11,259::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.18', 'elapsedTime': '514783', 'displayType': 'vnc', 'cpuSys': '1.33', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '2436045', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '59879', 'readRate': '0.00', 'truesize': '6010904576', 'writeRate': '35691.50'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.24', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:29:11,386::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54883 >Detector thread::DEBUG::2014-10-29 11:29:11,387::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54883 >Detector thread::DEBUG::2014-10-29 11:29:11,387::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54883 >Detector thread::DEBUG::2014-10-29 11:29:11,388::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54883) >Thread-137478::DEBUG::2014-10-29 11:29:11,427::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137478::DEBUG::2014-10-29 11:29:11,429::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137478::DEBUG::2014-10-29 11:29:11,460::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137478::DEBUG::2014-10-29 11:29:11,507::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '190', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '90', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:11,874::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:11,875::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:11,941::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:13,914::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:13,916::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137479::DEBUG::2014-10-29 11:29:13,921::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:13,923::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:13,925::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137480::DEBUG::2014-10-29 11:29:13,929::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137480::DEBUG::2014-10-29 11:29:13,931::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:29:14,612::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54885 >Detector thread::DEBUG::2014-10-29 11:29:14,612::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54885 >Detector thread::DEBUG::2014-10-29 11:29:14,613::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54885 >Detector thread::DEBUG::2014-10-29 11:29:14,613::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54885) >Thread-137481::DEBUG::2014-10-29 11:29:14,653::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137481::DEBUG::2014-10-29 11:29:14,654::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ddaab8d-f505-4887-8b8a-1d28c1a8866c`::moving from state init -> state preparing >Thread-137481::INFO::2014-10-29 11:29:14,654::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137481::DEBUG::2014-10-29 11:29:14,658::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:29:14,659::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:14,659::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:14,659::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:14,660::__init__::232::IOProcess::(_processLogs) (202645) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:29:14,660::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202645) Queuing response >Thread-137481::DEBUG::2014-10-29 11:29:14,661::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137481::DEBUG::2014-10-29 11:29:14,662::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137481::INFO::2014-10-29 11:29:14,662::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137481::DEBUG::2014-10-29 11:29:14,662::task::1191::Storage.TaskManager.Task::(prepare) Task=`4ddaab8d-f505-4887-8b8a-1d28c1a8866c`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137481::DEBUG::2014-10-29 11:29:14,663::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ddaab8d-f505-4887-8b8a-1d28c1a8866c`::moving from state preparing -> state finished >Thread-137481::DEBUG::2014-10-29 11:29:14,663::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137481::DEBUG::2014-10-29 11:29:14,663::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137481::DEBUG::2014-10-29 11:29:14,664::task::993::Storage.TaskManager.Task::(_decref) Task=`4ddaab8d-f505-4887-8b8a-1d28c1a8866c`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:29:14,707::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54886 >Detector thread::DEBUG::2014-10-29 11:29:14,708::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54886 >Detector thread::DEBUG::2014-10-29 11:29:14,708::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54886 >Detector thread::DEBUG::2014-10-29 11:29:14,709::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54886) >Thread-137482::DEBUG::2014-10-29 11:29:14,749::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137482::DEBUG::2014-10-29 11:29:14,749::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e994f8e-df3a-4aa0-886a-afe2d40bd5df`::moving from state init -> state preparing >Thread-137482::INFO::2014-10-29 11:29:14,750::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137482::DEBUG::2014-10-29 11:29:14,750::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137482::DEBUG::2014-10-29 11:29:14,751::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137482::DEBUG::2014-10-29 11:29:14,751::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137482::DEBUG::2014-10-29 11:29:14,751::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137482::DEBUG::2014-10-29 11:29:14,751::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137482::DEBUG::2014-10-29 11:29:14,752::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137482::DEBUG::2014-10-29 11:29:14,829::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137482::DEBUG::2014-10-29 11:29:14,831::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137482::DEBUG::2014-10-29 11:29:14,987::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137482::DEBUG::2014-10-29 11:29:14,988::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137482::DEBUG::2014-10-29 11:29:14,989::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137482::DEBUG::2014-10-29 11:29:14,989::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137482::DEBUG::2014-10-29 11:29:14,989::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137482::DEBUG::2014-10-29 11:29:14,990::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137482::DEBUG::2014-10-29 11:29:14,990::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137482::DEBUG::2014-10-29 11:29:14,990::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:29:14,998::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:15,000::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:15,000::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:15,001::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202646) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:29:15,003::__init__::232::IOProcess::(_processLogs) (202646) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:15,004::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:15,006::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:15,008::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:15,009::__init__::232::IOProcess::(_processLogs) (202647) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:29:15,012::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:15,013::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:15,016::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:15,018::__init__::232::IOProcess::(_processLogs) (202648) Got request for method 'glob' >Thread-137482::DEBUG::2014-10-29 11:29:15,019::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:29:15,020::__init__::232::IOProcess::(_processLogs) (202647) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:15,022::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:15,022::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:15,022::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:15,022::__init__::232::IOProcess::(_processLogs) (202649) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:29:15,023::__init__::232::IOProcess::(_processLogs) (202648) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:15,023::__init__::232::IOProcess::(_processLogs) (202649) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:15,025::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:15,026::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:15,026::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:15,026::__init__::232::IOProcess::(_processLogs) (202650) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:29:15,027::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202650) Queuing response >Thread-137482::DEBUG::2014-10-29 11:29:15,028::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:29:15,030::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:15,030::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:15,031::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:15,031::__init__::232::IOProcess::(_processLogs) (202651) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:29:15,032::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202651) Queuing response >Thread-137482::DEBUG::2014-10-29 11:29:15,032::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:29:15,034::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:15,034::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:15,035::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:15,036::__init__::232::IOProcess::(_processLogs) (202652) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:15,036::__init__::232::IOProcess::(_processLogs) (202652) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:15,036::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:15,037::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:15,037::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:15,037::__init__::232::IOProcess::(_processLogs) (202653) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:29:15,038::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202653) Queuing response >Thread-137482::DEBUG::2014-10-29 11:29:15,038::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-137482::INFO::2014-10-29 11:29:15,039::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137482::INFO::2014-10-29 11:29:15,040::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137482::INFO::2014-10-29 11:29:15,040::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:29:15,041::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:15,041::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:15,041::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:15,042::__init__::232::IOProcess::(_processLogs) (202654) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:29:15,043::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202654) Queuing response >Thread-137482::DEBUG::2014-10-29 11:29:15,043::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137482::DEBUG::2014-10-29 11:29:15,045::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`ebda6ed7-b8d2-461a-b882-5cfa037378dd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137482::DEBUG::2014-10-29 11:29:15,046::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137482::DEBUG::2014-10-29 11:29:15,046::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137482::DEBUG::2014-10-29 11:29:15,046::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`ebda6ed7-b8d2-461a-b882-5cfa037378dd`::Granted request >Thread-137482::DEBUG::2014-10-29 11:29:15,047::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0e994f8e-df3a-4aa0-886a-afe2d40bd5df`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137482::DEBUG::2014-10-29 11:29:15,047::task::993::Storage.TaskManager.Task::(_decref) Task=`0e994f8e-df3a-4aa0-886a-afe2d40bd5df`::ref 1 aborting False >Thread-137482::INFO::2014-10-29 11:29:15,050::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137482::DEBUG::2014-10-29 11:29:15,050::task::1191::Storage.TaskManager.Task::(prepare) Task=`0e994f8e-df3a-4aa0-886a-afe2d40bd5df`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137482::DEBUG::2014-10-29 11:29:15,051::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e994f8e-df3a-4aa0-886a-afe2d40bd5df`::moving from state preparing -> state finished >Thread-137482::DEBUG::2014-10-29 11:29:15,051::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137482::DEBUG::2014-10-29 11:29:15,051::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137482::DEBUG::2014-10-29 11:29:15,052::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137482::DEBUG::2014-10-29 11:29:15,052::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137482::DEBUG::2014-10-29 11:29:15,052::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137482::DEBUG::2014-10-29 11:29:15,052::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137482::DEBUG::2014-10-29 11:29:15,053::task::993::Storage.TaskManager.Task::(_decref) Task=`0e994f8e-df3a-4aa0-886a-afe2d40bd5df`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:29:15,077::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54887 >Detector thread::DEBUG::2014-10-29 11:29:15,077::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54887 >Detector thread::DEBUG::2014-10-29 11:29:15,078::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54887 >Detector thread::DEBUG::2014-10-29 11:29:15,078::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54887) >Thread-137487::DEBUG::2014-10-29 11:29:15,117::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137487::DEBUG::2014-10-29 11:29:15,118::task::595::Storage.TaskManager.Task::(_updateState) Task=`06cb4765-eb43-45c7-9f20-0a6044639f45`::moving from state init -> state preparing >Thread-137487::INFO::2014-10-29 11:29:15,118::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137487::INFO::2014-10-29 11:29:15,119::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517408', 'lastCheck': '5.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540525', 'lastCheck': '5.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000412723', 'lastCheck': '5.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000444133', 'lastCheck': '5.3', 'valid': True}} >Thread-137487::DEBUG::2014-10-29 11:29:15,119::task::1191::Storage.TaskManager.Task::(prepare) Task=`06cb4765-eb43-45c7-9f20-0a6044639f45`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517408', 'lastCheck': '5.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540525', 'lastCheck': '5.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000412723', 'lastCheck': '5.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000444133', 'lastCheck': '5.3', 'valid': True}} >Thread-137487::DEBUG::2014-10-29 11:29:15,119::task::595::Storage.TaskManager.Task::(_updateState) Task=`06cb4765-eb43-45c7-9f20-0a6044639f45`::moving from state preparing -> state finished >Thread-137487::DEBUG::2014-10-29 11:29:15,120::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137487::DEBUG::2014-10-29 11:29:15,120::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137487::DEBUG::2014-10-29 11:29:15,120::task::993::Storage.TaskManager.Task::(_decref) Task=`06cb4765-eb43-45c7-9f20-0a6044639f45`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:16,952::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:16,953::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:16,962::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpcServer::DEBUG::2014-10-29 11:29:16,965::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:16,976::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137488::DEBUG::2014-10-29 11:29:16,978::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:16,985::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:16,990::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137489::DEBUG::2014-10-29 11:29:16,997::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137489::DEBUG::2014-10-29 11:29:17,013::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:29:19,831::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:19,832::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:19,832::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:19,832::__init__::232::IOProcess::(_processLogs) (202655) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:19,834::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202655) Queuing response >Thread-179::DEBUG::2014-10-29 11:29:19,836::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:29:19,855::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000462141 s, 805 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:29:19,857::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:19,857::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:19,859::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:19,860::__init__::232::IOProcess::(_processLogs) (202656) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:19,860::__init__::232::IOProcess::(_processLogs) (202656) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:19,866::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:19,867::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:19,867::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:19,868::__init__::232::IOProcess::(_processLogs) (202657) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:19,869::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202657) Queuing response >Thread-10269::DEBUG::2014-10-29 11:29:19,871::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:29:19,889::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000523359 s, 959 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:29:19,891::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:19,891::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:19,892::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:19,894::__init__::232::IOProcess::(_processLogs) (202658) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:19,895::__init__::232::IOProcess::(_processLogs) (202658) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:19,982::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:19,982::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:19,983::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:19,983::__init__::232::IOProcess::(_processLogs) (202659) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:19,984::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202659) Queuing response >Thread-33::DEBUG::2014-10-29 11:29:19,986::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:29:20,002::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000544427 s, 895 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:29:20,004::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:20,004::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:20,005::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:20,005::__init__::232::IOProcess::(_processLogs) (202660) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:20,005::__init__::232::IOProcess::(_processLogs) (202660) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:20,007::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:20,008::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:20,008::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:20,008::__init__::232::IOProcess::(_processLogs) (202661) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:20,009::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202661) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:20,010::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:20,010::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:20,011::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:20,011::__init__::232::IOProcess::(_processLogs) (202662) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:20,012::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202662) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:20,013::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:20,013::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:20,013::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:20,013::__init__::232::IOProcess::(_processLogs) (202663) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:20,014::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202663) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:20,028::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:20,031::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137490::DEBUG::2014-10-29 11:29:20,035::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:20,037::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:20,039::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137491::DEBUG::2014-10-29 11:29:20,042::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137491::DEBUG::2014-10-29 11:29:20,044::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:29:20,068::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:20,069::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:20,069::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:20,069::__init__::232::IOProcess::(_processLogs) (202664) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:20,071::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202664) Queuing response >Thread-178::DEBUG::2014-10-29 11:29:20,072::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:29:20,090::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00134137 s, 379 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:29:20,092::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:20,092::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:20,093::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:20,093::__init__::232::IOProcess::(_processLogs) (202665) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:20,093::__init__::232::IOProcess::(_processLogs) (202665) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:20,095::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:20,096::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:20,096::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:20,096::__init__::232::IOProcess::(_processLogs) (202666) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:20,097::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202666) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:20,098::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:20,099::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:20,099::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:20,099::__init__::232::IOProcess::(_processLogs) (202667) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:20,100::__init__::232::IOProcess::(_processLogs) (202667) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:20,101::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:20,101::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:20,101::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:20,101::__init__::232::IOProcess::(_processLogs) (202668) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:20,102::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202668) Queuing response >Detector thread::DEBUG::2014-10-29 11:29:20,423::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54888 >Detector thread::DEBUG::2014-10-29 11:29:20,424::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54888 >Detector thread::DEBUG::2014-10-29 11:29:20,424::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54888 >Detector thread::DEBUG::2014-10-29 11:29:20,425::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54888) >Detector thread::DEBUG::2014-10-29 11:29:20,440::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54889 >Detector thread::DEBUG::2014-10-29 11:29:20,440::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54889 >Detector thread::DEBUG::2014-10-29 11:29:20,441::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54889 >Detector thread::DEBUG::2014-10-29 11:29:20,441::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54889) >Thread-137492::DEBUG::2014-10-29 11:29:20,463::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137492::DEBUG::2014-10-29 11:29:20,464::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137492::DEBUG::2014-10-29 11:29:20,465::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.18', 'elapsedTime': '514792', 'displayType': 'vnc', 'cpuSys': '1.33', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '2436045', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '59879', 'readRate': '0.00', 'truesize': '6010904576', 'writeRate': '35691.50'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.45', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-137493::DEBUG::2014-10-29 11:29:20,482::task::595::Storage.TaskManager.Task::(_updateState) Task=`8fff940d-b3cc-40b9-a8a9-9890fc51b257`::moving from state init -> state preparing >Thread-137493::INFO::2014-10-29 11:29:20,483::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137493::INFO::2014-10-29 11:29:20,484::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00134137', 'lastCheck': '0.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544427', 'lastCheck': '0.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462141', 'lastCheck': '0.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000523359', 'lastCheck': '0.6', 'valid': True}} >Thread-137493::DEBUG::2014-10-29 11:29:20,484::task::1191::Storage.TaskManager.Task::(prepare) Task=`8fff940d-b3cc-40b9-a8a9-9890fc51b257`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00134137', 'lastCheck': '0.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544427', 'lastCheck': '0.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462141', 'lastCheck': '0.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000523359', 'lastCheck': '0.6', 'valid': True}} >Thread-137493::DEBUG::2014-10-29 11:29:20,484::task::595::Storage.TaskManager.Task::(_updateState) Task=`8fff940d-b3cc-40b9-a8a9-9890fc51b257`::moving from state preparing -> state finished >Thread-137493::DEBUG::2014-10-29 11:29:20,484::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137493::DEBUG::2014-10-29 11:29:20,485::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137493::DEBUG::2014-10-29 11:29:20,485::task::993::Storage.TaskManager.Task::(_decref) Task=`8fff940d-b3cc-40b9-a8a9-9890fc51b257`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:29:21,036::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Detector thread::DEBUG::2014-10-29 11:29:21,556::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54891 >Detector thread::DEBUG::2014-10-29 11:29:21,556::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54891 >Detector thread::DEBUG::2014-10-29 11:29:21,557::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54891 >Detector thread::DEBUG::2014-10-29 11:29:21,557::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54891) >Thread-137494::DEBUG::2014-10-29 11:29:21,596::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137494::DEBUG::2014-10-29 11:29:21,598::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137494::DEBUG::2014-10-29 11:29:21,615::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137494::DEBUG::2014-10-29 11:29:21,684::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '173', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '73', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:21,985::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:21,986::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:21,988::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:23,060::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:23,064::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137495::DEBUG::2014-10-29 11:29:23,067::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:23,072::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:23,074::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137496::DEBUG::2014-10-29 11:29:23,078::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137496::DEBUG::2014-10-29 11:29:23,080::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:29:25,712::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54893 >Detector thread::DEBUG::2014-10-29 11:29:25,713::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54893 >Detector thread::DEBUG::2014-10-29 11:29:25,714::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54893 >Detector thread::DEBUG::2014-10-29 11:29:25,714::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54893) >Thread-137497::DEBUG::2014-10-29 11:29:25,754::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137497::DEBUG::2014-10-29 11:29:25,755::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1d3a9f4-097f-4a00-bbae-453c2b504239`::moving from state init -> state preparing >Thread-137497::INFO::2014-10-29 11:29:25,755::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137497::DEBUG::2014-10-29 11:29:25,760::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:29:25,761::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:25,761::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:25,761::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:25,762::__init__::232::IOProcess::(_processLogs) (202669) Got request for method 'glob' >Thread-137497::DEBUG::2014-10-29 11:29:25,762::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:29:25,763::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202669) Queuing response >Thread-137497::DEBUG::2014-10-29 11:29:25,764::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137497::INFO::2014-10-29 11:29:25,764::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137497::DEBUG::2014-10-29 11:29:25,765::task::1191::Storage.TaskManager.Task::(prepare) Task=`f1d3a9f4-097f-4a00-bbae-453c2b504239`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137497::DEBUG::2014-10-29 11:29:25,765::task::595::Storage.TaskManager.Task::(_updateState) Task=`f1d3a9f4-097f-4a00-bbae-453c2b504239`::moving from state preparing -> state finished >Thread-137497::DEBUG::2014-10-29 11:29:25,765::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137497::DEBUG::2014-10-29 11:29:25,766::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137497::DEBUG::2014-10-29 11:29:25,766::task::993::Storage.TaskManager.Task::(_decref) Task=`f1d3a9f4-097f-4a00-bbae-453c2b504239`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:29:25,809::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54894 >Detector thread::DEBUG::2014-10-29 11:29:25,810::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54894 >Detector thread::DEBUG::2014-10-29 11:29:25,810::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54894 >Detector thread::DEBUG::2014-10-29 11:29:25,811::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54894) >Thread-137498::DEBUG::2014-10-29 11:29:25,849::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137498::DEBUG::2014-10-29 11:29:25,850::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8033c4a-fd16-4f75-b461-b234a1945656`::moving from state init -> state preparing >Thread-137498::INFO::2014-10-29 11:29:25,850::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137498::DEBUG::2014-10-29 11:29:25,850::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137498::DEBUG::2014-10-29 11:29:25,851::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137498::DEBUG::2014-10-29 11:29:25,851::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137498::DEBUG::2014-10-29 11:29:25,851::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137498::DEBUG::2014-10-29 11:29:25,851::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137498::DEBUG::2014-10-29 11:29:25,852::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137498::DEBUG::2014-10-29 11:29:25,945::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137498::DEBUG::2014-10-29 11:29:25,945::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:26,110::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:26,115::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137499::DEBUG::2014-10-29 11:29:26,119::task::595::Storage.TaskManager.Task::(_updateState) Task=`972f531b-c7cf-40e3-870a-932f7c8f75bd`::moving from state init -> state preparing >Thread-137499::INFO::2014-10-29 11:29:26,120::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137499::INFO::2014-10-29 11:29:26,120::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00134137', 'lastCheck': '6.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544427', 'lastCheck': '6.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462141', 'lastCheck': '6.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000523359', 'lastCheck': '6.2', 'valid': True}} >Thread-137499::DEBUG::2014-10-29 11:29:26,121::task::1191::Storage.TaskManager.Task::(prepare) Task=`972f531b-c7cf-40e3-870a-932f7c8f75bd`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00134137', 'lastCheck': '6.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544427', 'lastCheck': '6.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462141', 'lastCheck': '6.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000523359', 'lastCheck': '6.2', 'valid': True}} >Thread-137499::DEBUG::2014-10-29 11:29:26,121::task::595::Storage.TaskManager.Task::(_updateState) Task=`972f531b-c7cf-40e3-870a-932f7c8f75bd`::moving from state preparing -> state finished >Thread-137499::DEBUG::2014-10-29 11:29:26,121::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137499::DEBUG::2014-10-29 11:29:26,122::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137499::DEBUG::2014-10-29 11:29:26,122::task::993::Storage.TaskManager.Task::(_decref) Task=`972f531b-c7cf-40e3-870a-932f7c8f75bd`::ref 0 aborting False >Thread-137498::DEBUG::2014-10-29 11:29:26,149::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137498::DEBUG::2014-10-29 11:29:26,150::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137498::DEBUG::2014-10-29 11:29:26,151::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137498::DEBUG::2014-10-29 11:29:26,151::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137498::DEBUG::2014-10-29 11:29:26,151::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137498::DEBUG::2014-10-29 11:29:26,152::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137498::DEBUG::2014-10-29 11:29:26,152::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137498::DEBUG::2014-10-29 11:29:26,152::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:29:26,160::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:26,163::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:26,164::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:26,165::__init__::232::IOProcess::(_processLogs) (202670) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:29:26,168::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202670) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:26,172::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:26,174::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:26,175::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:26,177::__init__::232::IOProcess::(_processLogs) (202671) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:29:26,180::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202671) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:26,186::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:26,188::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:26,190::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:26,192::__init__::232::IOProcess::(_processLogs) (202672) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:29:26,198::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202672) Queuing response >Thread-137498::DEBUG::2014-10-29 11:29:26,201::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:29:26,203::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:26,205::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:26,206::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:26,207::__init__::232::IOProcess::(_processLogs) (202673) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:29:26,211::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202673) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:26,214::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:26,215::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:26,218::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-137498::DEBUG::2014-10-29 11:29:26,218::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:29:26,220::__init__::232::IOProcess::(_processLogs) (202674) Got request for method 'touch' >Thread-137499::DEBUG::2014-10-29 11:29:26,223::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:29:26,223::__init__::232::IOProcess::(_processLogs) (202674) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:26,227::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:26,228::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-137498::DEBUG::2014-10-29 11:29:26,228::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:29:26,230::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:26,231::__init__::232::IOProcess::(_processLogs) (202675) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:29:26,233::__init__::232::IOProcess::(_processLogs) (202675) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:26,233::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:26,234::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:26,235::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:26,235::__init__::232::IOProcess::(_processLogs) (202676) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:26,235::__init__::232::IOProcess::(_processLogs) (202676) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:26,236::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:26,236::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:26,236::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:26,237::__init__::232::IOProcess::(_processLogs) (202677) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:29:26,237::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202677) Queuing response >Thread-137498::DEBUG::2014-10-29 11:29:26,237::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-137498::INFO::2014-10-29 11:29:26,239::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137498::INFO::2014-10-29 11:29:26,239::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137498::INFO::2014-10-29 11:29:26,240::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:29:26,240::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:26,241::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:26,241::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:26,241::__init__::232::IOProcess::(_processLogs) (202678) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:29:26,242::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202678) Queuing response >Thread-137498::DEBUG::2014-10-29 11:29:26,242::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137498::DEBUG::2014-10-29 11:29:26,245::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`f0fcccf3-012b-465d-860c-b30bab0beb9f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137498::DEBUG::2014-10-29 11:29:26,245::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137498::DEBUG::2014-10-29 11:29:26,245::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137498::DEBUG::2014-10-29 11:29:26,246::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`f0fcccf3-012b-465d-860c-b30bab0beb9f`::Granted request >Thread-137498::DEBUG::2014-10-29 11:29:26,246::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f8033c4a-fd16-4f75-b461-b234a1945656`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137498::DEBUG::2014-10-29 11:29:26,246::task::993::Storage.TaskManager.Task::(_decref) Task=`f8033c4a-fd16-4f75-b461-b234a1945656`::ref 1 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:26,250::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-137498::INFO::2014-10-29 11:29:26,252::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137498::DEBUG::2014-10-29 11:29:26,255::task::1191::Storage.TaskManager.Task::(prepare) Task=`f8033c4a-fd16-4f75-b461-b234a1945656`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137498::DEBUG::2014-10-29 11:29:26,257::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8033c4a-fd16-4f75-b461-b234a1945656`::moving from state preparing -> state finished >JsonRpcServer::DEBUG::2014-10-29 11:29:26,257::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137498::DEBUG::2014-10-29 11:29:26,259::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137498::DEBUG::2014-10-29 11:29:26,261::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137498::DEBUG::2014-10-29 11:29:26,264::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137504::DEBUG::2014-10-29 11:29:26,266::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137498::DEBUG::2014-10-29 11:29:26,267::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137498::DEBUG::2014-10-29 11:29:26,268::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137498::DEBUG::2014-10-29 11:29:26,269::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137498::DEBUG::2014-10-29 11:29:26,272::task::993::Storage.TaskManager.Task::(_decref) Task=`f8033c4a-fd16-4f75-b461-b234a1945656`::ref 0 aborting False >Thread-137504::DEBUG::2014-10-29 11:29:26,285::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:29:26,297::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54895 >Detector thread::DEBUG::2014-10-29 11:29:26,297::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54895 >Detector thread::DEBUG::2014-10-29 11:29:26,297::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54895 >Detector thread::DEBUG::2014-10-29 11:29:26,298::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54895) >Thread-137505::DEBUG::2014-10-29 11:29:26,337::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137505::DEBUG::2014-10-29 11:29:26,338::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7584e53-6f91-4a45-894e-c4a84bf7f743`::moving from state init -> state preparing >Thread-137505::INFO::2014-10-29 11:29:26,338::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137505::INFO::2014-10-29 11:29:26,339::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00134137', 'lastCheck': '6.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544427', 'lastCheck': '6.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462141', 'lastCheck': '6.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000523359', 'lastCheck': '6.4', 'valid': True}} >Thread-137505::DEBUG::2014-10-29 11:29:26,339::task::1191::Storage.TaskManager.Task::(prepare) Task=`e7584e53-6f91-4a45-894e-c4a84bf7f743`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00134137', 'lastCheck': '6.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544427', 'lastCheck': '6.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462141', 'lastCheck': '6.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000523359', 'lastCheck': '6.4', 'valid': True}} >Thread-137505::DEBUG::2014-10-29 11:29:26,339::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7584e53-6f91-4a45-894e-c4a84bf7f743`::moving from state preparing -> state finished >Thread-137505::DEBUG::2014-10-29 11:29:26,339::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137505::DEBUG::2014-10-29 11:29:26,340::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137505::DEBUG::2014-10-29 11:29:26,340::task::993::Storage.TaskManager.Task::(_decref) Task=`e7584e53-6f91-4a45-894e-c4a84bf7f743`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:26,996::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:26,997::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:27,000::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:29,328::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:29,331::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137506::DEBUG::2014-10-29 11:29:29,334::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:29,337::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:29,339::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137507::DEBUG::2014-10-29 11:29:29,342::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137507::DEBUG::2014-10-29 11:29:29,344::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:29:29,863::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:29,863::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:29,864::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:29,864::__init__::232::IOProcess::(_processLogs) (202679) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:29,864::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202679) Queuing response >Thread-179::DEBUG::2014-10-29 11:29:29,866::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:29:29,885::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000478424 s, 778 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:29:29,887::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:29,887::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:29,888::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:29,889::__init__::232::IOProcess::(_processLogs) (202680) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:29,890::__init__::232::IOProcess::(_processLogs) (202680) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:29,897::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:29,897::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:29,897::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:29,898::__init__::232::IOProcess::(_processLogs) (202681) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:29,899::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202681) Queuing response >Thread-10269::DEBUG::2014-10-29 11:29:29,901::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:29:29,918::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000491932 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:29:29,920::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:29,920::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:29,921::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:29,921::__init__::232::IOProcess::(_processLogs) (202682) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:29,923::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202682) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:30,016::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:30,017::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:30,017::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:30,017::__init__::232::IOProcess::(_processLogs) (202683) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:30,019::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202683) Queuing response >Thread-33::DEBUG::2014-10-29 11:29:30,020::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:29:30,038::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00050702 s, 961 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:29:30,040::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:30,040::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:30,040::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:30,041::__init__::232::IOProcess::(_processLogs) (202684) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:30,041::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202684) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:30,043::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:30,043::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:30,044::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:30,044::__init__::232::IOProcess::(_processLogs) (202685) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:30,045::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202685) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:30,046::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:30,046::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:30,046::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:30,047::__init__::232::IOProcess::(_processLogs) (202686) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:30,047::__init__::232::IOProcess::(_processLogs) (202686) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:30,048::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:30,048::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:30,048::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:30,049::__init__::232::IOProcess::(_processLogs) (202687) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:30,049::__init__::232::IOProcess::(_processLogs) (202687) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:30,104::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:30,104::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:30,105::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:30,105::__init__::232::IOProcess::(_processLogs) (202688) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:30,106::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202688) Queuing response >Thread-178::DEBUG::2014-10-29 11:29:30,108::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:29:30,124::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000528633 s, 961 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:29:30,126::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:30,127::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:30,128::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:30,130::__init__::232::IOProcess::(_processLogs) (202689) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:30,130::__init__::232::IOProcess::(_processLogs) (202689) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:30,131::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:30,131::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:30,132::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:30,132::__init__::232::IOProcess::(_processLogs) (202690) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:30,133::__init__::232::IOProcess::(_processLogs) (202690) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:30,133::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:30,133::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:30,134::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:30,134::__init__::232::IOProcess::(_processLogs) (202691) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:30,135::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202691) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:30,136::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:30,136::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:30,136::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:30,137::__init__::232::IOProcess::(_processLogs) (202692) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:30,137::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202692) Queuing response >Detector thread::DEBUG::2014-10-29 11:29:30,553::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54896 >Detector thread::DEBUG::2014-10-29 11:29:30,553::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54896 >Detector thread::DEBUG::2014-10-29 11:29:30,554::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54896 >Detector thread::DEBUG::2014-10-29 11:29:30,554::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54896) >Thread-137508::DEBUG::2014-10-29 11:29:30,595::task::595::Storage.TaskManager.Task::(_updateState) Task=`783e505e-33fa-41d2-a2e6-636bd03969c3`::moving from state init -> state preparing >Thread-137508::INFO::2014-10-29 11:29:30,595::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137508::INFO::2014-10-29 11:29:30,596::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528633', 'lastCheck': '0.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050702', 'lastCheck': '0.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478424', 'lastCheck': '0.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000491932', 'lastCheck': '0.7', 'valid': True}} >Thread-137508::DEBUG::2014-10-29 11:29:30,596::task::1191::Storage.TaskManager.Task::(prepare) Task=`783e505e-33fa-41d2-a2e6-636bd03969c3`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528633', 'lastCheck': '0.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050702', 'lastCheck': '0.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478424', 'lastCheck': '0.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000491932', 'lastCheck': '0.7', 'valid': True}} >Thread-137508::DEBUG::2014-10-29 11:29:30,597::task::595::Storage.TaskManager.Task::(_updateState) Task=`783e505e-33fa-41d2-a2e6-636bd03969c3`::moving from state preparing -> state finished >Thread-137508::DEBUG::2014-10-29 11:29:30,597::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137508::DEBUG::2014-10-29 11:29:30,597::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137508::DEBUG::2014-10-29 11:29:30,597::task::993::Storage.TaskManager.Task::(_decref) Task=`783e505e-33fa-41d2-a2e6-636bd03969c3`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:29:30,628::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54897 >Detector thread::DEBUG::2014-10-29 11:29:30,631::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54897 >Detector thread::DEBUG::2014-10-29 11:29:30,632::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54897 >Detector thread::DEBUG::2014-10-29 11:29:30,634::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54897) >Thread-137509::DEBUG::2014-10-29 11:29:30,668::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137509::DEBUG::2014-10-29 11:29:30,669::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137509::DEBUG::2014-10-29 11:29:30,670::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.89', 'elapsedTime': '514803', 'displayType': 'vnc', 'cpuSys': '0.87', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '2436045', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '59879', 'readRate': '0.00', 'truesize': '6010904576', 'writeRate': '35691.50'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.63', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:29:31,734::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54899 >Detector thread::DEBUG::2014-10-29 11:29:31,734::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54899 >Detector thread::DEBUG::2014-10-29 11:29:31,735::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54899 >Detector thread::DEBUG::2014-10-29 11:29:31,735::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54899) >Thread-137510::DEBUG::2014-10-29 11:29:31,774::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137510::DEBUG::2014-10-29 11:29:31,776::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137510::DEBUG::2014-10-29 11:29:31,795::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137510::DEBUG::2014-10-29 11:29:31,846::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '156', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '56', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:32,007::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:32,008::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:32,011::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:32,362::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:32,365::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137511::DEBUG::2014-10-29 11:29:32,368::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:32,370::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:32,372::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137512::DEBUG::2014-10-29 11:29:32,375::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137512::DEBUG::2014-10-29 11:29:32,377::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:29:34,890::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:35,392::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:35,394::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137513::DEBUG::2014-10-29 11:29:35,398::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:35,400::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:35,402::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137514::DEBUG::2014-10-29 11:29:35,405::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137514::DEBUG::2014-10-29 11:29:35,407::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:29:36,069::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Detector thread::DEBUG::2014-10-29 11:29:36,864::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54901 >Detector thread::DEBUG::2014-10-29 11:29:36,865::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54901 >Detector thread::DEBUG::2014-10-29 11:29:36,865::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54901 >Detector thread::DEBUG::2014-10-29 11:29:36,866::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54901) >Thread-137515::DEBUG::2014-10-29 11:29:36,905::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137515::DEBUG::2014-10-29 11:29:36,906::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1d092a8-c266-4b47-b5c3-6b58fc06b337`::moving from state init -> state preparing >Thread-137515::INFO::2014-10-29 11:29:36,906::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137515::DEBUG::2014-10-29 11:29:36,920::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:29:36,921::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:36,922::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:36,922::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:36,922::__init__::232::IOProcess::(_processLogs) (202693) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:29:36,923::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202693) Queuing response >Thread-137515::DEBUG::2014-10-29 11:29:36,924::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137515::DEBUG::2014-10-29 11:29:36,925::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137515::INFO::2014-10-29 11:29:36,925::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137515::DEBUG::2014-10-29 11:29:36,925::task::1191::Storage.TaskManager.Task::(prepare) Task=`a1d092a8-c266-4b47-b5c3-6b58fc06b337`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137515::DEBUG::2014-10-29 11:29:36,925::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1d092a8-c266-4b47-b5c3-6b58fc06b337`::moving from state preparing -> state finished >Thread-137515::DEBUG::2014-10-29 11:29:36,926::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137515::DEBUG::2014-10-29 11:29:36,926::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137515::DEBUG::2014-10-29 11:29:36,926::task::993::Storage.TaskManager.Task::(_decref) Task=`a1d092a8-c266-4b47-b5c3-6b58fc06b337`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:29:36,970::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54902 >Detector thread::DEBUG::2014-10-29 11:29:36,970::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54902 >Detector thread::DEBUG::2014-10-29 11:29:36,970::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54902 >Detector thread::DEBUG::2014-10-29 11:29:36,971::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54902) >Thread-137516::DEBUG::2014-10-29 11:29:37,010::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137516::DEBUG::2014-10-29 11:29:37,011::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac8cc907-ecc9-4fe0-b786-6839a926c18f`::moving from state init -> state preparing >Thread-137516::INFO::2014-10-29 11:29:37,015::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137516::DEBUG::2014-10-29 11:29:37,015::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137516::DEBUG::2014-10-29 11:29:37,015::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137516::DEBUG::2014-10-29 11:29:37,016::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137516::DEBUG::2014-10-29 11:29:37,016::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137516::DEBUG::2014-10-29 11:29:37,016::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137516::DEBUG::2014-10-29 11:29:37,017::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:37,035::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:37,037::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:37,039::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137516::DEBUG::2014-10-29 11:29:37,096::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137516::DEBUG::2014-10-29 11:29:37,097::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137516::DEBUG::2014-10-29 11:29:37,269::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137516::DEBUG::2014-10-29 11:29:37,270::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137516::DEBUG::2014-10-29 11:29:37,270::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137516::DEBUG::2014-10-29 11:29:37,270::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137516::DEBUG::2014-10-29 11:29:37,271::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137516::DEBUG::2014-10-29 11:29:37,271::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137516::DEBUG::2014-10-29 11:29:37,271::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137516::DEBUG::2014-10-29 11:29:37,272::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:29:37,279::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:37,280::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:37,281::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:37,281::__init__::232::IOProcess::(_processLogs) (202694) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:29:37,282::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202694) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:37,283::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:37,284::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:37,284::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:37,284::__init__::232::IOProcess::(_processLogs) (202695) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:29:37,285::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202695) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:37,286::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:37,288::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:37,290::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:37,291::__init__::232::IOProcess::(_processLogs) (202696) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:29:37,293::__init__::232::IOProcess::(_processLogs) (202696) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:37,299::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-137516::DEBUG::2014-10-29 11:29:37,299::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:29:37,300::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:37,301::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:37,302::__init__::232::IOProcess::(_processLogs) (202697) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:29:37,302::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202697) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:37,304::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:37,304::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:37,304::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:37,304::__init__::232::IOProcess::(_processLogs) (202698) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:29:37,305::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202698) Queuing response >Thread-137516::DEBUG::2014-10-29 11:29:37,306::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:29:37,306::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:37,307::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:37,307::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:37,307::__init__::232::IOProcess::(_processLogs) (202699) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:29:37,308::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202699) Queuing response >Thread-137516::DEBUG::2014-10-29 11:29:37,308::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:29:37,310::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:37,311::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:37,311::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:37,312::__init__::232::IOProcess::(_processLogs) (202700) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:37,312::__init__::232::IOProcess::(_processLogs) (202700) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:37,313::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:37,313::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137516::DEBUG::2014-10-29 11:29:37,314::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:29:37,314::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-137516::INFO::2014-10-29 11:29:37,315::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:29:37,316::__init__::232::IOProcess::(_processLogs) (202701) Got request for method 'glob' >Thread-137516::INFO::2014-10-29 11:29:37,316::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:29:37,317::__init__::232::IOProcess::(_processLogs) (202701) Queuing response >Thread-137516::INFO::2014-10-29 11:29:37,318::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:29:37,319::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:37,320::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:37,320::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:37,320::__init__::232::IOProcess::(_processLogs) (202702) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:29:37,321::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202702) Queuing response >Thread-137516::DEBUG::2014-10-29 11:29:37,321::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137516::DEBUG::2014-10-29 11:29:37,324::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`5f813271-768f-49be-83f1-c755bbbc54ce`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137516::DEBUG::2014-10-29 11:29:37,324::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137516::DEBUG::2014-10-29 11:29:37,324::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137516::DEBUG::2014-10-29 11:29:37,324::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`5f813271-768f-49be-83f1-c755bbbc54ce`::Granted request >Thread-137516::DEBUG::2014-10-29 11:29:37,325::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ac8cc907-ecc9-4fe0-b786-6839a926c18f`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137516::DEBUG::2014-10-29 11:29:37,325::task::993::Storage.TaskManager.Task::(_decref) Task=`ac8cc907-ecc9-4fe0-b786-6839a926c18f`::ref 1 aborting False >Thread-137516::INFO::2014-10-29 11:29:37,328::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137516::DEBUG::2014-10-29 11:29:37,328::task::1191::Storage.TaskManager.Task::(prepare) Task=`ac8cc907-ecc9-4fe0-b786-6839a926c18f`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137516::DEBUG::2014-10-29 11:29:37,329::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac8cc907-ecc9-4fe0-b786-6839a926c18f`::moving from state preparing -> state finished >Thread-137516::DEBUG::2014-10-29 11:29:37,329::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137516::DEBUG::2014-10-29 11:29:37,329::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137516::DEBUG::2014-10-29 11:29:37,330::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137516::DEBUG::2014-10-29 11:29:37,330::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137516::DEBUG::2014-10-29 11:29:37,330::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137516::DEBUG::2014-10-29 11:29:37,330::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137516::DEBUG::2014-10-29 11:29:37,331::task::993::Storage.TaskManager.Task::(_decref) Task=`ac8cc907-ecc9-4fe0-b786-6839a926c18f`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:29:37,353::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54903 >Detector thread::DEBUG::2014-10-29 11:29:37,354::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54903 >Detector thread::DEBUG::2014-10-29 11:29:37,354::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54903 >Detector thread::DEBUG::2014-10-29 11:29:37,355::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54903) >Thread-137521::DEBUG::2014-10-29 11:29:37,393::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137521::DEBUG::2014-10-29 11:29:37,394::task::595::Storage.TaskManager.Task::(_updateState) Task=`ae38cca8-b9bd-46ee-8d18-839e098747b6`::moving from state init -> state preparing >Thread-137521::INFO::2014-10-29 11:29:37,394::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137521::INFO::2014-10-29 11:29:37,395::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528633', 'lastCheck': '7.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050702', 'lastCheck': '7.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478424', 'lastCheck': '7.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000491932', 'lastCheck': '7.5', 'valid': True}} >Thread-137521::DEBUG::2014-10-29 11:29:37,395::task::1191::Storage.TaskManager.Task::(prepare) Task=`ae38cca8-b9bd-46ee-8d18-839e098747b6`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528633', 'lastCheck': '7.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050702', 'lastCheck': '7.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478424', 'lastCheck': '7.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000491932', 'lastCheck': '7.5', 'valid': True}} >Thread-137521::DEBUG::2014-10-29 11:29:37,395::task::595::Storage.TaskManager.Task::(_updateState) Task=`ae38cca8-b9bd-46ee-8d18-839e098747b6`::moving from state preparing -> state finished >Thread-137521::DEBUG::2014-10-29 11:29:37,396::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137521::DEBUG::2014-10-29 11:29:37,396::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137521::DEBUG::2014-10-29 11:29:37,396::task::993::Storage.TaskManager.Task::(_decref) Task=`ae38cca8-b9bd-46ee-8d18-839e098747b6`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:38,422::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:38,425::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137522::DEBUG::2014-10-29 11:29:38,429::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:38,431::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:38,433::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137523::DEBUG::2014-10-29 11:29:38,436::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137523::DEBUG::2014-10-29 11:29:38,438::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:29:39,893::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:39,894::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:39,894::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:39,894::__init__::232::IOProcess::(_processLogs) (202703) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:39,896::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202703) Queuing response >Thread-179::DEBUG::2014-10-29 11:29:39,898::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:29:39,914::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00050329 s, 739 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:29:39,916::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:39,917::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:39,917::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:39,917::__init__::232::IOProcess::(_processLogs) (202704) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:39,919::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202704) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:39,926::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:39,926::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:39,926::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:39,927::__init__::232::IOProcess::(_processLogs) (202705) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:39,928::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202705) Queuing response >Thread-10269::DEBUG::2014-10-29 11:29:39,929::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:29:39,945::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000514915 s, 975 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:29:39,947::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:39,947::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:39,947::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:39,948::__init__::232::IOProcess::(_processLogs) (202706) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:39,949::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202706) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:40,051::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:40,052::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:40,052::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:40,052::__init__::232::IOProcess::(_processLogs) (202707) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:40,053::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202707) Queuing response >Thread-33::DEBUG::2014-10-29 11:29:40,055::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:29:40,071::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000451449 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:29:40,073::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:40,073::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:40,073::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:40,074::__init__::232::IOProcess::(_processLogs) (202708) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:40,076::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202708) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:40,078::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:40,079::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:40,079::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:40,080::__init__::232::IOProcess::(_processLogs) (202709) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:40,080::__init__::232::IOProcess::(_processLogs) (202709) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:40,080::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:40,081::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:40,081::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:40,081::__init__::232::IOProcess::(_processLogs) (202710) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:40,082::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202710) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:40,083::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:40,083::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:40,084::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:40,085::__init__::232::IOProcess::(_processLogs) (202711) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:40,086::__init__::232::IOProcess::(_processLogs) (202711) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:40,139::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:40,140::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:40,140::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:40,140::__init__::232::IOProcess::(_processLogs) (202712) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:40,142::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202712) Queuing response >Thread-178::DEBUG::2014-10-29 11:29:40,143::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:29:40,162::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000494696 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:29:40,163::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:40,164::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:40,165::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:40,167::__init__::232::IOProcess::(_processLogs) (202713) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:40,167::__init__::232::IOProcess::(_processLogs) (202713) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:40,167::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:40,168::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:40,169::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:40,169::__init__::232::IOProcess::(_processLogs) (202714) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:40,169::__init__::232::IOProcess::(_processLogs) (202714) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:40,170::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:40,170::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:40,171::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:40,172::__init__::232::IOProcess::(_processLogs) (202715) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:40,172::__init__::232::IOProcess::(_processLogs) (202715) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:40,172::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:40,173::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:40,173::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:40,174::__init__::232::IOProcess::(_processLogs) (202716) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:40,175::__init__::232::IOProcess::(_processLogs) (202716) Queuing response >Detector thread::DEBUG::2014-10-29 11:29:40,680::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54904 >Detector thread::DEBUG::2014-10-29 11:29:40,681::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54904 >Detector thread::DEBUG::2014-10-29 11:29:40,681::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54904 >Detector thread::DEBUG::2014-10-29 11:29:40,682::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54904) >Thread-137524::DEBUG::2014-10-29 11:29:40,721::task::595::Storage.TaskManager.Task::(_updateState) Task=`11d03c90-1321-4e0e-87fc-6ed3c69a4f15`::moving from state init -> state preparing >Thread-137524::INFO::2014-10-29 11:29:40,722::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137524::INFO::2014-10-29 11:29:40,723::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494696', 'lastCheck': '0.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000451449', 'lastCheck': '0.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050329', 'lastCheck': '0.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000514915', 'lastCheck': '0.8', 'valid': True}} >Thread-137524::DEBUG::2014-10-29 11:29:40,723::task::1191::Storage.TaskManager.Task::(prepare) Task=`11d03c90-1321-4e0e-87fc-6ed3c69a4f15`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494696', 'lastCheck': '0.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000451449', 'lastCheck': '0.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050329', 'lastCheck': '0.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000514915', 'lastCheck': '0.8', 'valid': True}} >Thread-137524::DEBUG::2014-10-29 11:29:40,723::task::595::Storage.TaskManager.Task::(_updateState) Task=`11d03c90-1321-4e0e-87fc-6ed3c69a4f15`::moving from state preparing -> state finished >Thread-137524::DEBUG::2014-10-29 11:29:40,723::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137524::DEBUG::2014-10-29 11:29:40,724::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137524::DEBUG::2014-10-29 11:29:40,724::task::993::Storage.TaskManager.Task::(_decref) Task=`11d03c90-1321-4e0e-87fc-6ed3c69a4f15`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:29:40,812::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54905 >Detector thread::DEBUG::2014-10-29 11:29:40,812::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54905 >Detector thread::DEBUG::2014-10-29 11:29:40,813::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54905 >Detector thread::DEBUG::2014-10-29 11:29:40,813::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54905) >Thread-137525::DEBUG::2014-10-29 11:29:40,852::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137525::DEBUG::2014-10-29 11:29:40,853::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137525::DEBUG::2014-10-29 11:29:40,854::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.50', 'elapsedTime': '514813', 'displayType': 'vnc', 'cpuSys': '0.47', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '2436045', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '59879', 'readRate': '0.00', 'truesize': '6010904576', 'writeRate': '35691.50'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.78', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:41,451::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:41,454::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137526::DEBUG::2014-10-29 11:29:41,457::task::595::Storage.TaskManager.Task::(_updateState) Task=`4e86a29b-83cd-40a5-b65b-9519381b210c`::moving from state init -> state preparing >Thread-137526::INFO::2014-10-29 11:29:41,458::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137526::INFO::2014-10-29 11:29:41,458::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494696', 'lastCheck': '1.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000451449', 'lastCheck': '1.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050329', 'lastCheck': '1.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000514915', 'lastCheck': '1.5', 'valid': True}} >Thread-137526::DEBUG::2014-10-29 11:29:41,459::task::1191::Storage.TaskManager.Task::(prepare) Task=`4e86a29b-83cd-40a5-b65b-9519381b210c`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494696', 'lastCheck': '1.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000451449', 'lastCheck': '1.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050329', 'lastCheck': '1.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000514915', 'lastCheck': '1.5', 'valid': True}} >Thread-137526::DEBUG::2014-10-29 11:29:41,459::task::595::Storage.TaskManager.Task::(_updateState) Task=`4e86a29b-83cd-40a5-b65b-9519381b210c`::moving from state preparing -> state finished >Thread-137526::DEBUG::2014-10-29 11:29:41,459::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137526::DEBUG::2014-10-29 11:29:41,459::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137526::DEBUG::2014-10-29 11:29:41,460::task::993::Storage.TaskManager.Task::(_decref) Task=`4e86a29b-83cd-40a5-b65b-9519381b210c`::ref 0 aborting False >Thread-137526::DEBUG::2014-10-29 11:29:41,480::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:41,502::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:41,504::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137527::DEBUG::2014-10-29 11:29:41,507::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137527::DEBUG::2014-10-29 11:29:41,509::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:29:41,902::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54907 >Detector thread::DEBUG::2014-10-29 11:29:41,903::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54907 >Detector thread::DEBUG::2014-10-29 11:29:41,903::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54907 >Detector thread::DEBUG::2014-10-29 11:29:41,903::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54907) >Thread-137528::DEBUG::2014-10-29 11:29:41,942::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137528::DEBUG::2014-10-29 11:29:41,943::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137528::DEBUG::2014-10-29 11:29:41,963::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137528::DEBUG::2014-10-29 11:29:42,009::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '140', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '40', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:42,046::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:42,047::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:42,049::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:44,556::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:44,559::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137529::DEBUG::2014-10-29 11:29:44,563::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:44,565::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:44,567::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137530::DEBUG::2014-10-29 11:29:44,571::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137530::DEBUG::2014-10-29 11:29:44,573::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:47,056::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:47,057::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:47,059::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:47,598::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:47,603::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137531::DEBUG::2014-10-29 11:29:47,613::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:47,619::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:47,625::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137532::DEBUG::2014-10-29 11:29:47,634::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137532::DEBUG::2014-10-29 11:29:47,658::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:29:48,015::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54909 >Detector thread::DEBUG::2014-10-29 11:29:48,017::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54909 >Detector thread::DEBUG::2014-10-29 11:29:48,017::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54909 >Detector thread::DEBUG::2014-10-29 11:29:48,018::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54909) >Thread-137533::DEBUG::2014-10-29 11:29:48,057::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137533::DEBUG::2014-10-29 11:29:48,058::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f6ab999-df89-4086-95b5-3616331a3578`::moving from state init -> state preparing >Thread-137533::INFO::2014-10-29 11:29:48,059::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137533::DEBUG::2014-10-29 11:29:48,062::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:29:48,063::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:48,063::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:48,063::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:48,064::__init__::232::IOProcess::(_processLogs) (202717) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:29:48,065::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202717) Queuing response >Thread-137533::DEBUG::2014-10-29 11:29:48,066::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137533::DEBUG::2014-10-29 11:29:48,066::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137533::INFO::2014-10-29 11:29:48,073::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137533::DEBUG::2014-10-29 11:29:48,077::task::1191::Storage.TaskManager.Task::(prepare) Task=`2f6ab999-df89-4086-95b5-3616331a3578`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137533::DEBUG::2014-10-29 11:29:48,078::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f6ab999-df89-4086-95b5-3616331a3578`::moving from state preparing -> state finished >Thread-137533::DEBUG::2014-10-29 11:29:48,079::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137533::DEBUG::2014-10-29 11:29:48,080::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137533::DEBUG::2014-10-29 11:29:48,080::task::993::Storage.TaskManager.Task::(_decref) Task=`2f6ab999-df89-4086-95b5-3616331a3578`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:29:48,143::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54910 >Detector thread::DEBUG::2014-10-29 11:29:48,144::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54910 >Detector thread::DEBUG::2014-10-29 11:29:48,144::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54910 >Detector thread::DEBUG::2014-10-29 11:29:48,145::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54910) >Thread-137534::DEBUG::2014-10-29 11:29:48,183::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137534::DEBUG::2014-10-29 11:29:48,184::task::595::Storage.TaskManager.Task::(_updateState) Task=`ec0a5d23-2efa-48cb-b2ee-3cb4b95427e6`::moving from state init -> state preparing >Thread-137534::INFO::2014-10-29 11:29:48,184::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137534::DEBUG::2014-10-29 11:29:48,185::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137534::DEBUG::2014-10-29 11:29:48,185::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137534::DEBUG::2014-10-29 11:29:48,185::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137534::DEBUG::2014-10-29 11:29:48,185::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137534::DEBUG::2014-10-29 11:29:48,186::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137534::DEBUG::2014-10-29 11:29:48,186::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137534::DEBUG::2014-10-29 11:29:48,279::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137534::DEBUG::2014-10-29 11:29:48,280::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137534::DEBUG::2014-10-29 11:29:48,447::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137534::DEBUG::2014-10-29 11:29:48,449::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137534::DEBUG::2014-10-29 11:29:48,450::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137534::DEBUG::2014-10-29 11:29:48,450::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137534::DEBUG::2014-10-29 11:29:48,450::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137534::DEBUG::2014-10-29 11:29:48,451::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137534::DEBUG::2014-10-29 11:29:48,451::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137534::DEBUG::2014-10-29 11:29:48,451::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:29:48,462::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:48,463::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:48,464::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:48,464::__init__::232::IOProcess::(_processLogs) (202718) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:29:48,464::__init__::232::IOProcess::(_processLogs) (202718) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:48,465::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:48,465::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:48,465::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:48,465::__init__::232::IOProcess::(_processLogs) (202719) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:29:48,466::__init__::232::IOProcess::(_processLogs) (202719) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:48,469::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:48,471::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:48,473::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:48,474::__init__::232::IOProcess::(_processLogs) (202720) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:29:48,474::__init__::232::IOProcess::(_processLogs) (202720) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:48,474::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:48,475::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:48,478::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:48,480::__init__::232::IOProcess::(_processLogs) (202721) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:29:48,482::__init__::232::IOProcess::(_processLogs) (202721) Queuing response >Thread-137534::DEBUG::2014-10-29 11:29:48,483::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:29:48,484::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:48,485::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:48,485::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:48,485::__init__::232::IOProcess::(_processLogs) (202722) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:29:48,487::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202722) Queuing response >Thread-137534::DEBUG::2014-10-29 11:29:48,488::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:29:48,489::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:48,490::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:48,490::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:48,491::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202723) Got request for method 'readfile' >Thread-137534::DEBUG::2014-10-29 11:29:48,491::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:29:48,492::__init__::232::IOProcess::(_processLogs) (202723) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:48,495::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:48,495::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:48,495::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:48,496::__init__::232::IOProcess::(_processLogs) (202724) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:48,497::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202724) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:48,497::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:48,498::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:48,498::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:48,498::__init__::232::IOProcess::(_processLogs) (202725) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:29:48,499::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202725) Queuing response >Thread-137534::DEBUG::2014-10-29 11:29:48,499::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-137534::INFO::2014-10-29 11:29:48,500::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137534::INFO::2014-10-29 11:29:48,501::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137534::INFO::2014-10-29 11:29:48,501::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:29:48,502::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:48,502::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:48,502::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:48,503::__init__::232::IOProcess::(_processLogs) (202726) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:29:48,503::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202726) Queuing response >Thread-137534::DEBUG::2014-10-29 11:29:48,504::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137534::DEBUG::2014-10-29 11:29:48,506::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`d308f113-3461-41e2-bb28-f970ed1d8ece`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137534::DEBUG::2014-10-29 11:29:48,506::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137534::DEBUG::2014-10-29 11:29:48,506::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137534::DEBUG::2014-10-29 11:29:48,507::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`d308f113-3461-41e2-bb28-f970ed1d8ece`::Granted request >Thread-137534::DEBUG::2014-10-29 11:29:48,507::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ec0a5d23-2efa-48cb-b2ee-3cb4b95427e6`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137534::DEBUG::2014-10-29 11:29:48,508::task::993::Storage.TaskManager.Task::(_decref) Task=`ec0a5d23-2efa-48cb-b2ee-3cb4b95427e6`::ref 1 aborting False >Thread-137534::INFO::2014-10-29 11:29:48,510::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137534::DEBUG::2014-10-29 11:29:48,511::task::1191::Storage.TaskManager.Task::(prepare) Task=`ec0a5d23-2efa-48cb-b2ee-3cb4b95427e6`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137534::DEBUG::2014-10-29 11:29:48,511::task::595::Storage.TaskManager.Task::(_updateState) Task=`ec0a5d23-2efa-48cb-b2ee-3cb4b95427e6`::moving from state preparing -> state finished >Thread-137534::DEBUG::2014-10-29 11:29:48,511::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137534::DEBUG::2014-10-29 11:29:48,512::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137534::DEBUG::2014-10-29 11:29:48,512::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137534::DEBUG::2014-10-29 11:29:48,512::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137534::DEBUG::2014-10-29 11:29:48,512::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137534::DEBUG::2014-10-29 11:29:48,513::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137534::DEBUG::2014-10-29 11:29:48,513::task::993::Storage.TaskManager.Task::(_decref) Task=`ec0a5d23-2efa-48cb-b2ee-3cb4b95427e6`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:29:48,546::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54911 >Detector thread::DEBUG::2014-10-29 11:29:48,547::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54911 >Detector thread::DEBUG::2014-10-29 11:29:48,547::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54911 >Detector thread::DEBUG::2014-10-29 11:29:48,547::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54911) >Thread-137539::DEBUG::2014-10-29 11:29:48,586::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137539::DEBUG::2014-10-29 11:29:48,587::task::595::Storage.TaskManager.Task::(_updateState) Task=`70d59fd5-dc5d-4b04-b229-80067b4c3c0f`::moving from state init -> state preparing >Thread-137539::INFO::2014-10-29 11:29:48,587::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137539::INFO::2014-10-29 11:29:48,588::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494696', 'lastCheck': '8.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000451449', 'lastCheck': '8.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050329', 'lastCheck': '8.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000514915', 'lastCheck': '8.6', 'valid': True}} >Thread-137539::DEBUG::2014-10-29 11:29:48,588::task::1191::Storage.TaskManager.Task::(prepare) Task=`70d59fd5-dc5d-4b04-b229-80067b4c3c0f`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494696', 'lastCheck': '8.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000451449', 'lastCheck': '8.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050329', 'lastCheck': '8.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000514915', 'lastCheck': '8.6', 'valid': True}} >Thread-137539::DEBUG::2014-10-29 11:29:48,588::task::595::Storage.TaskManager.Task::(_updateState) Task=`70d59fd5-dc5d-4b04-b229-80067b4c3c0f`::moving from state preparing -> state finished >Thread-137539::DEBUG::2014-10-29 11:29:48,588::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137539::DEBUG::2014-10-29 11:29:48,589::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137539::DEBUG::2014-10-29 11:29:48,589::task::993::Storage.TaskManager.Task::(_decref) Task=`70d59fd5-dc5d-4b04-b229-80067b4c3c0f`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:29:49,923::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:49,923::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:49,923::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:49,924::__init__::232::IOProcess::(_processLogs) (202727) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:49,925::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202727) Queuing response >Thread-179::DEBUG::2014-10-29 11:29:49,926::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:29:49,945::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000440641 s, 844 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:29:49,947::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:49,947::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:49,947::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:49,947::__init__::232::IOProcess::(_processLogs) (202728) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:49,948::__init__::232::IOProcess::(_processLogs) (202728) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:49,952::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:49,953::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:49,953::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:49,953::__init__::232::IOProcess::(_processLogs) (202729) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:49,954::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202729) Queuing response >Thread-10269::DEBUG::2014-10-29 11:29:49,956::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:29:49,973::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000517325 s, 970 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:29:49,975::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:49,975::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:49,975::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:49,975::__init__::232::IOProcess::(_processLogs) (202730) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:49,976::__init__::232::IOProcess::(_processLogs) (202730) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:50,087::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:50,089::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-33::DEBUG::2014-10-29 11:29:50,090::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:29:50,090::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:50,105::__init__::232::IOProcess::(_processLogs) (202731) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:50,106::__init__::232::IOProcess::(_processLogs) (202731) Queuing response >Thread-33::DEBUG::2014-10-29 11:29:50,107::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00157825 s, 309 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:29:50,109::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:50,109::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:50,109::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:50,110::__init__::232::IOProcess::(_processLogs) (202732) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:50,111::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202732) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:50,113::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:50,114::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:50,115::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:50,115::__init__::232::IOProcess::(_processLogs) (202733) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:50,115::__init__::232::IOProcess::(_processLogs) (202733) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:50,116::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:50,116::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:50,116::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:50,116::__init__::232::IOProcess::(_processLogs) (202734) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:50,117::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202734) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:50,118::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:50,118::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:50,119::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:50,119::__init__::232::IOProcess::(_processLogs) (202735) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:50,120::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202735) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:50,176::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:50,176::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:50,177::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:50,177::__init__::232::IOProcess::(_processLogs) (202736) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:50,178::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202736) Queuing response >Thread-178::DEBUG::2014-10-29 11:29:50,179::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:29:50,196::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000477692 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:29:50,198::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:50,198::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:50,199::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:50,199::__init__::232::IOProcess::(_processLogs) (202737) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:50,201::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202737) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:50,202::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:50,203::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:50,203::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:50,203::__init__::232::IOProcess::(_processLogs) (202738) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:50,204::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202738) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:50,205::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:50,205::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:50,206::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:50,206::__init__::232::IOProcess::(_processLogs) (202739) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:50,206::__init__::232::IOProcess::(_processLogs) (202739) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:50,207::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:50,207::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:50,208::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:50,208::__init__::232::IOProcess::(_processLogs) (202740) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:50,208::__init__::232::IOProcess::(_processLogs) (202740) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:50,691::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:50,694::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137540::DEBUG::2014-10-29 11:29:50,697::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:50,700::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:50,702::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137541::DEBUG::2014-10-29 11:29:50,707::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137541::DEBUG::2014-10-29 11:29:50,709::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:29:50,785::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54912 >Detector thread::DEBUG::2014-10-29 11:29:50,786::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54912 >Detector thread::DEBUG::2014-10-29 11:29:50,786::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54912 >Detector thread::DEBUG::2014-10-29 11:29:50,786::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54912) >Thread-137542::DEBUG::2014-10-29 11:29:50,827::task::595::Storage.TaskManager.Task::(_updateState) Task=`a2d1b19a-4273-40e5-97e3-8e1b258c1114`::moving from state init -> state preparing >Thread-137542::INFO::2014-10-29 11:29:50,827::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137542::INFO::2014-10-29 11:29:50,828::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477692', 'lastCheck': '0.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00157825', 'lastCheck': '0.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440641', 'lastCheck': '0.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000517325', 'lastCheck': '0.9', 'valid': True}} >Thread-137542::DEBUG::2014-10-29 11:29:50,828::task::1191::Storage.TaskManager.Task::(prepare) Task=`a2d1b19a-4273-40e5-97e3-8e1b258c1114`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477692', 'lastCheck': '0.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00157825', 'lastCheck': '0.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440641', 'lastCheck': '0.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000517325', 'lastCheck': '0.9', 'valid': True}} >Thread-137542::DEBUG::2014-10-29 11:29:50,829::task::595::Storage.TaskManager.Task::(_updateState) Task=`a2d1b19a-4273-40e5-97e3-8e1b258c1114`::moving from state preparing -> state finished >Thread-137542::DEBUG::2014-10-29 11:29:50,829::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137542::DEBUG::2014-10-29 11:29:50,829::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137542::DEBUG::2014-10-29 11:29:50,829::task::993::Storage.TaskManager.Task::(_decref) Task=`a2d1b19a-4273-40e5-97e3-8e1b258c1114`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:29:51,013::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54913 >Detector thread::DEBUG::2014-10-29 11:29:51,013::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54913 >Detector thread::DEBUG::2014-10-29 11:29:51,013::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54913 >Detector thread::DEBUG::2014-10-29 11:29:51,014::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54913) >Thread-137543::DEBUG::2014-10-29 11:29:51,053::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137543::DEBUG::2014-10-29 11:29:51,054::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137543::DEBUG::2014-10-29 11:29:51,055::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.50', 'elapsedTime': '514823', 'displayType': 'vnc', 'cpuSys': '0.47', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '2436045', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '59879', 'readRate': '0.00', 'truesize': '6010904576', 'writeRate': '35691.50'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.98', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-22::DEBUG::2014-10-29 11:29:51,073::task::595::Storage.TaskManager.Task::(_updateState) Task=`9170b5a5-3bf6-4cfc-9db9-1b345f9220e0`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:29:51,073::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:29:51,074::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:51,075::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:51,075::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:51,075::__init__::232::IOProcess::(_processLogs) (202741) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:29:51,076::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202741) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:51,078::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:51,079::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-22::INFO::2014-10-29 11:29:51,079::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010912768', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:29:51,080::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-22::DEBUG::2014-10-29 11:29:51,081::task::1191::Storage.TaskManager.Task::(prepare) Task=`9170b5a5-3bf6-4cfc-9db9-1b345f9220e0`::finished: {'truesize': '6010912768', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:29:51,082::__init__::232::IOProcess::(_processLogs) (202742) Got request for method 'stat' >Thread-22::DEBUG::2014-10-29 11:29:51,082::task::595::Storage.TaskManager.Task::(_updateState) Task=`9170b5a5-3bf6-4cfc-9db9-1b345f9220e0`::moving from state preparing -> state finished >Thread-17::DEBUG::2014-10-29 11:29:51,083::__init__::232::IOProcess::(_processLogs) (202742) Queuing response >Thread-22::DEBUG::2014-10-29 11:29:51,083::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-10-29 11:29:51,084::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2014-10-29 11:29:51,085::task::993::Storage.TaskManager.Task::(_decref) Task=`9170b5a5-3bf6-4cfc-9db9-1b345f9220e0`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:29:51,168::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Detector thread::DEBUG::2014-10-29 11:29:52,061::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54915 >Detector thread::DEBUG::2014-10-29 11:29:52,061::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54915 >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:52,066::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:29:52,066::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54915 >Detector thread::DEBUG::2014-10-29 11:29:52,069::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54915) >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:52,073::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:52,075::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137544::DEBUG::2014-10-29 11:29:52,101::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137544::DEBUG::2014-10-29 11:29:52,103::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137544::DEBUG::2014-10-29 11:29:52,122::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137544::DEBUG::2014-10-29 11:29:52,169::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '124', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '24', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:53,726::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:53,728::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137545::DEBUG::2014-10-29 11:29:53,732::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:53,735::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:53,737::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137546::DEBUG::2014-10-29 11:29:53,740::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137546::DEBUG::2014-10-29 11:29:53,742::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:56,758::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:56,760::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137547::DEBUG::2014-10-29 11:29:56,763::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ad491b4-ddd9-4c4e-894c-28e25e9726b2`::moving from state init -> state preparing >Thread-137547::INFO::2014-10-29 11:29:56,764::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137547::INFO::2014-10-29 11:29:56,764::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477692', 'lastCheck': '6.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00157825', 'lastCheck': '6.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440641', 'lastCheck': '6.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000517325', 'lastCheck': '6.8', 'valid': True}} >Thread-137547::DEBUG::2014-10-29 11:29:56,765::task::1191::Storage.TaskManager.Task::(prepare) Task=`9ad491b4-ddd9-4c4e-894c-28e25e9726b2`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477692', 'lastCheck': '6.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00157825', 'lastCheck': '6.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440641', 'lastCheck': '6.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000517325', 'lastCheck': '6.8', 'valid': True}} >Thread-137547::DEBUG::2014-10-29 11:29:56,765::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ad491b4-ddd9-4c4e-894c-28e25e9726b2`::moving from state preparing -> state finished >Thread-137547::DEBUG::2014-10-29 11:29:56,765::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137547::DEBUG::2014-10-29 11:29:56,765::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137547::DEBUG::2014-10-29 11:29:56,766::task::993::Storage.TaskManager.Task::(_decref) Task=`9ad491b4-ddd9-4c4e-894c-28e25e9726b2`::ref 0 aborting False >Thread-137547::DEBUG::2014-10-29 11:29:56,798::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:56,822::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:56,823::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137548::DEBUG::2014-10-29 11:29:56,827::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137548::DEBUG::2014-10-29 11:29:56,829::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:57,082::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:57,083::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:29:57,085::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:29:59,163::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54917 >Detector thread::DEBUG::2014-10-29 11:29:59,164::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54917 >Detector thread::DEBUG::2014-10-29 11:29:59,164::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54917 >Detector thread::DEBUG::2014-10-29 11:29:59,165::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54917) >Thread-137549::DEBUG::2014-10-29 11:29:59,204::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137549::DEBUG::2014-10-29 11:29:59,205::task::595::Storage.TaskManager.Task::(_updateState) Task=`9994403e-b258-4fc4-8333-55fb38fc9895`::moving from state init -> state preparing >Thread-137549::INFO::2014-10-29 11:29:59,206::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137549::DEBUG::2014-10-29 11:29:59,222::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:29:59,223::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:59,224::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:59,224::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:59,224::__init__::232::IOProcess::(_processLogs) (202743) Got request for method 'glob' >Thread-137549::DEBUG::2014-10-29 11:29:59,226::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:29:59,226::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202743) Queuing response >Thread-137549::DEBUG::2014-10-29 11:29:59,227::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137549::INFO::2014-10-29 11:29:59,228::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137549::DEBUG::2014-10-29 11:29:59,228::task::1191::Storage.TaskManager.Task::(prepare) Task=`9994403e-b258-4fc4-8333-55fb38fc9895`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137549::DEBUG::2014-10-29 11:29:59,228::task::595::Storage.TaskManager.Task::(_updateState) Task=`9994403e-b258-4fc4-8333-55fb38fc9895`::moving from state preparing -> state finished >Thread-137549::DEBUG::2014-10-29 11:29:59,229::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137549::DEBUG::2014-10-29 11:29:59,229::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137549::DEBUG::2014-10-29 11:29:59,229::task::993::Storage.TaskManager.Task::(_decref) Task=`9994403e-b258-4fc4-8333-55fb38fc9895`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:29:59,273::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54918 >Detector thread::DEBUG::2014-10-29 11:29:59,273::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54918 >Detector thread::DEBUG::2014-10-29 11:29:59,273::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54918 >Detector thread::DEBUG::2014-10-29 11:29:59,274::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54918) >Thread-137550::DEBUG::2014-10-29 11:29:59,313::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137550::DEBUG::2014-10-29 11:29:59,313::task::595::Storage.TaskManager.Task::(_updateState) Task=`66aba1e3-a671-4b8a-86d4-a14b25484377`::moving from state init -> state preparing >Thread-137550::INFO::2014-10-29 11:29:59,314::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137550::DEBUG::2014-10-29 11:29:59,314::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137550::DEBUG::2014-10-29 11:29:59,314::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137550::DEBUG::2014-10-29 11:29:59,315::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137550::DEBUG::2014-10-29 11:29:59,315::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137550::DEBUG::2014-10-29 11:29:59,315::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137550::DEBUG::2014-10-29 11:29:59,316::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137550::DEBUG::2014-10-29 11:29:59,402::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137550::DEBUG::2014-10-29 11:29:59,403::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137550::DEBUG::2014-10-29 11:29:59,588::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137550::DEBUG::2014-10-29 11:29:59,589::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137550::DEBUG::2014-10-29 11:29:59,590::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137550::DEBUG::2014-10-29 11:29:59,590::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137550::DEBUG::2014-10-29 11:29:59,591::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137550::DEBUG::2014-10-29 11:29:59,591::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137550::DEBUG::2014-10-29 11:29:59,591::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137550::DEBUG::2014-10-29 11:29:59,592::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:29:59,599::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:59,601::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:59,602::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:59,602::__init__::232::IOProcess::(_processLogs) (202744) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:29:59,603::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202744) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:59,605::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:59,605::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:59,605::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:59,606::__init__::232::IOProcess::(_processLogs) (202745) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:29:59,607::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202745) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:59,608::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:59,611::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:59,613::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:59,614::__init__::232::IOProcess::(_processLogs) (202746) Got request for method 'glob' >Thread-137550::DEBUG::2014-10-29 11:29:59,618::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:29:59,619::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202746) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:59,622::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:59,623::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:59,624::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:59,624::__init__::232::IOProcess::(_processLogs) (202747) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:29:59,624::__init__::232::IOProcess::(_processLogs) (202747) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:59,625::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:59,625::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:59,625::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:59,625::__init__::232::IOProcess::(_processLogs) (202748) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:29:59,626::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202748) Queuing response >Thread-137550::DEBUG::2014-10-29 11:29:59,627::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:29:59,629::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:59,629::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:59,629::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:59,630::__init__::232::IOProcess::(_processLogs) (202749) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:29:59,631::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202749) Queuing response >Thread-137550::DEBUG::2014-10-29 11:29:59,631::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:29:59,633::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:59,633::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:59,634::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:59,635::__init__::232::IOProcess::(_processLogs) (202750) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:29:59,635::__init__::232::IOProcess::(_processLogs) (202750) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:59,635::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:59,636::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:59,636::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:59,637::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202751) Got request for method 'glob' >Thread-137550::DEBUG::2014-10-29 11:29:59,637::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:29:59,638::__init__::232::IOProcess::(_processLogs) (202751) Queuing response >Thread-137550::INFO::2014-10-29 11:29:59,638::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137550::INFO::2014-10-29 11:29:59,639::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137550::INFO::2014-10-29 11:29:59,640::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:29:59,640::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:59,641::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:59,641::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:59,641::__init__::232::IOProcess::(_processLogs) (202752) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:29:59,642::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202752) Queuing response >Thread-137550::DEBUG::2014-10-29 11:29:59,642::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137550::DEBUG::2014-10-29 11:29:59,646::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`5657dbf8-4b6a-420a-882e-c837393b90e6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137550::DEBUG::2014-10-29 11:29:59,646::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137550::DEBUG::2014-10-29 11:29:59,647::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137550::DEBUG::2014-10-29 11:29:59,647::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`5657dbf8-4b6a-420a-882e-c837393b90e6`::Granted request >Thread-137550::DEBUG::2014-10-29 11:29:59,648::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`66aba1e3-a671-4b8a-86d4-a14b25484377`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137550::DEBUG::2014-10-29 11:29:59,648::task::993::Storage.TaskManager.Task::(_decref) Task=`66aba1e3-a671-4b8a-86d4-a14b25484377`::ref 1 aborting False >Thread-137550::INFO::2014-10-29 11:29:59,651::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137550::DEBUG::2014-10-29 11:29:59,651::task::1191::Storage.TaskManager.Task::(prepare) Task=`66aba1e3-a671-4b8a-86d4-a14b25484377`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137550::DEBUG::2014-10-29 11:29:59,652::task::595::Storage.TaskManager.Task::(_updateState) Task=`66aba1e3-a671-4b8a-86d4-a14b25484377`::moving from state preparing -> state finished >Thread-137550::DEBUG::2014-10-29 11:29:59,652::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137550::DEBUG::2014-10-29 11:29:59,652::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137550::DEBUG::2014-10-29 11:29:59,653::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137550::DEBUG::2014-10-29 11:29:59,653::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137550::DEBUG::2014-10-29 11:29:59,654::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137550::DEBUG::2014-10-29 11:29:59,654::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137550::DEBUG::2014-10-29 11:29:59,654::task::993::Storage.TaskManager.Task::(_decref) Task=`66aba1e3-a671-4b8a-86d4-a14b25484377`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:29:59,677::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54919 >Detector thread::DEBUG::2014-10-29 11:29:59,677::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54919 >Detector thread::DEBUG::2014-10-29 11:29:59,677::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54919 >Detector thread::DEBUG::2014-10-29 11:29:59,678::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54919) >Thread-137555::DEBUG::2014-10-29 11:29:59,717::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137555::DEBUG::2014-10-29 11:29:59,718::task::595::Storage.TaskManager.Task::(_updateState) Task=`5647aede-7bf5-4a57-873b-05e3ae934f60`::moving from state init -> state preparing >Thread-137555::INFO::2014-10-29 11:29:59,718::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137555::INFO::2014-10-29 11:29:59,719::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477692', 'lastCheck': '9.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00157825', 'lastCheck': '9.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440641', 'lastCheck': '9.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000517325', 'lastCheck': '9.7', 'valid': True}} >Thread-137555::DEBUG::2014-10-29 11:29:59,719::task::1191::Storage.TaskManager.Task::(prepare) Task=`5647aede-7bf5-4a57-873b-05e3ae934f60`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000477692', 'lastCheck': '9.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00157825', 'lastCheck': '9.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440641', 'lastCheck': '9.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000517325', 'lastCheck': '9.7', 'valid': True}} >Thread-137555::DEBUG::2014-10-29 11:29:59,719::task::595::Storage.TaskManager.Task::(_updateState) Task=`5647aede-7bf5-4a57-873b-05e3ae934f60`::moving from state preparing -> state finished >Thread-137555::DEBUG::2014-10-29 11:29:59,719::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137555::DEBUG::2014-10-29 11:29:59,720::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137555::DEBUG::2014-10-29 11:29:59,720::task::993::Storage.TaskManager.Task::(_decref) Task=`5647aede-7bf5-4a57-873b-05e3ae934f60`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:59,884::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:59,887::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137556::DEBUG::2014-10-29 11:29:59,891::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:29:59,894::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:29:59,896::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137557::DEBUG::2014-10-29 11:29:59,899::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137557::DEBUG::2014-10-29 11:29:59,902::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:29:59,952::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:59,952::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:59,953::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:59,953::__init__::232::IOProcess::(_processLogs) (202753) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:59,953::__init__::232::IOProcess::(_processLogs) (202753) Queuing response >Thread-179::DEBUG::2014-10-29 11:29:59,955::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:29:59,971::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000517949 s, 718 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:29:59,973::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:59,974::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:59,974::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:59,974::__init__::232::IOProcess::(_processLogs) (202754) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:59,975::__init__::232::IOProcess::(_processLogs) (202754) Queuing response >Thread-17::DEBUG::2014-10-29 11:29:59,980::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:29:59,980::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:29:59,981::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:29:59,981::__init__::232::IOProcess::(_processLogs) (202755) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:29:59,981::__init__::232::IOProcess::(_processLogs) (202755) Queuing response >Thread-10269::DEBUG::2014-10-29 11:29:59,983::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:30:00,000::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000524535 s, 957 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:30:00,002::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:00,002::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:00,003::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:00,003::__init__::232::IOProcess::(_processLogs) (202756) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:00,005::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202756) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:00,122::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:00,123::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-33::DEBUG::2014-10-29 11:30:00,125::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:30:00,125::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:00,140::__init__::232::IOProcess::(_processLogs) (202757) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:00,140::__init__::232::IOProcess::(_processLogs) (202757) Queuing response >Thread-33::DEBUG::2014-10-29 11:30:00,141::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000454743 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:30:00,143::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:00,143::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:00,143::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:00,144::__init__::232::IOProcess::(_processLogs) (202758) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:00,145::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202758) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:00,147::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:00,148::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:00,148::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:00,149::__init__::232::IOProcess::(_processLogs) (202759) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:00,149::__init__::232::IOProcess::(_processLogs) (202759) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:00,149::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:00,150::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:00,151::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:00,151::__init__::232::IOProcess::(_processLogs) (202760) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:00,152::__init__::232::IOProcess::(_processLogs) (202760) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:00,152::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:00,153::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:00,153::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:00,154::__init__::232::IOProcess::(_processLogs) (202761) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:00,155::__init__::232::IOProcess::(_processLogs) (202761) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:00,210::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:00,211::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:00,212::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:00,213::__init__::232::IOProcess::(_processLogs) (202762) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:30:00,213::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:30:00,215::__init__::232::IOProcess::(_processLogs) (202762) Queuing response >Thread-178::DEBUG::2014-10-29 11:30:00,230::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000580572 s, 875 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:30:00,232::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:00,232::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:00,232::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:00,233::__init__::232::IOProcess::(_processLogs) (202763) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:00,234::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202763) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:00,236::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:00,237::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:00,237::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:00,238::__init__::232::IOProcess::(_processLogs) (202764) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:00,238::__init__::232::IOProcess::(_processLogs) (202764) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:00,238::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:00,239::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:00,240::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:00,240::__init__::232::IOProcess::(_processLogs) (202765) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:00,240::__init__::232::IOProcess::(_processLogs) (202765) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:00,241::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:00,242::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:00,242::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:00,244::__init__::232::IOProcess::(_processLogs) (202766) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:00,244::__init__::232::IOProcess::(_processLogs) (202766) Queuing response >Detector thread::DEBUG::2014-10-29 11:30:00,903::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54920 >Detector thread::DEBUG::2014-10-29 11:30:00,904::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54920 >Detector thread::DEBUG::2014-10-29 11:30:00,904::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54920 >Detector thread::DEBUG::2014-10-29 11:30:00,905::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54920) >Thread-137558::DEBUG::2014-10-29 11:30:00,944::task::595::Storage.TaskManager.Task::(_updateState) Task=`b022c2d7-35db-470c-a4a2-d37bf8a04b31`::moving from state init -> state preparing >Thread-137558::INFO::2014-10-29 11:30:00,945::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137558::INFO::2014-10-29 11:30:00,945::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580572', 'lastCheck': '0.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000454743', 'lastCheck': '0.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517949', 'lastCheck': '1.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000524535', 'lastCheck': '0.9', 'valid': True}} >Thread-137558::DEBUG::2014-10-29 11:30:00,946::task::1191::Storage.TaskManager.Task::(prepare) Task=`b022c2d7-35db-470c-a4a2-d37bf8a04b31`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580572', 'lastCheck': '0.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000454743', 'lastCheck': '0.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000517949', 'lastCheck': '1.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000524535', 'lastCheck': '0.9', 'valid': True}} >Thread-137558::DEBUG::2014-10-29 11:30:00,946::task::595::Storage.TaskManager.Task::(_updateState) Task=`b022c2d7-35db-470c-a4a2-d37bf8a04b31`::moving from state preparing -> state finished >Thread-137558::DEBUG::2014-10-29 11:30:00,946::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137558::DEBUG::2014-10-29 11:30:00,946::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137558::DEBUG::2014-10-29 11:30:00,947::task::993::Storage.TaskManager.Task::(_decref) Task=`b022c2d7-35db-470c-a4a2-d37bf8a04b31`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:30:01,207::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54921 >Detector thread::DEBUG::2014-10-29 11:30:01,207::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54921 >Detector thread::DEBUG::2014-10-29 11:30:01,208::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54921 >Detector thread::DEBUG::2014-10-29 11:30:01,208::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54921) >Thread-137559::DEBUG::2014-10-29 11:30:01,247::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137559::DEBUG::2014-10-29 11:30:01,248::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137559::DEBUG::2014-10-29 11:30:01,249::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.04', 'elapsedTime': '514833', 'displayType': 'vnc', 'cpuSys': '1.20', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '2834667', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57841', 'readRate': '0.00', 'truesize': '6010912768', 'writeRate': '35663.22'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.08', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:02,092::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:02,093::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:02,094::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:30:02,229::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54923 >Detector thread::DEBUG::2014-10-29 11:30:02,230::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54923 >Detector thread::DEBUG::2014-10-29 11:30:02,230::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54923 >Detector thread::DEBUG::2014-10-29 11:30:02,230::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54923) >Thread-137560::DEBUG::2014-10-29 11:30:02,269::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137560::DEBUG::2014-10-29 11:30:02,270::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137560::DEBUG::2014-10-29 11:30:02,289::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137560::DEBUG::2014-10-29 11:30:02,360::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '105', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '5', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:02,920::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:02,923::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137561::DEBUG::2014-10-29 11:30:02,928::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:02,931::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:02,933::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137562::DEBUG::2014-10-29 11:30:02,936::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137562::DEBUG::2014-10-29 11:30:02,938::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:30:04,926::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:05,954::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:05,957::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137563::DEBUG::2014-10-29 11:30:05,960::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:05,963::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:05,964::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137564::DEBUG::2014-10-29 11:30:05,967::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137564::DEBUG::2014-10-29 11:30:05,970::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:30:06,194::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:07,101::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:07,102::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:07,104::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:08,984::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:08,988::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137565::DEBUG::2014-10-29 11:30:08,992::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:08,994::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:08,996::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137566::DEBUG::2014-10-29 11:30:09,000::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137566::DEBUG::2014-10-29 11:30:09,002::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:30:09,981::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:09,981::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:09,981::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:09,982::__init__::232::IOProcess::(_processLogs) (202767) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:09,984::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202767) Queuing response >Thread-179::DEBUG::2014-10-29 11:30:09,986::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:30:10,009::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:10,010::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:10,010::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:10,011::__init__::232::IOProcess::(_processLogs) (202768) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:10,019::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202768) Queuing response >Thread-179::DEBUG::2014-10-29 11:30:10,018::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00168893 s, 220 kB/s\n'; <rc> = 0 >Thread-10269::DEBUG::2014-10-29 11:30:10,022::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:30:10,046::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:10,049::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:10,049::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:10,049::__init__::232::IOProcess::(_processLogs) (202769) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:10,050::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202769) Queuing response >Thread-10269::DEBUG::2014-10-29 11:30:10,055::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000605893 s, 829 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:30:10,058::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:10,061::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:10,061::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:10,062::__init__::232::IOProcess::(_processLogs) (202770) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:10,062::__init__::232::IOProcess::(_processLogs) (202770) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:10,156::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:10,156::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:10,157::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:10,157::__init__::232::IOProcess::(_processLogs) (202771) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:10,159::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202771) Queuing response >Thread-33::DEBUG::2014-10-29 11:30:10,161::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:30:10,183::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00097729 s, 498 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:30:10,185::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:10,186::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:10,186::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:10,186::__init__::232::IOProcess::(_processLogs) (202772) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:10,188::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202772) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:10,190::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:10,190::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:10,191::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:10,191::__init__::232::IOProcess::(_processLogs) (202773) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:10,192::__init__::232::IOProcess::(_processLogs) (202773) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:10,192::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:10,193::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:10,193::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:10,193::__init__::232::IOProcess::(_processLogs) (202774) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:10,194::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202774) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:10,195::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:10,195::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:10,196::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:10,196::__init__::232::IOProcess::(_processLogs) (202775) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:10,198::__init__::232::IOProcess::(_processLogs) (202775) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:10,245::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:10,245::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:10,245::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:10,246::__init__::232::IOProcess::(_processLogs) (202776) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:10,247::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202776) Queuing response >Thread-178::DEBUG::2014-10-29 11:30:10,249::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:30:10,268::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000558736 s, 909 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:30:10,270::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:10,270::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:10,272::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:10,274::__init__::232::IOProcess::(_processLogs) (202777) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:10,274::__init__::232::IOProcess::(_processLogs) (202777) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:10,274::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:10,275::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:10,276::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:10,276::__init__::232::IOProcess::(_processLogs) (202778) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:10,276::__init__::232::IOProcess::(_processLogs) (202778) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:10,277::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:10,277::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:10,278::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:10,279::__init__::232::IOProcess::(_processLogs) (202779) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:10,279::__init__::232::IOProcess::(_processLogs) (202779) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:10,280::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:10,280::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:10,281::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:10,281::__init__::232::IOProcess::(_processLogs) (202780) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:10,282::__init__::232::IOProcess::(_processLogs) (202780) Queuing response >Detector thread::DEBUG::2014-10-29 11:30:10,366::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54925 >Detector thread::DEBUG::2014-10-29 11:30:10,367::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54925 >Detector thread::DEBUG::2014-10-29 11:30:10,367::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54925 >Detector thread::DEBUG::2014-10-29 11:30:10,368::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54925) >Detector thread::DEBUG::2014-10-29 11:30:10,393::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54926 >Detector thread::DEBUG::2014-10-29 11:30:10,393::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54926 >Detector thread::DEBUG::2014-10-29 11:30:10,394::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54926 >Detector thread::DEBUG::2014-10-29 11:30:10,394::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54926) >Thread-137567::DEBUG::2014-10-29 11:30:10,407::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137567::DEBUG::2014-10-29 11:30:10,408::task::595::Storage.TaskManager.Task::(_updateState) Task=`5c00d077-e429-4d1b-9943-c8d37a688542`::moving from state init -> state preparing >Thread-137567::INFO::2014-10-29 11:30:10,409::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137567::DEBUG::2014-10-29 11:30:10,416::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:30:10,417::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:10,417::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:10,417::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:10,418::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202781) Got request for method 'glob' >Thread-137567::DEBUG::2014-10-29 11:30:10,419::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:30:10,419::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202781) Queuing response >Thread-137567::DEBUG::2014-10-29 11:30:10,420::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137567::INFO::2014-10-29 11:30:10,421::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137567::DEBUG::2014-10-29 11:30:10,421::task::1191::Storage.TaskManager.Task::(prepare) Task=`5c00d077-e429-4d1b-9943-c8d37a688542`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137567::DEBUG::2014-10-29 11:30:10,421::task::595::Storage.TaskManager.Task::(_updateState) Task=`5c00d077-e429-4d1b-9943-c8d37a688542`::moving from state preparing -> state finished >Thread-137567::DEBUG::2014-10-29 11:30:10,422::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137567::DEBUG::2014-10-29 11:30:10,422::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137567::DEBUG::2014-10-29 11:30:10,422::task::993::Storage.TaskManager.Task::(_decref) Task=`5c00d077-e429-4d1b-9943-c8d37a688542`::ref 0 aborting False >Thread-137568::DEBUG::2014-10-29 11:30:10,433::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137568::DEBUG::2014-10-29 11:30:10,435::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137568::DEBUG::2014-10-29 11:30:10,436::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '6.26', 'elapsedTime': '514842', 'displayType': 'vnc', 'cpuSys': '1.06', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '2834667', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57841', 'readRate': '0.00', 'truesize': '6010912768', 'writeRate': '35663.22'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.24', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:30:10,472::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54927 >Detector thread::DEBUG::2014-10-29 11:30:10,472::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54927 >Detector thread::DEBUG::2014-10-29 11:30:10,473::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54927 >Detector thread::DEBUG::2014-10-29 11:30:10,473::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54927) >Thread-137569::DEBUG::2014-10-29 11:30:10,512::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137569::DEBUG::2014-10-29 11:30:10,513::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f141341-d08e-4ab8-8281-3dab59359ea0`::moving from state init -> state preparing >Thread-137569::INFO::2014-10-29 11:30:10,513::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137569::DEBUG::2014-10-29 11:30:10,514::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137569::DEBUG::2014-10-29 11:30:10,514::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137569::DEBUG::2014-10-29 11:30:10,514::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137569::DEBUG::2014-10-29 11:30:10,514::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137569::DEBUG::2014-10-29 11:30:10,515::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137569::DEBUG::2014-10-29 11:30:10,515::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137569::DEBUG::2014-10-29 11:30:10,617::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137569::DEBUG::2014-10-29 11:30:10,618::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137569::DEBUG::2014-10-29 11:30:10,864::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137569::DEBUG::2014-10-29 11:30:10,865::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137569::DEBUG::2014-10-29 11:30:10,865::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137569::DEBUG::2014-10-29 11:30:10,866::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137569::DEBUG::2014-10-29 11:30:10,866::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137569::DEBUG::2014-10-29 11:30:10,866::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137569::DEBUG::2014-10-29 11:30:10,867::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137569::DEBUG::2014-10-29 11:30:10,867::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:30:10,876::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:10,878::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:10,878::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:10,879::__init__::232::IOProcess::(_processLogs) (202782) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:30:10,879::__init__::232::IOProcess::(_processLogs) (202782) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:10,880::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:10,881::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:10,882::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:10,884::__init__::232::IOProcess::(_processLogs) (202783) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:30:10,885::__init__::232::IOProcess::(_processLogs) (202783) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:10,888::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:10,889::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:10,891::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:10,892::__init__::232::IOProcess::(_processLogs) (202784) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:30:10,896::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202784) Queuing response >Thread-137569::DEBUG::2014-10-29 11:30:10,897::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:30:10,899::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:10,900::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:10,900::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:10,900::__init__::232::IOProcess::(_processLogs) (202785) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:30:10,901::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202785) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:10,902::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:10,902::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:10,903::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:10,903::__init__::232::IOProcess::(_processLogs) (202786) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:30:10,904::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202786) Queuing response >Thread-137569::DEBUG::2014-10-29 11:30:10,904::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:30:10,906::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:10,906::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:10,907::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:10,907::__init__::232::IOProcess::(_processLogs) (202787) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:30:10,908::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202787) Queuing response >Thread-137569::DEBUG::2014-10-29 11:30:10,908::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:30:10,910::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:10,911::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:10,912::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:10,912::__init__::232::IOProcess::(_processLogs) (202788) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:10,912::__init__::232::IOProcess::(_processLogs) (202788) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:10,913::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:10,913::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:10,913::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:10,913::__init__::232::IOProcess::(_processLogs) (202789) Got request for method 'glob' >Thread-137569::DEBUG::2014-10-29 11:30:10,914::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:30:10,914::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202789) Queuing response >Thread-137569::INFO::2014-10-29 11:30:10,915::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137569::INFO::2014-10-29 11:30:10,917::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137569::INFO::2014-10-29 11:30:10,917::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:30:10,918::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:10,918::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:10,919::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:10,919::__init__::232::IOProcess::(_processLogs) (202790) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:30:10,926::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202790) Queuing response >Thread-137569::DEBUG::2014-10-29 11:30:10,927::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137569::DEBUG::2014-10-29 11:30:10,929::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`8b8c0ccd-54d4-4737-bbc2-d443d9a62276`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137569::DEBUG::2014-10-29 11:30:10,929::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137569::DEBUG::2014-10-29 11:30:10,930::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137569::DEBUG::2014-10-29 11:30:10,930::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`8b8c0ccd-54d4-4737-bbc2-d443d9a62276`::Granted request >Thread-137569::DEBUG::2014-10-29 11:30:10,931::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6f141341-d08e-4ab8-8281-3dab59359ea0`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137569::DEBUG::2014-10-29 11:30:10,931::task::993::Storage.TaskManager.Task::(_decref) Task=`6f141341-d08e-4ab8-8281-3dab59359ea0`::ref 1 aborting False >Thread-137569::INFO::2014-10-29 11:30:10,934::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137569::DEBUG::2014-10-29 11:30:10,935::task::1191::Storage.TaskManager.Task::(prepare) Task=`6f141341-d08e-4ab8-8281-3dab59359ea0`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137569::DEBUG::2014-10-29 11:30:10,935::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f141341-d08e-4ab8-8281-3dab59359ea0`::moving from state preparing -> state finished >Thread-137569::DEBUG::2014-10-29 11:30:10,935::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137569::DEBUG::2014-10-29 11:30:10,935::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137569::DEBUG::2014-10-29 11:30:10,936::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137569::DEBUG::2014-10-29 11:30:10,936::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137569::DEBUG::2014-10-29 11:30:10,936::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137569::DEBUG::2014-10-29 11:30:10,937::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137569::DEBUG::2014-10-29 11:30:10,937::task::993::Storage.TaskManager.Task::(_decref) Task=`6f141341-d08e-4ab8-8281-3dab59359ea0`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:30:10,960::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54929 >Detector thread::DEBUG::2014-10-29 11:30:10,961::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54929 >Detector thread::DEBUG::2014-10-29 11:30:10,961::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54929 >Detector thread::DEBUG::2014-10-29 11:30:10,962::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54929) >Detector thread::DEBUG::2014-10-29 11:30:10,998::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54930 >Detector thread::DEBUG::2014-10-29 11:30:10,999::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54930 >Detector thread::DEBUG::2014-10-29 11:30:10,999::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54930 >Detector thread::DEBUG::2014-10-29 11:30:11,000::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54930) >Thread-137574::DEBUG::2014-10-29 11:30:11,002::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137574::DEBUG::2014-10-29 11:30:11,005::task::595::Storage.TaskManager.Task::(_updateState) Task=`632ca8f0-abc4-4c36-a930-025fa9790d71`::moving from state init -> state preparing >Thread-137574::INFO::2014-10-29 11:30:11,005::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137574::INFO::2014-10-29 11:30:11,006::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558736', 'lastCheck': '0.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00097729', 'lastCheck': '0.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00168893', 'lastCheck': '0.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000605893', 'lastCheck': '0.9', 'valid': True}} >Thread-137574::DEBUG::2014-10-29 11:30:11,006::task::1191::Storage.TaskManager.Task::(prepare) Task=`632ca8f0-abc4-4c36-a930-025fa9790d71`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558736', 'lastCheck': '0.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00097729', 'lastCheck': '0.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00168893', 'lastCheck': '0.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000605893', 'lastCheck': '0.9', 'valid': True}} >Thread-137574::DEBUG::2014-10-29 11:30:11,006::task::595::Storage.TaskManager.Task::(_updateState) Task=`632ca8f0-abc4-4c36-a930-025fa9790d71`::moving from state preparing -> state finished >Thread-137574::DEBUG::2014-10-29 11:30:11,007::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137574::DEBUG::2014-10-29 11:30:11,007::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137574::DEBUG::2014-10-29 11:30:11,007::task::993::Storage.TaskManager.Task::(_decref) Task=`632ca8f0-abc4-4c36-a930-025fa9790d71`::ref 0 aborting False >Thread-137575::DEBUG::2014-10-29 11:30:11,040::task::595::Storage.TaskManager.Task::(_updateState) Task=`90d895a0-3723-4da9-af1d-9a6d728e3872`::moving from state init -> state preparing >Thread-137575::INFO::2014-10-29 11:30:11,041::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137575::INFO::2014-10-29 11:30:11,041::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558736', 'lastCheck': '0.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00097729', 'lastCheck': '0.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00168893', 'lastCheck': '1.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000605893', 'lastCheck': '1.0', 'valid': True}} >Thread-137575::DEBUG::2014-10-29 11:30:11,042::task::1191::Storage.TaskManager.Task::(prepare) Task=`90d895a0-3723-4da9-af1d-9a6d728e3872`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558736', 'lastCheck': '0.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00097729', 'lastCheck': '0.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00168893', 'lastCheck': '1.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000605893', 'lastCheck': '1.0', 'valid': True}} >Thread-137575::DEBUG::2014-10-29 11:30:11,042::task::595::Storage.TaskManager.Task::(_updateState) Task=`90d895a0-3723-4da9-af1d-9a6d728e3872`::moving from state preparing -> state finished >Thread-137575::DEBUG::2014-10-29 11:30:11,042::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137575::DEBUG::2014-10-29 11:30:11,042::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137575::DEBUG::2014-10-29 11:30:11,043::task::993::Storage.TaskManager.Task::(_decref) Task=`90d895a0-3723-4da9-af1d-9a6d728e3872`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:30:11,404::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54931 >Detector thread::DEBUG::2014-10-29 11:30:11,404::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54931 >Detector thread::DEBUG::2014-10-29 11:30:11,405::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54931 >Detector thread::DEBUG::2014-10-29 11:30:11,405::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54931) >Thread-137576::DEBUG::2014-10-29 11:30:11,444::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137576::DEBUG::2014-10-29 11:30:11,446::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137576::DEBUG::2014-10-29 11:30:11,466::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137576::DEBUG::2014-10-29 11:30:11,524::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '188', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '88', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:12,016::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:12,018::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137577::DEBUG::2014-10-29 11:30:12,023::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f78052d-5da9-4d2a-9c9a-e54cafec96af`::moving from state init -> state preparing >Thread-137577::INFO::2014-10-29 11:30:12,023::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137577::INFO::2014-10-29 11:30:12,024::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558736', 'lastCheck': '1.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00097729', 'lastCheck': '1.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00168893', 'lastCheck': '2.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000605893', 'lastCheck': '2.0', 'valid': True}} >Thread-137577::DEBUG::2014-10-29 11:30:12,024::task::1191::Storage.TaskManager.Task::(prepare) Task=`2f78052d-5da9-4d2a-9c9a-e54cafec96af`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558736', 'lastCheck': '1.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00097729', 'lastCheck': '1.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00168893', 'lastCheck': '2.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000605893', 'lastCheck': '2.0', 'valid': True}} >Thread-137577::DEBUG::2014-10-29 11:30:12,024::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f78052d-5da9-4d2a-9c9a-e54cafec96af`::moving from state preparing -> state finished >Thread-137577::DEBUG::2014-10-29 11:30:12,024::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137577::DEBUG::2014-10-29 11:30:12,025::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137577::DEBUG::2014-10-29 11:30:12,025::task::993::Storage.TaskManager.Task::(_decref) Task=`2f78052d-5da9-4d2a-9c9a-e54cafec96af`::ref 0 aborting False >Thread-137577::DEBUG::2014-10-29 11:30:12,045::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:12,068::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:12,070::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137578::DEBUG::2014-10-29 11:30:12,073::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137578::DEBUG::2014-10-29 11:30:12,075::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:12,111::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:12,112::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:12,116::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:15,153::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:15,156::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137579::DEBUG::2014-10-29 11:30:15,160::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:15,162::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:15,164::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137580::DEBUG::2014-10-29 11:30:15,167::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137580::DEBUG::2014-10-29 11:30:15,170::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:17,123::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:17,124::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:17,125::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:18,188::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:18,190::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137581::DEBUG::2014-10-29 11:30:18,193::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:18,195::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:18,197::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137582::DEBUG::2014-10-29 11:30:18,200::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137582::DEBUG::2014-10-29 11:30:18,202::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:30:20,058::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:20,058::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:20,058::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:20,059::__init__::232::IOProcess::(_processLogs) (202791) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:20,060::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202791) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:20,064::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-179::DEBUG::2014-10-29 11:30:20,064::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:30:20,066::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:20,083::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-179::DEBUG::2014-10-29 11:30:20,085::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000473278 s, 786 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:30:20,085::__init__::232::IOProcess::(_processLogs) (202792) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:20,089::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202792) Queuing response >Thread-10269::DEBUG::2014-10-29 11:30:20,091::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:30:20,107::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:20,109::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10269::DEBUG::2014-10-29 11:30:20,111::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000596644 s, 841 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:30:20,115::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:20,116::__init__::232::IOProcess::(_processLogs) (202793) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:20,116::__init__::232::IOProcess::(_processLogs) (202793) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:20,117::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:20,117::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:20,118::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:20,119::__init__::232::IOProcess::(_processLogs) (202794) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:20,120::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202794) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:20,199::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:20,200::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:20,202::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-33::DEBUG::2014-10-29 11:30:20,202::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:30:20,203::__init__::232::IOProcess::(_processLogs) (202795) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:20,221::__init__::232::IOProcess::(_processLogs) (202795) Queuing response >Thread-33::DEBUG::2014-10-29 11:30:20,225::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00327326 s, 149 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:30:20,226::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:20,226::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:20,227::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:20,227::__init__::232::IOProcess::(_processLogs) (202796) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:20,228::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202796) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:20,230::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:20,230::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:20,231::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:20,231::__init__::232::IOProcess::(_processLogs) (202797) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:20,232::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202797) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:20,233::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:20,233::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:20,233::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:20,234::__init__::232::IOProcess::(_processLogs) (202798) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:20,234::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202798) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:20,235::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:20,236::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:20,237::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:20,237::__init__::232::IOProcess::(_processLogs) (202799) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:20,238::__init__::232::IOProcess::(_processLogs) (202799) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:20,283::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:20,283::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:20,284::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:20,284::__init__::232::IOProcess::(_processLogs) (202800) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:20,285::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202800) Queuing response >Thread-178::DEBUG::2014-10-29 11:30:20,287::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:30:20,304::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000440152 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:30:20,306::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:20,307::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:20,307::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:20,307::__init__::232::IOProcess::(_processLogs) (202801) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:20,308::__init__::232::IOProcess::(_processLogs) (202801) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:20,310::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:20,310::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:20,310::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:20,311::__init__::232::IOProcess::(_processLogs) (202802) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:20,311::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202802) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:20,312::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:20,313::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:20,313::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:20,313::__init__::232::IOProcess::(_processLogs) (202803) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:20,314::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202803) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:20,315::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:20,315::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:20,315::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:20,316::__init__::232::IOProcess::(_processLogs) (202804) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:20,316::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202804) Queuing response >Detector thread::DEBUG::2014-10-29 11:30:20,608::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54932 >Detector thread::DEBUG::2014-10-29 11:30:20,609::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54932 >Detector thread::DEBUG::2014-10-29 11:30:20,609::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54932 >Detector thread::DEBUG::2014-10-29 11:30:20,610::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54932) >Thread-137583::DEBUG::2014-10-29 11:30:20,648::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137583::DEBUG::2014-10-29 11:30:20,650::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137583::DEBUG::2014-10-29 11:30:20,651::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '6.26', 'elapsedTime': '514853', 'displayType': 'vnc', 'cpuSys': '1.06', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '2834667', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57841', 'readRate': '0.00', 'truesize': '6010912768', 'writeRate': '35663.22'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.45', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:30:21,127::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54934 >Detector thread::DEBUG::2014-10-29 11:30:21,128::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54934 >Detector thread::DEBUG::2014-10-29 11:30:21,128::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54934 >Detector thread::DEBUG::2014-10-29 11:30:21,129::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54934) >Thread-137584::DEBUG::2014-10-29 11:30:21,169::task::595::Storage.TaskManager.Task::(_updateState) Task=`22d821d8-715b-461b-8753-8d44ce11f2a7`::moving from state init -> state preparing >Thread-137584::INFO::2014-10-29 11:30:21,170::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137584::INFO::2014-10-29 11:30:21,171::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440152', 'lastCheck': '0.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00327326', 'lastCheck': '0.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473278', 'lastCheck': '1.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000596644', 'lastCheck': '1.0', 'valid': True}} >Thread-137584::DEBUG::2014-10-29 11:30:21,171::task::1191::Storage.TaskManager.Task::(prepare) Task=`22d821d8-715b-461b-8753-8d44ce11f2a7`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440152', 'lastCheck': '0.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00327326', 'lastCheck': '0.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473278', 'lastCheck': '1.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000596644', 'lastCheck': '1.0', 'valid': True}} >Thread-137584::DEBUG::2014-10-29 11:30:21,171::task::595::Storage.TaskManager.Task::(_updateState) Task=`22d821d8-715b-461b-8753-8d44ce11f2a7`::moving from state preparing -> state finished >Thread-137584::DEBUG::2014-10-29 11:30:21,171::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137584::DEBUG::2014-10-29 11:30:21,172::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137584::DEBUG::2014-10-29 11:30:21,172::task::993::Storage.TaskManager.Task::(_decref) Task=`22d821d8-715b-461b-8753-8d44ce11f2a7`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:30:21,231::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:21,235::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:21,237::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137585::DEBUG::2014-10-29 11:30:21,241::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:21,252::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:21,255::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137586::DEBUG::2014-10-29 11:30:21,258::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137586::DEBUG::2014-10-29 11:30:21,260::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:30:21,574::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54935 >Detector thread::DEBUG::2014-10-29 11:30:21,576::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54935 >Detector thread::DEBUG::2014-10-29 11:30:21,576::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54935 >Detector thread::DEBUG::2014-10-29 11:30:21,576::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54935) >Detector thread::DEBUG::2014-10-29 11:30:21,602::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54937 >Detector thread::DEBUG::2014-10-29 11:30:21,603::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54937 >Detector thread::DEBUG::2014-10-29 11:30:21,603::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54937 >Detector thread::DEBUG::2014-10-29 11:30:21,604::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54937) >Thread-137587::DEBUG::2014-10-29 11:30:21,616::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137587::DEBUG::2014-10-29 11:30:21,620::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137587::DEBUG::2014-10-29 11:30:21,639::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137588::DEBUG::2014-10-29 11:30:21,644::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137588::DEBUG::2014-10-29 11:30:21,646::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5953490-4ec0-4709-b693-0a476d3da9cc`::moving from state init -> state preparing >Thread-137588::INFO::2014-10-29 11:30:21,646::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137588::DEBUG::2014-10-29 11:30:21,650::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:30:21,652::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:21,658::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-137588::DEBUG::2014-10-29 11:30:21,658::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:30:21,661::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-137588::DEBUG::2014-10-29 11:30:21,662::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-17::DEBUG::2014-10-29 11:30:21,664::__init__::232::IOProcess::(_processLogs) (202805) Got request for method 'glob' >Thread-137588::INFO::2014-10-29 11:30:21,665::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-17::DEBUG::2014-10-29 11:30:21,667::__init__::232::IOProcess::(_processLogs) (202805) Queuing response >Thread-137588::DEBUG::2014-10-29 11:30:21,668::task::1191::Storage.TaskManager.Task::(prepare) Task=`c5953490-4ec0-4709-b693-0a476d3da9cc`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137588::DEBUG::2014-10-29 11:30:21,670::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5953490-4ec0-4709-b693-0a476d3da9cc`::moving from state preparing -> state finished >Thread-137588::DEBUG::2014-10-29 11:30:21,671::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137588::DEBUG::2014-10-29 11:30:21,672::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137588::DEBUG::2014-10-29 11:30:21,674::task::993::Storage.TaskManager.Task::(_decref) Task=`c5953490-4ec0-4709-b693-0a476d3da9cc`::ref 0 aborting False >Thread-137587::DEBUG::2014-10-29 11:30:21,720::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '169', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '69', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:30:21,724::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54938 >Detector thread::DEBUG::2014-10-29 11:30:21,727::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54938 >Detector thread::DEBUG::2014-10-29 11:30:21,729::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54938 >Detector thread::DEBUG::2014-10-29 11:30:21,730::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54938) >Thread-137589::DEBUG::2014-10-29 11:30:21,766::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137589::DEBUG::2014-10-29 11:30:21,767::task::595::Storage.TaskManager.Task::(_updateState) Task=`39f3debe-c404-49d4-b1e0-c63866040e3d`::moving from state init -> state preparing >Thread-137589::INFO::2014-10-29 11:30:21,767::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137589::DEBUG::2014-10-29 11:30:21,767::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137589::DEBUG::2014-10-29 11:30:21,768::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137589::DEBUG::2014-10-29 11:30:21,768::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137589::DEBUG::2014-10-29 11:30:21,768::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137589::DEBUG::2014-10-29 11:30:21,768::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137589::DEBUG::2014-10-29 11:30:21,769::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137589::DEBUG::2014-10-29 11:30:21,851::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137589::DEBUG::2014-10-29 11:30:21,852::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137589::DEBUG::2014-10-29 11:30:22,032::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137589::DEBUG::2014-10-29 11:30:22,032::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137589::DEBUG::2014-10-29 11:30:22,033::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137589::DEBUG::2014-10-29 11:30:22,033::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137589::DEBUG::2014-10-29 11:30:22,034::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137589::DEBUG::2014-10-29 11:30:22,034::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137589::DEBUG::2014-10-29 11:30:22,034::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137589::DEBUG::2014-10-29 11:30:22,035::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:30:22,038::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:22,039::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:22,039::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:22,041::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202806) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:30:22,044::__init__::232::IOProcess::(_processLogs) (202806) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:22,046::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:22,046::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:22,047::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:22,047::__init__::232::IOProcess::(_processLogs) (202807) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:30:22,048::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202807) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:22,049::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:22,049::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:22,050::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:22,050::__init__::232::IOProcess::(_processLogs) (202808) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:30:22,054::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202808) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:22,056::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:22,057::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:22,057::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:22,059::__init__::232::IOProcess::(_processLogs) (202809) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:30:22,061::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202809) Queuing response >Thread-137589::DEBUG::2014-10-29 11:30:22,064::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:30:22,065::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:22,065::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:22,065::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:22,065::__init__::232::IOProcess::(_processLogs) (202810) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:30:22,067::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202810) Queuing response >Thread-137589::DEBUG::2014-10-29 11:30:22,067::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:30:22,068::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:22,069::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:22,069::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:22,069::__init__::232::IOProcess::(_processLogs) (202811) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:30:22,070::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202811) Queuing response >Thread-137589::DEBUG::2014-10-29 11:30:22,070::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:30:22,072::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:22,073::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:22,073::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:22,074::__init__::232::IOProcess::(_processLogs) (202812) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:22,074::__init__::232::IOProcess::(_processLogs) (202812) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:22,075::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:22,075::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:22,076::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-137589::DEBUG::2014-10-29 11:30:22,076::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-137589::INFO::2014-10-29 11:30:22,077::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:30:22,077::__init__::232::IOProcess::(_processLogs) (202813) Got request for method 'glob' >Thread-137589::INFO::2014-10-29 11:30:22,078::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:30:22,079::__init__::232::IOProcess::(_processLogs) (202813) Queuing response >Thread-137589::INFO::2014-10-29 11:30:22,080::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:30:22,080::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:22,081::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:22,081::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:22,081::__init__::232::IOProcess::(_processLogs) (202814) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:30:22,082::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202814) Queuing response >Thread-137589::DEBUG::2014-10-29 11:30:22,082::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137589::DEBUG::2014-10-29 11:30:22,084::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`1a5462d9-6417-49fd-a609-82f2c12c9de6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137589::DEBUG::2014-10-29 11:30:22,084::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137589::DEBUG::2014-10-29 11:30:22,084::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137589::DEBUG::2014-10-29 11:30:22,085::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`1a5462d9-6417-49fd-a609-82f2c12c9de6`::Granted request >Thread-137589::DEBUG::2014-10-29 11:30:22,085::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`39f3debe-c404-49d4-b1e0-c63866040e3d`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137589::DEBUG::2014-10-29 11:30:22,086::task::993::Storage.TaskManager.Task::(_decref) Task=`39f3debe-c404-49d4-b1e0-c63866040e3d`::ref 1 aborting False >Thread-137589::INFO::2014-10-29 11:30:22,088::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137589::DEBUG::2014-10-29 11:30:22,089::task::1191::Storage.TaskManager.Task::(prepare) Task=`39f3debe-c404-49d4-b1e0-c63866040e3d`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137589::DEBUG::2014-10-29 11:30:22,089::task::595::Storage.TaskManager.Task::(_updateState) Task=`39f3debe-c404-49d4-b1e0-c63866040e3d`::moving from state preparing -> state finished >Thread-137589::DEBUG::2014-10-29 11:30:22,089::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137589::DEBUG::2014-10-29 11:30:22,089::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137589::DEBUG::2014-10-29 11:30:22,090::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137589::DEBUG::2014-10-29 11:30:22,090::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137589::DEBUG::2014-10-29 11:30:22,090::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137589::DEBUG::2014-10-29 11:30:22,091::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137589::DEBUG::2014-10-29 11:30:22,091::task::993::Storage.TaskManager.Task::(_decref) Task=`39f3debe-c404-49d4-b1e0-c63866040e3d`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:30:22,124::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54939 >Detector thread::DEBUG::2014-10-29 11:30:22,124::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54939 >Detector thread::DEBUG::2014-10-29 11:30:22,128::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54939 >Detector thread::DEBUG::2014-10-29 11:30:22,130::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54939) >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:22,137::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:22,139::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:22,140::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137594::DEBUG::2014-10-29 11:30:22,164::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137594::DEBUG::2014-10-29 11:30:22,164::task::595::Storage.TaskManager.Task::(_updateState) Task=`3b6a7bc8-d5f4-408a-bc1b-447241412c0b`::moving from state init -> state preparing >Thread-137594::INFO::2014-10-29 11:30:22,165::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137594::INFO::2014-10-29 11:30:22,165::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440152', 'lastCheck': '1.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00327326', 'lastCheck': '1.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473278', 'lastCheck': '2.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000596644', 'lastCheck': '2.0', 'valid': True}} >Thread-137594::DEBUG::2014-10-29 11:30:22,166::task::1191::Storage.TaskManager.Task::(prepare) Task=`3b6a7bc8-d5f4-408a-bc1b-447241412c0b`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440152', 'lastCheck': '1.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00327326', 'lastCheck': '1.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473278', 'lastCheck': '2.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000596644', 'lastCheck': '2.0', 'valid': True}} >Thread-137594::DEBUG::2014-10-29 11:30:22,166::task::595::Storage.TaskManager.Task::(_updateState) Task=`3b6a7bc8-d5f4-408a-bc1b-447241412c0b`::moving from state preparing -> state finished >Thread-137594::DEBUG::2014-10-29 11:30:22,166::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137594::DEBUG::2014-10-29 11:30:22,167::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137594::DEBUG::2014-10-29 11:30:22,167::task::993::Storage.TaskManager.Task::(_decref) Task=`3b6a7bc8-d5f4-408a-bc1b-447241412c0b`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:24,278::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:24,281::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137595::DEBUG::2014-10-29 11:30:24,285::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:24,287::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:24,289::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137596::DEBUG::2014-10-29 11:30:24,292::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137596::DEBUG::2014-10-29 11:30:24,295::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:27,147::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:27,148::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:27,150::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:27,312::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:27,315::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137597::DEBUG::2014-10-29 11:30:27,318::task::595::Storage.TaskManager.Task::(_updateState) Task=`79d2ed41-ea0b-4411-8011-4bc01455c5f8`::moving from state init -> state preparing >Thread-137597::INFO::2014-10-29 11:30:27,318::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137597::INFO::2014-10-29 11:30:27,319::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440152', 'lastCheck': '7.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00327326', 'lastCheck': '7.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473278', 'lastCheck': '7.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000596644', 'lastCheck': '7.2', 'valid': True}} >Thread-137597::DEBUG::2014-10-29 11:30:27,319::task::1191::Storage.TaskManager.Task::(prepare) Task=`79d2ed41-ea0b-4411-8011-4bc01455c5f8`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440152', 'lastCheck': '7.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00327326', 'lastCheck': '7.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473278', 'lastCheck': '7.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000596644', 'lastCheck': '7.2', 'valid': True}} >Thread-137597::DEBUG::2014-10-29 11:30:27,320::task::595::Storage.TaskManager.Task::(_updateState) Task=`79d2ed41-ea0b-4411-8011-4bc01455c5f8`::moving from state preparing -> state finished >Thread-137597::DEBUG::2014-10-29 11:30:27,320::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137597::DEBUG::2014-10-29 11:30:27,320::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137597::DEBUG::2014-10-29 11:30:27,320::task::993::Storage.TaskManager.Task::(_decref) Task=`79d2ed41-ea0b-4411-8011-4bc01455c5f8`::ref 0 aborting False >Thread-137597::DEBUG::2014-10-29 11:30:27,364::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:27,390::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:27,392::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137598::DEBUG::2014-10-29 11:30:27,395::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137598::DEBUG::2014-10-29 11:30:27,398::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:30:30,120::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:30,120::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:30,121::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:30,121::__init__::232::IOProcess::(_processLogs) (202815) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:30,121::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202815) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:30,126::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-179::DEBUG::2014-10-29 11:30:30,126::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:30:30,127::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:30,142::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:30,143::__init__::232::IOProcess::(_processLogs) (202816) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:30,146::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202816) Queuing response >Thread-10269::DEBUG::2014-10-29 11:30:30,150::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:30:30,150::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000506723 s, 734 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:30:30,169::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:30,170::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:30,170::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:30,171::__init__::232::IOProcess::(_processLogs) (202817) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:30,172::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202817) Queuing response >Thread-10269::DEBUG::2014-10-29 11:30:30,174::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00193508 s, 259 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:30:30,179::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:30,181::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:30,184::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:30,185::__init__::232::IOProcess::(_processLogs) (202818) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:30,186::__init__::232::IOProcess::(_processLogs) (202818) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:30,239::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:30,239::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:30,240::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:30,240::__init__::232::IOProcess::(_processLogs) (202819) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:30,240::__init__::232::IOProcess::(_processLogs) (202819) Queuing response >Thread-33::DEBUG::2014-10-29 11:30:30,242::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:30:30,270::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000438964 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:30:30,271::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:30,272::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:30,272::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:30,272::__init__::232::IOProcess::(_processLogs) (202820) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:30,274::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202820) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:30,276::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:30,276::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:30,276::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:30,277::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202821) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:30,278::__init__::232::IOProcess::(_processLogs) (202821) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:30,278::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:30,279::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Detector thread::DEBUG::2014-10-29 11:30:30,282::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54940 >Thread-17::DEBUG::2014-10-29 11:30:30,282::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Detector thread::DEBUG::2014-10-29 11:30:30,283::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54940 >Thread-17::DEBUG::2014-10-29 11:30:30,284::__init__::232::IOProcess::(_processLogs) (202822) Got request for method 'access' >Detector thread::DEBUG::2014-10-29 11:30:30,285::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54940 >Thread-17::DEBUG::2014-10-29 11:30:30,288::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202822) Queuing response >Detector thread::DEBUG::2014-10-29 11:30:30,288::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54940) >Thread-17::DEBUG::2014-10-29 11:30:30,294::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:30,294::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:30,295::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:30,296::__init__::232::IOProcess::(_processLogs) (202823) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:30,297::__init__::232::IOProcess::(_processLogs) (202823) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:30,318::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:30,318::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:30,320::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-178::DEBUG::2014-10-29 11:30:30,321::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:30:30,322::__init__::232::IOProcess::(_processLogs) (202824) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:30,342::__init__::232::IOProcess::(_processLogs) (202824) Queuing response >Thread-178::DEBUG::2014-10-29 11:30:30,347::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000552368 s, 920 kB/s\n'; <rc> = 0 >Thread-137599::DEBUG::2014-10-29 11:30:30,348::task::595::Storage.TaskManager.Task::(_updateState) Task=`73fc65c9-940f-43b6-9bcb-7fb14d6f6d96`::moving from state init -> state preparing >Thread-137599::INFO::2014-10-29 11:30:30,351::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-17::DEBUG::2014-10-29 11:30:30,353::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:30,355::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137599::INFO::2014-10-29 11:30:30,355::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440152', 'lastCheck': '10.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000438964', 'lastCheck': '0.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506723', 'lastCheck': '0.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00193508', 'lastCheck': '0.2', 'valid': True}} >Thread-17::DEBUG::2014-10-29 11:30:30,357::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-137599::DEBUG::2014-10-29 11:30:30,358::task::1191::Storage.TaskManager.Task::(prepare) Task=`73fc65c9-940f-43b6-9bcb-7fb14d6f6d96`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000440152', 'lastCheck': '10.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000438964', 'lastCheck': '0.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506723', 'lastCheck': '0.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00193508', 'lastCheck': '0.2', 'valid': True}} >Thread-17::DEBUG::2014-10-29 11:30:30,358::__init__::232::IOProcess::(_processLogs) (202825) Got request for method 'statvfs' >Thread-137599::DEBUG::2014-10-29 11:30:30,359::task::595::Storage.TaskManager.Task::(_updateState) Task=`73fc65c9-940f-43b6-9bcb-7fb14d6f6d96`::moving from state preparing -> state finished >Thread-137599::DEBUG::2014-10-29 11:30:30,361::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137599::DEBUG::2014-10-29 11:30:30,363::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17::DEBUG::2014-10-29 11:30:30,365::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202825) Queuing response >Thread-137599::DEBUG::2014-10-29 11:30:30,367::task::993::Storage.TaskManager.Task::(_decref) Task=`73fc65c9-940f-43b6-9bcb-7fb14d6f6d96`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:30:30,372::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:30,375::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:30,377::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:30,379::__init__::232::IOProcess::(_processLogs) (202826) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:30,379::__init__::232::IOProcess::(_processLogs) (202826) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:30,379::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:30,380::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:30,381::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:30,383::__init__::232::IOProcess::(_processLogs) (202827) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:30,383::__init__::232::IOProcess::(_processLogs) (202827) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:30,383::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:30,384::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:30,384::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:30,384::__init__::232::IOProcess::(_processLogs) (202828) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:30,385::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202828) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:30,448::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:30,450::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137600::DEBUG::2014-10-29 11:30:30,454::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:30,456::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:30,458::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137601::DEBUG::2014-10-29 11:30:30,462::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137601::DEBUG::2014-10-29 11:30:30,464::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:30:30,810::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54941 >Detector thread::DEBUG::2014-10-29 11:30:30,811::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54941 >Detector thread::DEBUG::2014-10-29 11:30:30,811::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54941 >Detector thread::DEBUG::2014-10-29 11:30:30,812::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54941) >Thread-137602::DEBUG::2014-10-29 11:30:30,851::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137602::DEBUG::2014-10-29 11:30:30,852::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137602::DEBUG::2014-10-29 11:30:30,853::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.93', 'elapsedTime': '514863', 'displayType': 'vnc', 'cpuSys': '1.06', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '2834667', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57841', 'readRate': '0.00', 'truesize': '6010912768', 'writeRate': '35663.22'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.62', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:30:31,780::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54943 >Detector thread::DEBUG::2014-10-29 11:30:31,780::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54943 >Detector thread::DEBUG::2014-10-29 11:30:31,781::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54943 >Detector thread::DEBUG::2014-10-29 11:30:31,781::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54943) >Thread-137603::DEBUG::2014-10-29 11:30:31,820::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137603::DEBUG::2014-10-29 11:30:31,822::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137603::DEBUG::2014-10-29 11:30:31,839::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137603::DEBUG::2014-10-29 11:30:31,883::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '152', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '52', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:32,157::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:32,158::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:32,160::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:30:32,714::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54945 >Detector thread::DEBUG::2014-10-29 11:30:32,715::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54945 >Detector thread::DEBUG::2014-10-29 11:30:32,715::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54945 >Detector thread::DEBUG::2014-10-29 11:30:32,716::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54945) >Thread-137604::DEBUG::2014-10-29 11:30:32,755::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137604::DEBUG::2014-10-29 11:30:32,756::task::595::Storage.TaskManager.Task::(_updateState) Task=`9212686a-16e9-425d-8c28-ba7454c9d4f9`::moving from state init -> state preparing >Thread-137604::INFO::2014-10-29 11:30:32,756::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137604::DEBUG::2014-10-29 11:30:32,760::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:30:32,761::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:32,761::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:32,762::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:32,762::__init__::232::IOProcess::(_processLogs) (202829) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:30:32,762::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202829) Queuing response >Thread-137604::DEBUG::2014-10-29 11:30:32,763::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137604::DEBUG::2014-10-29 11:30:32,764::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137604::INFO::2014-10-29 11:30:32,764::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137604::DEBUG::2014-10-29 11:30:32,764::task::1191::Storage.TaskManager.Task::(prepare) Task=`9212686a-16e9-425d-8c28-ba7454c9d4f9`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137604::DEBUG::2014-10-29 11:30:32,765::task::595::Storage.TaskManager.Task::(_updateState) Task=`9212686a-16e9-425d-8c28-ba7454c9d4f9`::moving from state preparing -> state finished >Thread-137604::DEBUG::2014-10-29 11:30:32,765::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137604::DEBUG::2014-10-29 11:30:32,765::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137604::DEBUG::2014-10-29 11:30:32,765::task::993::Storage.TaskManager.Task::(_decref) Task=`9212686a-16e9-425d-8c28-ba7454c9d4f9`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:30:32,809::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54946 >Detector thread::DEBUG::2014-10-29 11:30:32,809::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54946 >Detector thread::DEBUG::2014-10-29 11:30:32,809::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54946 >Detector thread::DEBUG::2014-10-29 11:30:32,810::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54946) >Thread-137605::DEBUG::2014-10-29 11:30:32,849::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137605::DEBUG::2014-10-29 11:30:32,849::task::595::Storage.TaskManager.Task::(_updateState) Task=`a459923a-03e4-467a-a921-541afecea115`::moving from state init -> state preparing >Thread-137605::INFO::2014-10-29 11:30:32,850::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137605::DEBUG::2014-10-29 11:30:32,850::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137605::DEBUG::2014-10-29 11:30:32,850::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137605::DEBUG::2014-10-29 11:30:32,851::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137605::DEBUG::2014-10-29 11:30:32,851::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137605::DEBUG::2014-10-29 11:30:32,851::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137605::DEBUG::2014-10-29 11:30:32,852::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137605::DEBUG::2014-10-29 11:30:32,937::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137605::DEBUG::2014-10-29 11:30:32,938::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137605::DEBUG::2014-10-29 11:30:33,102::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137605::DEBUG::2014-10-29 11:30:33,103::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137605::DEBUG::2014-10-29 11:30:33,103::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137605::DEBUG::2014-10-29 11:30:33,104::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137605::DEBUG::2014-10-29 11:30:33,104::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137605::DEBUG::2014-10-29 11:30:33,105::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137605::DEBUG::2014-10-29 11:30:33,105::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137605::DEBUG::2014-10-29 11:30:33,105::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:30:33,112::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:33,114::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:33,114::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:33,114::__init__::232::IOProcess::(_processLogs) (202830) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:30:33,116::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202830) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:33,118::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:33,118::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:33,119::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:33,119::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:33,119::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:33,120::__init__::232::IOProcess::(_processLogs) (202831) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:30:33,121::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202831) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:33,122::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:33,124::__init__::232::IOProcess::(_processLogs) (202832) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:30:33,126::__init__::232::IOProcess::(_processLogs) (202832) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:33,128::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:33,129::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:33,132::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:33,133::__init__::232::IOProcess::(_processLogs) (202833) Got request for method 'glob' >Thread-137605::DEBUG::2014-10-29 11:30:33,133::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:30:33,136::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202833) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:33,138::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:33,139::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:33,139::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:33,139::__init__::232::IOProcess::(_processLogs) (202834) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:30:33,140::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202834) Queuing response >Thread-137605::DEBUG::2014-10-29 11:30:33,140::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:30:33,142::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:33,143::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:33,143::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:33,143::__init__::232::IOProcess::(_processLogs) (202835) Got request for method 'readfile' >Thread-137605::DEBUG::2014-10-29 11:30:33,145::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:30:33,144::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202835) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:33,147::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:33,148::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:33,148::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:33,149::__init__::232::IOProcess::(_processLogs) (202836) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:33,149::__init__::232::IOProcess::(_processLogs) (202836) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:33,149::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:33,150::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:33,150::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:33,150::__init__::232::IOProcess::(_processLogs) (202837) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:30:33,151::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202837) Queuing response >Thread-137605::DEBUG::2014-10-29 11:30:33,152::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-137605::INFO::2014-10-29 11:30:33,152::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137605::INFO::2014-10-29 11:30:33,153::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137605::INFO::2014-10-29 11:30:33,153::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:30:33,154::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:33,154::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:33,154::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:33,155::__init__::232::IOProcess::(_processLogs) (202838) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:30:33,158::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202838) Queuing response >Thread-137605::DEBUG::2014-10-29 11:30:33,158::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137605::DEBUG::2014-10-29 11:30:33,160::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`8b4398d1-3c16-41e8-baaf-c16f816be94a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137605::DEBUG::2014-10-29 11:30:33,160::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137605::DEBUG::2014-10-29 11:30:33,160::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137605::DEBUG::2014-10-29 11:30:33,161::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`8b4398d1-3c16-41e8-baaf-c16f816be94a`::Granted request >Thread-137605::DEBUG::2014-10-29 11:30:33,161::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a459923a-03e4-467a-a921-541afecea115`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137605::DEBUG::2014-10-29 11:30:33,162::task::993::Storage.TaskManager.Task::(_decref) Task=`a459923a-03e4-467a-a921-541afecea115`::ref 1 aborting False >Thread-137605::INFO::2014-10-29 11:30:33,164::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137605::DEBUG::2014-10-29 11:30:33,165::task::1191::Storage.TaskManager.Task::(prepare) Task=`a459923a-03e4-467a-a921-541afecea115`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137605::DEBUG::2014-10-29 11:30:33,165::task::595::Storage.TaskManager.Task::(_updateState) Task=`a459923a-03e4-467a-a921-541afecea115`::moving from state preparing -> state finished >Thread-137605::DEBUG::2014-10-29 11:30:33,165::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137605::DEBUG::2014-10-29 11:30:33,165::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137605::DEBUG::2014-10-29 11:30:33,166::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137605::DEBUG::2014-10-29 11:30:33,166::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137605::DEBUG::2014-10-29 11:30:33,166::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137605::DEBUG::2014-10-29 11:30:33,167::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137605::DEBUG::2014-10-29 11:30:33,167::task::993::Storage.TaskManager.Task::(_decref) Task=`a459923a-03e4-467a-a921-541afecea115`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:30:33,190::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54947 >Detector thread::DEBUG::2014-10-29 11:30:33,191::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54947 >Detector thread::DEBUG::2014-10-29 11:30:33,191::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54947 >Detector thread::DEBUG::2014-10-29 11:30:33,192::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54947) >Thread-137610::DEBUG::2014-10-29 11:30:33,231::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137610::DEBUG::2014-10-29 11:30:33,231::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6fa17b6-e092-41d1-91ad-a977ee17821d`::moving from state init -> state preparing >Thread-137610::INFO::2014-10-29 11:30:33,232::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137610::INFO::2014-10-29 11:30:33,232::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552368', 'lastCheck': '2.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000438964', 'lastCheck': '2.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506723', 'lastCheck': '3.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00193508', 'lastCheck': '3.0', 'valid': True}} >Thread-137610::DEBUG::2014-10-29 11:30:33,233::task::1191::Storage.TaskManager.Task::(prepare) Task=`b6fa17b6-e092-41d1-91ad-a977ee17821d`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552368', 'lastCheck': '2.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000438964', 'lastCheck': '2.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000506723', 'lastCheck': '3.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00193508', 'lastCheck': '3.0', 'valid': True}} >Thread-137610::DEBUG::2014-10-29 11:30:33,233::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6fa17b6-e092-41d1-91ad-a977ee17821d`::moving from state preparing -> state finished >Thread-137610::DEBUG::2014-10-29 11:30:33,233::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137610::DEBUG::2014-10-29 11:30:33,235::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137610::DEBUG::2014-10-29 11:30:33,235::task::993::Storage.TaskManager.Task::(_decref) Task=`b6fa17b6-e092-41d1-91ad-a977ee17821d`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:33,481::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:33,484::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137611::DEBUG::2014-10-29 11:30:33,487::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:33,489::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:33,491::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137612::DEBUG::2014-10-29 11:30:33,494::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137612::DEBUG::2014-10-29 11:30:33,496::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:30:34,967::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >Thread-22::DEBUG::2014-10-29 11:30:36,254::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:36,510::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:36,513::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137613::DEBUG::2014-10-29 11:30:36,517::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:36,519::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:36,520::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137614::DEBUG::2014-10-29 11:30:36,524::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137614::DEBUG::2014-10-29 11:30:36,526::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:37,166::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:37,167::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:37,170::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:39,541::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:39,544::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137615::DEBUG::2014-10-29 11:30:39,548::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:39,550::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:39,552::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137616::DEBUG::2014-10-29 11:30:39,556::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137616::DEBUG::2014-10-29 11:30:39,558::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:30:40,183::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:40,184::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:40,184::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:40,184::__init__::232::IOProcess::(_processLogs) (202839) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:40,186::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:40,186::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:40,187::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:40,189::__init__::232::IOProcess::(_processLogs) (202840) Got request for method 'statvfs' >Thread-179::DEBUG::2014-10-29 11:30:40,189::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:30:40,190::__init__::232::IOProcess::(_processLogs) (202839) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:40,206::__init__::232::IOProcess::(_processLogs) (202840) Queuing response >Thread-10269::DEBUG::2014-10-29 11:30:40,209::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:30:40,224::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000619333 s, 601 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:30:40,226::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:40,227::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10269::DEBUG::2014-10-29 11:30:40,230::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00174807 s, 287 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:30:40,230::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:40,233::__init__::232::IOProcess::(_processLogs) (202841) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:40,234::__init__::232::IOProcess::(_processLogs) (202841) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:40,236::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:40,236::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:40,236::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:40,236::__init__::232::IOProcess::(_processLogs) (202842) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:40,238::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202842) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:40,298::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:40,298::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:40,299::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:40,299::__init__::232::IOProcess::(_processLogs) (202843) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:40,299::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202843) Queuing response >Thread-33::DEBUG::2014-10-29 11:30:40,301::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:30:40,320::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000418392 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:30:40,321::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:40,322::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:40,322::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:40,322::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202844) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:40,324::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202844) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:40,326::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:40,326::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:40,327::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:40,328::__init__::232::IOProcess::(_processLogs) (202845) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:40,328::__init__::232::IOProcess::(_processLogs) (202845) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:40,328::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:40,329::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:40,330::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:40,330::__init__::232::IOProcess::(_processLogs) (202846) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:40,331::__init__::232::IOProcess::(_processLogs) (202846) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:40,331::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:40,331::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:40,332::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:40,332::__init__::232::IOProcess::(_processLogs) (202847) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:40,334::__init__::232::IOProcess::(_processLogs) (202847) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:40,387::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:40,388::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:40,389::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-178::DEBUG::2014-10-29 11:30:40,390::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:30:40,391::__init__::232::IOProcess::(_processLogs) (202848) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:40,408::__init__::232::IOProcess::(_processLogs) (202848) Queuing response >Thread-178::DEBUG::2014-10-29 11:30:40,409::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000683532 s, 743 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:30:40,410::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:40,411::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:40,412::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:40,412::__init__::232::IOProcess::(_processLogs) (202849) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:40,413::__init__::232::IOProcess::(_processLogs) (202849) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:40,414::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:40,414::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:40,414::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:40,415::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202850) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:40,416::__init__::232::IOProcess::(_processLogs) (202850) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:40,417::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:40,417::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:40,417::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:40,417::__init__::232::IOProcess::(_processLogs) (202851) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:40,418::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202851) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:40,419::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:40,419::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:40,419::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:40,420::__init__::232::IOProcess::(_processLogs) (202852) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:40,421::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202852) Queuing response >Detector thread::DEBUG::2014-10-29 11:30:40,453::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54948 >Detector thread::DEBUG::2014-10-29 11:30:40,453::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54948 >Detector thread::DEBUG::2014-10-29 11:30:40,454::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54948 >Detector thread::DEBUG::2014-10-29 11:30:40,454::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54948) >Thread-137617::DEBUG::2014-10-29 11:30:40,494::task::595::Storage.TaskManager.Task::(_updateState) Task=`00b78e59-1c9c-40cc-b84d-ce2c6bc19942`::moving from state init -> state preparing >Thread-137617::INFO::2014-10-29 11:30:40,495::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137617::INFO::2014-10-29 11:30:40,495::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683532', 'lastCheck': '0.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418392', 'lastCheck': '0.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619333', 'lastCheck': '0.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00174807', 'lastCheck': '0.3', 'valid': True}} >Thread-137617::DEBUG::2014-10-29 11:30:40,496::task::1191::Storage.TaskManager.Task::(prepare) Task=`00b78e59-1c9c-40cc-b84d-ce2c6bc19942`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683532', 'lastCheck': '0.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418392', 'lastCheck': '0.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619333', 'lastCheck': '0.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00174807', 'lastCheck': '0.3', 'valid': True}} >Thread-137617::DEBUG::2014-10-29 11:30:40,496::task::595::Storage.TaskManager.Task::(_updateState) Task=`00b78e59-1c9c-40cc-b84d-ce2c6bc19942`::moving from state preparing -> state finished >Thread-137617::DEBUG::2014-10-29 11:30:40,496::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137617::DEBUG::2014-10-29 11:30:40,496::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137617::DEBUG::2014-10-29 11:30:40,497::task::993::Storage.TaskManager.Task::(_decref) Task=`00b78e59-1c9c-40cc-b84d-ce2c6bc19942`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:30:41,001::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54949 >Detector thread::DEBUG::2014-10-29 11:30:41,001::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54949 >Detector thread::DEBUG::2014-10-29 11:30:41,002::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54949 >Detector thread::DEBUG::2014-10-29 11:30:41,002::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54949) >Thread-137618::DEBUG::2014-10-29 11:30:41,041::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137618::DEBUG::2014-10-29 11:30:41,042::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137618::DEBUG::2014-10-29 11:30:41,043::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '6.09', 'elapsedTime': '514873', 'displayType': 'vnc', 'cpuSys': '1.06', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '2834667', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57841', 'readRate': '0.00', 'truesize': '6010912768', 'writeRate': '35663.22'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.79', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:30:41,932::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54951 >Detector thread::DEBUG::2014-10-29 11:30:41,933::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54951 >Detector thread::DEBUG::2014-10-29 11:30:41,933::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54951 >Detector thread::DEBUG::2014-10-29 11:30:41,933::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54951) >Thread-137619::DEBUG::2014-10-29 11:30:41,972::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137619::DEBUG::2014-10-29 11:30:41,974::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137619::DEBUG::2014-10-29 11:30:41,991::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137619::DEBUG::2014-10-29 11:30:42,038::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '137', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '37', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:42,177::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:42,179::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:42,180::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:42,573::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:42,575::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137620::DEBUG::2014-10-29 11:30:42,579::task::595::Storage.TaskManager.Task::(_updateState) Task=`22d274d1-04ec-4caf-a4ef-c4233c5ec51f`::moving from state init -> state preparing >Thread-137620::INFO::2014-10-29 11:30:42,579::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137620::INFO::2014-10-29 11:30:42,580::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683532', 'lastCheck': '2.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418392', 'lastCheck': '2.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619333', 'lastCheck': '2.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00174807', 'lastCheck': '2.3', 'valid': True}} >Thread-137620::DEBUG::2014-10-29 11:30:42,580::task::1191::Storage.TaskManager.Task::(prepare) Task=`22d274d1-04ec-4caf-a4ef-c4233c5ec51f`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683532', 'lastCheck': '2.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418392', 'lastCheck': '2.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619333', 'lastCheck': '2.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00174807', 'lastCheck': '2.3', 'valid': True}} >Thread-137620::DEBUG::2014-10-29 11:30:42,581::task::595::Storage.TaskManager.Task::(_updateState) Task=`22d274d1-04ec-4caf-a4ef-c4233c5ec51f`::moving from state preparing -> state finished >Thread-137620::DEBUG::2014-10-29 11:30:42,581::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137620::DEBUG::2014-10-29 11:30:42,581::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137620::DEBUG::2014-10-29 11:30:42,581::task::993::Storage.TaskManager.Task::(_decref) Task=`22d274d1-04ec-4caf-a4ef-c4233c5ec51f`::ref 0 aborting False >Thread-137620::DEBUG::2014-10-29 11:30:42,603::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:42,626::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:42,628::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137621::DEBUG::2014-10-29 11:30:42,631::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137621::DEBUG::2014-10-29 11:30:42,633::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:30:43,797::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54953 >Detector thread::DEBUG::2014-10-29 11:30:43,798::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54953 >Detector thread::DEBUG::2014-10-29 11:30:43,798::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54953 >Detector thread::DEBUG::2014-10-29 11:30:43,799::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54953) >Thread-137622::DEBUG::2014-10-29 11:30:43,838::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137622::DEBUG::2014-10-29 11:30:43,838::task::595::Storage.TaskManager.Task::(_updateState) Task=`49115ea4-1b09-4dc5-829b-4acbc699ef2f`::moving from state init -> state preparing >Thread-137622::INFO::2014-10-29 11:30:43,839::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137622::DEBUG::2014-10-29 11:30:43,842::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:30:43,842::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:43,843::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:43,843::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:43,843::__init__::232::IOProcess::(_processLogs) (202853) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:30:43,844::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202853) Queuing response >Thread-137622::DEBUG::2014-10-29 11:30:43,844::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137622::DEBUG::2014-10-29 11:30:43,846::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137622::INFO::2014-10-29 11:30:43,846::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137622::DEBUG::2014-10-29 11:30:43,846::task::1191::Storage.TaskManager.Task::(prepare) Task=`49115ea4-1b09-4dc5-829b-4acbc699ef2f`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137622::DEBUG::2014-10-29 11:30:43,847::task::595::Storage.TaskManager.Task::(_updateState) Task=`49115ea4-1b09-4dc5-829b-4acbc699ef2f`::moving from state preparing -> state finished >Thread-137622::DEBUG::2014-10-29 11:30:43,847::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137622::DEBUG::2014-10-29 11:30:43,847::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137622::DEBUG::2014-10-29 11:30:43,847::task::993::Storage.TaskManager.Task::(_decref) Task=`49115ea4-1b09-4dc5-829b-4acbc699ef2f`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:30:43,892::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54954 >Detector thread::DEBUG::2014-10-29 11:30:43,892::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54954 >Detector thread::DEBUG::2014-10-29 11:30:43,893::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54954 >Detector thread::DEBUG::2014-10-29 11:30:43,893::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54954) >Thread-137623::DEBUG::2014-10-29 11:30:43,933::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137623::DEBUG::2014-10-29 11:30:43,934::task::595::Storage.TaskManager.Task::(_updateState) Task=`287ad55e-b723-4a99-8a4b-04505ad49d43`::moving from state init -> state preparing >Thread-137623::INFO::2014-10-29 11:30:43,934::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137623::DEBUG::2014-10-29 11:30:43,934::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137623::DEBUG::2014-10-29 11:30:43,935::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137623::DEBUG::2014-10-29 11:30:43,935::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137623::DEBUG::2014-10-29 11:30:43,935::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137623::DEBUG::2014-10-29 11:30:43,936::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137623::DEBUG::2014-10-29 11:30:43,936::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137623::DEBUG::2014-10-29 11:30:44,029::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137623::DEBUG::2014-10-29 11:30:44,030::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137623::DEBUG::2014-10-29 11:30:44,199::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137623::DEBUG::2014-10-29 11:30:44,201::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137623::DEBUG::2014-10-29 11:30:44,202::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137623::DEBUG::2014-10-29 11:30:44,202::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137623::DEBUG::2014-10-29 11:30:44,202::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137623::DEBUG::2014-10-29 11:30:44,203::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137623::DEBUG::2014-10-29 11:30:44,203::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137623::DEBUG::2014-10-29 11:30:44,204::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:30:44,222::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:44,224::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:44,224::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:44,224::__init__::232::IOProcess::(_processLogs) (202854) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:30:44,226::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202854) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:44,227::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:44,229::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:44,230::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:44,232::__init__::232::IOProcess::(_processLogs) (202855) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:30:44,234::__init__::232::IOProcess::(_processLogs) (202855) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:44,236::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:44,236::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:44,237::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:44,239::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137623::DEBUG::2014-10-29 11:30:44,242::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:30:44,244::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:44,244::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:44,244::__init__::232::IOProcess::(_processLogs) (202856) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:30:44,245::__init__::232::IOProcess::(_processLogs) (202857) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:30:44,245::__init__::232::IOProcess::(_processLogs) (202857) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:44,245::__init__::232::IOProcess::(_processLogs) (202856) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:44,248::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:44,249::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:44,249::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:44,249::__init__::232::IOProcess::(_processLogs) (202858) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:30:44,249::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202858) Queuing response >Thread-137623::DEBUG::2014-10-29 11:30:44,250::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:30:44,251::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:44,251::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:44,252::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:44,252::__init__::232::IOProcess::(_processLogs) (202859) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:30:44,253::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202859) Queuing response >Thread-137623::DEBUG::2014-10-29 11:30:44,253::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:30:44,255::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:44,256::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:44,257::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:44,257::__init__::232::IOProcess::(_processLogs) (202860) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:44,257::__init__::232::IOProcess::(_processLogs) (202860) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:44,258::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:44,258::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:44,259::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-137623::DEBUG::2014-10-29 11:30:44,259::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-137623::INFO::2014-10-29 11:30:44,260::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:30:44,260::__init__::232::IOProcess::(_processLogs) (202861) Got request for method 'glob' >Thread-137623::INFO::2014-10-29 11:30:44,261::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:30:44,262::__init__::232::IOProcess::(_processLogs) (202861) Queuing response >Thread-137623::INFO::2014-10-29 11:30:44,263::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:30:44,264::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:44,265::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:44,265::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:44,265::__init__::232::IOProcess::(_processLogs) (202862) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:30:44,266::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202862) Queuing response >Thread-137623::DEBUG::2014-10-29 11:30:44,266::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137623::DEBUG::2014-10-29 11:30:44,269::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`cd7ee240-3b18-4771-9048-7bed69b3f4c9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137623::DEBUG::2014-10-29 11:30:44,269::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137623::DEBUG::2014-10-29 11:30:44,269::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137623::DEBUG::2014-10-29 11:30:44,270::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`cd7ee240-3b18-4771-9048-7bed69b3f4c9`::Granted request >Thread-137623::DEBUG::2014-10-29 11:30:44,270::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`287ad55e-b723-4a99-8a4b-04505ad49d43`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137623::DEBUG::2014-10-29 11:30:44,271::task::993::Storage.TaskManager.Task::(_decref) Task=`287ad55e-b723-4a99-8a4b-04505ad49d43`::ref 1 aborting False >Thread-137623::INFO::2014-10-29 11:30:44,273::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137623::DEBUG::2014-10-29 11:30:44,274::task::1191::Storage.TaskManager.Task::(prepare) Task=`287ad55e-b723-4a99-8a4b-04505ad49d43`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137623::DEBUG::2014-10-29 11:30:44,274::task::595::Storage.TaskManager.Task::(_updateState) Task=`287ad55e-b723-4a99-8a4b-04505ad49d43`::moving from state preparing -> state finished >Thread-137623::DEBUG::2014-10-29 11:30:44,274::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137623::DEBUG::2014-10-29 11:30:44,275::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137623::DEBUG::2014-10-29 11:30:44,275::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137623::DEBUG::2014-10-29 11:30:44,275::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137623::DEBUG::2014-10-29 11:30:44,276::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137623::DEBUG::2014-10-29 11:30:44,276::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137623::DEBUG::2014-10-29 11:30:44,276::task::993::Storage.TaskManager.Task::(_decref) Task=`287ad55e-b723-4a99-8a4b-04505ad49d43`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:30:44,309::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54955 >Detector thread::DEBUG::2014-10-29 11:30:44,309::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54955 >Detector thread::DEBUG::2014-10-29 11:30:44,310::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54955 >Detector thread::DEBUG::2014-10-29 11:30:44,310::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54955) >Thread-137628::DEBUG::2014-10-29 11:30:44,349::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137628::DEBUG::2014-10-29 11:30:44,349::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d9a8cb0-9640-4518-b02f-ac38947dfda5`::moving from state init -> state preparing >Thread-137628::INFO::2014-10-29 11:30:44,350::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137628::INFO::2014-10-29 11:30:44,351::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683532', 'lastCheck': '3.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418392', 'lastCheck': '4.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619333', 'lastCheck': '4.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00174807', 'lastCheck': '4.1', 'valid': True}} >Thread-137628::DEBUG::2014-10-29 11:30:44,351::task::1191::Storage.TaskManager.Task::(prepare) Task=`9d9a8cb0-9640-4518-b02f-ac38947dfda5`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683532', 'lastCheck': '3.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000418392', 'lastCheck': '4.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619333', 'lastCheck': '4.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00174807', 'lastCheck': '4.1', 'valid': True}} >Thread-137628::DEBUG::2014-10-29 11:30:44,351::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d9a8cb0-9640-4518-b02f-ac38947dfda5`::moving from state preparing -> state finished >Thread-137628::DEBUG::2014-10-29 11:30:44,351::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137628::DEBUG::2014-10-29 11:30:44,352::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137628::DEBUG::2014-10-29 11:30:44,352::task::993::Storage.TaskManager.Task::(_decref) Task=`9d9a8cb0-9640-4518-b02f-ac38947dfda5`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:45,676::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:45,678::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137629::DEBUG::2014-10-29 11:30:45,684::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:45,687::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:45,689::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137630::DEBUG::2014-10-29 11:30:45,694::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137630::DEBUG::2014-10-29 11:30:45,696::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:47,187::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:47,189::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:47,192::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:48,714::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:48,716::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137631::DEBUG::2014-10-29 11:30:48,719::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:48,721::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:48,723::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137632::DEBUG::2014-10-29 11:30:48,726::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137632::DEBUG::2014-10-29 11:30:48,728::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:30:50,236::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:50,237::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:50,237::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:50,237::__init__::232::IOProcess::(_processLogs) (202863) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:50,238::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202863) Queuing response >Thread-10269::DEBUG::2014-10-29 11:30:50,240::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain de096187-36e2-44e5-b8db-a9b67c3960de >Thread-179::DEBUG::2014-10-29 11:30:50,242::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:30:50,265::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000548717 s, 678 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:30:50,271::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:50,274::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:50,275::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:50,275::__init__::232::IOProcess::(_processLogs) (202864) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:30:50,276::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202864) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:50,277::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:50,278::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:50,278::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:50,278::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:50,279::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:50,279::__init__::232::IOProcess::(_processLogs) (202865) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:30:50,280::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202865) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:50,281::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:50,281::__init__::232::IOProcess::(_processLogs) (202866) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:50,281::__init__::232::IOProcess::(_processLogs) (202866) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:50,282::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:50,282::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:50,282::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:50,282::__init__::232::IOProcess::(_processLogs) (202867) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:30:50,284::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202867) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:50,286::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:50,289::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:50,290::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:50,292::__init__::232::IOProcess::(_processLogs) (202868) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:30:50,294::__init__::232::IOProcess::(_processLogs) (202868) Queuing response >Thread-10269::DEBUG::2014-10-29 11:30:50,297::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de >Thread-17::DEBUG::2014-10-29 11:30:50,298::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:50,299::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:50,299::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:50,299::__init__::232::IOProcess::(_processLogs) (202869) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:30:50,300::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202869) Queuing response >Thread-10269::DEBUG::2014-10-29 11:30:50,301::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:30:50,301::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:50,302::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:50,302::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:50,302::__init__::232::IOProcess::(_processLogs) (202870) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:30:50,303::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202870) Queuing response >Thread-10269::DEBUG::2014-10-29 11:30:50,303::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Iso', 'DESCRIPTION=nsednev-iso-domain', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=00000002-0002-0002-0002-000000000324,00000002-0002-0002-0002-00000000002d,00000002-0002-0002-0002-0000000003d4,00000002-0002-0002-0002-000000000321', 'REMOTE_PATH=monster-nfs.scl.lab.tlv.redhat.com:/RHEV/nsednev-iso-domain', 'ROLE=Regular', 'SDUUID=de096187-36e2-44e5-b8db-a9b67c3960de', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=4fa36e197e83f2488bfc8aea7825ed34cc463260'] >Thread-17::DEBUG::2014-10-29 11:30:50,305::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:50,306::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:50,307::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:50,307::__init__::232::IOProcess::(_processLogs) (202871) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:50,307::__init__::232::IOProcess::(_processLogs) (202871) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:50,308::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:50,308::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:50,308::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:50,309::__init__::232::IOProcess::(_processLogs) (202872) Got request for method 'glob' >Thread-10269::DEBUG::2014-10-29 11:30:50,310::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:30:50,309::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202872) Queuing response >Thread-10269::INFO::2014-10-29 11:30:50,311::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace de096187-36e2-44e5-b8db-a9b67c3960de_imageNS already registered >Thread-10269::INFO::2014-10-29 11:30:50,312::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace de096187-36e2-44e5-b8db-a9b67c3960de_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:30:50,312::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:50,313::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:50,313::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:50,313::__init__::232::IOProcess::(_processLogs) (202873) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:50,314::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202873) Queuing response >Thread-10269::DEBUG::2014-10-29 11:30:50,315::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:30:50,332::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000505599 s, 993 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:30:50,336::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:50,336::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:50,337::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:50,337::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:50,337::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:50,337::__init__::232::IOProcess::(_processLogs) (202874) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:50,339::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202874) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:50,341::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:50,341::__init__::232::IOProcess::(_processLogs) (202875) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:50,341::__init__::232::IOProcess::(_processLogs) (202875) Queuing response >Thread-33::DEBUG::2014-10-29 11:30:50,343::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:30:50,360::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000492932 s, 988 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:30:50,362::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:50,362::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:50,363::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:50,363::__init__::232::IOProcess::(_processLogs) (202876) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:50,365::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202876) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:50,367::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:50,367::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:50,368::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:50,369::__init__::232::IOProcess::(_processLogs) (202877) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:50,369::__init__::232::IOProcess::(_processLogs) (202877) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:50,369::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:50,370::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:50,370::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:50,371::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202878) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:50,371::__init__::232::IOProcess::(_processLogs) (202878) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:50,372::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:50,372::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:50,372::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:50,373::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202879) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:50,374::__init__::232::IOProcess::(_processLogs) (202879) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:50,422::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:50,422::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:50,423::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:50,423::__init__::232::IOProcess::(_processLogs) (202880) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:50,424::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202880) Queuing response >Thread-178::DEBUG::2014-10-29 11:30:50,425::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:30:50,442::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000525715 s, 966 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:30:50,444::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:50,444::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:50,446::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:50,447::__init__::232::IOProcess::(_processLogs) (202881) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:30:50,447::__init__::232::IOProcess::(_processLogs) (202881) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:50,448::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:50,449::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:50,449::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:50,449::__init__::232::IOProcess::(_processLogs) (202882) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:50,450::__init__::232::IOProcess::(_processLogs) (202882) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:50,450::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:50,450::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:50,451::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:50,451::__init__::232::IOProcess::(_processLogs) (202883) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:50,451::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202883) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:50,453::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:50,453::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:50,453::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:50,454::__init__::232::IOProcess::(_processLogs) (202884) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:50,454::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202884) Queuing response >Detector thread::DEBUG::2014-10-29 11:30:50,557::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54956 >Detector thread::DEBUG::2014-10-29 11:30:50,558::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54956 >Detector thread::DEBUG::2014-10-29 11:30:50,559::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54956 >Detector thread::DEBUG::2014-10-29 11:30:50,559::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54956) >Thread-137637::DEBUG::2014-10-29 11:30:50,598::task::595::Storage.TaskManager.Task::(_updateState) Task=`a5250dfb-3df2-434b-a633-e08921fc11c7`::moving from state init -> state preparing >Thread-137637::INFO::2014-10-29 11:30:50,599::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137637::INFO::2014-10-29 11:30:50,599::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525715', 'lastCheck': '0.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000492932', 'lastCheck': '0.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548717', 'lastCheck': '0.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000505599', 'lastCheck': '0.3', 'valid': True}} >Thread-137637::DEBUG::2014-10-29 11:30:50,600::task::1191::Storage.TaskManager.Task::(prepare) Task=`a5250dfb-3df2-434b-a633-e08921fc11c7`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525715', 'lastCheck': '0.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000492932', 'lastCheck': '0.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548717', 'lastCheck': '0.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000505599', 'lastCheck': '0.3', 'valid': True}} >Thread-137637::DEBUG::2014-10-29 11:30:50,600::task::595::Storage.TaskManager.Task::(_updateState) Task=`a5250dfb-3df2-434b-a633-e08921fc11c7`::moving from state preparing -> state finished >Thread-137637::DEBUG::2014-10-29 11:30:50,600::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137637::DEBUG::2014-10-29 11:30:50,600::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137637::DEBUG::2014-10-29 11:30:50,601::task::993::Storage.TaskManager.Task::(_decref) Task=`a5250dfb-3df2-434b-a633-e08921fc11c7`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:30:51,194::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54957 >Detector thread::DEBUG::2014-10-29 11:30:51,195::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54957 >Detector thread::DEBUG::2014-10-29 11:30:51,195::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54957 >Detector thread::DEBUG::2014-10-29 11:30:51,196::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54957) >Thread-137638::DEBUG::2014-10-29 11:30:51,235::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137638::DEBUG::2014-10-29 11:30:51,236::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137638::DEBUG::2014-10-29 11:30:51,237::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '6.09', 'elapsedTime': '514883', 'displayType': 'vnc', 'cpuSys': '1.06', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '2834667', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57841', 'readRate': '0.00', 'truesize': '6010912768', 'writeRate': '35663.22'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.98', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-22::DEBUG::2014-10-29 11:30:51,259::task::595::Storage.TaskManager.Task::(_updateState) Task=`07756c1d-d355-4b5d-851a-a01be94836d4`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:30:51,262::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:30:51,263::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:51,263::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:51,263::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:51,264::__init__::232::IOProcess::(_processLogs) (202885) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:30:51,264::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202885) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:51,266::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:51,267::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:51,267::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:51,267::__init__::232::IOProcess::(_processLogs) (202886) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:30:51,268::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202886) Queuing response >Thread-22::INFO::2014-10-29 11:30:51,269::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010912768', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:30:51,269::task::1191::Storage.TaskManager.Task::(prepare) Task=`07756c1d-d355-4b5d-851a-a01be94836d4`::finished: {'truesize': '6010912768', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:30:51,269::task::595::Storage.TaskManager.Task::(_updateState) Task=`07756c1d-d355-4b5d-851a-a01be94836d4`::moving from state preparing -> state finished >Thread-22::DEBUG::2014-10-29 11:30:51,270::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-10-29 11:30:51,270::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2014-10-29 11:30:51,270::task::993::Storage.TaskManager.Task::(_decref) Task=`07756c1d-d355-4b5d-851a-a01be94836d4`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:30:51,384::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:51,741::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:51,743::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137639::DEBUG::2014-10-29 11:30:51,746::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:51,749::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:51,751::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137640::DEBUG::2014-10-29 11:30:51,754::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137640::DEBUG::2014-10-29 11:30:51,756::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:30:52,088::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54959 >Detector thread::DEBUG::2014-10-29 11:30:52,089::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54959 >Detector thread::DEBUG::2014-10-29 11:30:52,089::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54959 >Detector thread::DEBUG::2014-10-29 11:30:52,090::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54959) >Thread-137641::DEBUG::2014-10-29 11:30:52,129::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137641::DEBUG::2014-10-29 11:30:52,131::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137641::DEBUG::2014-10-29 11:30:52,152::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:52,215::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137641::DEBUG::2014-10-29 11:30:52,222::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '119', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '19', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:52,224::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:52,231::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:54,771::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:54,774::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137642::DEBUG::2014-10-29 11:30:54,779::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:54,782::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:54,784::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137643::DEBUG::2014-10-29 11:30:54,788::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137643::DEBUG::2014-10-29 11:30:54,790::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:30:54,908::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54961 >Detector thread::DEBUG::2014-10-29 11:30:54,911::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54961 >Detector thread::DEBUG::2014-10-29 11:30:54,911::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54961 >Detector thread::DEBUG::2014-10-29 11:30:54,912::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54961) >Thread-137644::DEBUG::2014-10-29 11:30:54,952::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137644::DEBUG::2014-10-29 11:30:54,953::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ef4bac2-50b5-41ca-a4d2-7caad8893756`::moving from state init -> state preparing >Thread-137644::INFO::2014-10-29 11:30:54,953::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137644::DEBUG::2014-10-29 11:30:54,957::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:30:54,958::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:54,959::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:54,959::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:54,959::__init__::232::IOProcess::(_processLogs) (202887) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:30:54,961::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202887) Queuing response >Thread-137644::DEBUG::2014-10-29 11:30:54,961::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137644::DEBUG::2014-10-29 11:30:54,962::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137644::INFO::2014-10-29 11:30:54,962::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137644::DEBUG::2014-10-29 11:30:54,963::task::1191::Storage.TaskManager.Task::(prepare) Task=`9ef4bac2-50b5-41ca-a4d2-7caad8893756`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137644::DEBUG::2014-10-29 11:30:54,963::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ef4bac2-50b5-41ca-a4d2-7caad8893756`::moving from state preparing -> state finished >Thread-137644::DEBUG::2014-10-29 11:30:54,963::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137644::DEBUG::2014-10-29 11:30:54,963::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137644::DEBUG::2014-10-29 11:30:54,964::task::993::Storage.TaskManager.Task::(_decref) Task=`9ef4bac2-50b5-41ca-a4d2-7caad8893756`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:30:55,007::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54962 >Detector thread::DEBUG::2014-10-29 11:30:55,008::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54962 >Detector thread::DEBUG::2014-10-29 11:30:55,008::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54962 >Detector thread::DEBUG::2014-10-29 11:30:55,009::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54962) >Thread-137645::DEBUG::2014-10-29 11:30:55,047::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137645::DEBUG::2014-10-29 11:30:55,047::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef359251-0498-4440-923c-01b5325a2eb2`::moving from state init -> state preparing >Thread-137645::INFO::2014-10-29 11:30:55,048::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137645::DEBUG::2014-10-29 11:30:55,048::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137645::DEBUG::2014-10-29 11:30:55,048::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137645::DEBUG::2014-10-29 11:30:55,049::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137645::DEBUG::2014-10-29 11:30:55,049::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137645::DEBUG::2014-10-29 11:30:55,049::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137645::DEBUG::2014-10-29 11:30:55,050::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137645::DEBUG::2014-10-29 11:30:55,131::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137645::DEBUG::2014-10-29 11:30:55,132::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137645::DEBUG::2014-10-29 11:30:55,300::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137645::DEBUG::2014-10-29 11:30:55,301::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137645::DEBUG::2014-10-29 11:30:55,301::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137645::DEBUG::2014-10-29 11:30:55,301::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137645::DEBUG::2014-10-29 11:30:55,302::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137645::DEBUG::2014-10-29 11:30:55,302::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137645::DEBUG::2014-10-29 11:30:55,303::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137645::DEBUG::2014-10-29 11:30:55,303::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:30:55,307::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:55,307::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:55,309::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:55,312::__init__::232::IOProcess::(_processLogs) (202888) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:30:55,315::__init__::232::IOProcess::(_processLogs) (202888) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:55,315::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:55,316::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:55,316::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:55,316::__init__::232::IOProcess::(_processLogs) (202889) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:30:55,317::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202889) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:55,319::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:55,321::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:55,323::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:55,325::__init__::232::IOProcess::(_processLogs) (202890) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:30:55,329::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202890) Queuing response >Thread-137645::DEBUG::2014-10-29 11:30:55,329::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:30:55,332::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:55,332::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:55,333::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:55,333::__init__::232::IOProcess::(_processLogs) (202891) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:30:55,334::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202891) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:55,335::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:55,335::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:55,335::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:55,335::__init__::232::IOProcess::(_processLogs) (202892) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:30:55,337::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202892) Queuing response >Thread-137645::DEBUG::2014-10-29 11:30:55,337::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:30:55,339::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:55,339::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:55,339::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:55,340::__init__::232::IOProcess::(_processLogs) (202893) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:30:55,341::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202893) Queuing response >Thread-137645::DEBUG::2014-10-29 11:30:55,341::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:30:55,343::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:55,344::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:55,344::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:55,345::__init__::232::IOProcess::(_processLogs) (202894) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:30:55,345::__init__::232::IOProcess::(_processLogs) (202894) Queuing response >Thread-17::DEBUG::2014-10-29 11:30:55,345::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:55,346::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:55,346::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:55,346::__init__::232::IOProcess::(_processLogs) (202895) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:30:55,348::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202895) Queuing response >Thread-137645::DEBUG::2014-10-29 11:30:55,349::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-137645::INFO::2014-10-29 11:30:55,349::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137645::INFO::2014-10-29 11:30:55,349::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137645::INFO::2014-10-29 11:30:55,350::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:30:55,351::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:30:55,351::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:30:55,351::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:30:55,351::__init__::232::IOProcess::(_processLogs) (202896) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:30:55,353::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202896) Queuing response >Thread-137645::DEBUG::2014-10-29 11:30:55,353::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137645::DEBUG::2014-10-29 11:30:55,355::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`f1f2403c-bd3a-440b-bc4b-11efa93ad86b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137645::DEBUG::2014-10-29 11:30:55,355::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137645::DEBUG::2014-10-29 11:30:55,355::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137645::DEBUG::2014-10-29 11:30:55,356::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`f1f2403c-bd3a-440b-bc4b-11efa93ad86b`::Granted request >Thread-137645::DEBUG::2014-10-29 11:30:55,356::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ef359251-0498-4440-923c-01b5325a2eb2`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137645::DEBUG::2014-10-29 11:30:55,357::task::993::Storage.TaskManager.Task::(_decref) Task=`ef359251-0498-4440-923c-01b5325a2eb2`::ref 1 aborting False >Thread-137645::INFO::2014-10-29 11:30:55,359::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137645::DEBUG::2014-10-29 11:30:55,360::task::1191::Storage.TaskManager.Task::(prepare) Task=`ef359251-0498-4440-923c-01b5325a2eb2`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137645::DEBUG::2014-10-29 11:30:55,360::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef359251-0498-4440-923c-01b5325a2eb2`::moving from state preparing -> state finished >Thread-137645::DEBUG::2014-10-29 11:30:55,360::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137645::DEBUG::2014-10-29 11:30:55,360::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137645::DEBUG::2014-10-29 11:30:55,361::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137645::DEBUG::2014-10-29 11:30:55,361::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137645::DEBUG::2014-10-29 11:30:55,361::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137645::DEBUG::2014-10-29 11:30:55,362::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137645::DEBUG::2014-10-29 11:30:55,362::task::993::Storage.TaskManager.Task::(_decref) Task=`ef359251-0498-4440-923c-01b5325a2eb2`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:30:55,385::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54963 >Detector thread::DEBUG::2014-10-29 11:30:55,386::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54963 >Detector thread::DEBUG::2014-10-29 11:30:55,386::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54963 >Detector thread::DEBUG::2014-10-29 11:30:55,387::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54963) >Thread-137650::DEBUG::2014-10-29 11:30:55,426::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137650::DEBUG::2014-10-29 11:30:55,427::task::595::Storage.TaskManager.Task::(_updateState) Task=`89c6e87a-beb1-49b2-be9d-1b30068ac4a9`::moving from state init -> state preparing >Thread-137650::INFO::2014-10-29 11:30:55,427::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137650::INFO::2014-10-29 11:30:55,428::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525715', 'lastCheck': '5.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000492932', 'lastCheck': '5.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548717', 'lastCheck': '5.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000505599', 'lastCheck': '5.1', 'valid': True}} >Thread-137650::DEBUG::2014-10-29 11:30:55,428::task::1191::Storage.TaskManager.Task::(prepare) Task=`89c6e87a-beb1-49b2-be9d-1b30068ac4a9`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525715', 'lastCheck': '5.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000492932', 'lastCheck': '5.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548717', 'lastCheck': '5.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000505599', 'lastCheck': '5.1', 'valid': True}} >Thread-137650::DEBUG::2014-10-29 11:30:55,428::task::595::Storage.TaskManager.Task::(_updateState) Task=`89c6e87a-beb1-49b2-be9d-1b30068ac4a9`::moving from state preparing -> state finished >Thread-137650::DEBUG::2014-10-29 11:30:55,428::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137650::DEBUG::2014-10-29 11:30:55,429::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137650::DEBUG::2014-10-29 11:30:55,429::task::993::Storage.TaskManager.Task::(_decref) Task=`89c6e87a-beb1-49b2-be9d-1b30068ac4a9`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:57,242::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:57,244::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:30:57,246::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:57,806::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:57,808::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137651::DEBUG::2014-10-29 11:30:57,811::task::595::Storage.TaskManager.Task::(_updateState) Task=`39fffba4-028e-4714-8916-dc7e4c6f1dfc`::moving from state init -> state preparing >Thread-137651::INFO::2014-10-29 11:30:57,812::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137651::INFO::2014-10-29 11:30:57,812::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525715', 'lastCheck': '7.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000492932', 'lastCheck': '7.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548717', 'lastCheck': '7.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000505599', 'lastCheck': '7.5', 'valid': True}} >Thread-137651::DEBUG::2014-10-29 11:30:57,813::task::1191::Storage.TaskManager.Task::(prepare) Task=`39fffba4-028e-4714-8916-dc7e4c6f1dfc`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525715', 'lastCheck': '7.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000492932', 'lastCheck': '7.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548717', 'lastCheck': '7.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000505599', 'lastCheck': '7.5', 'valid': True}} >Thread-137651::DEBUG::2014-10-29 11:30:57,813::task::595::Storage.TaskManager.Task::(_updateState) Task=`39fffba4-028e-4714-8916-dc7e4c6f1dfc`::moving from state preparing -> state finished >Thread-137651::DEBUG::2014-10-29 11:30:57,813::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137651::DEBUG::2014-10-29 11:30:57,814::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137651::DEBUG::2014-10-29 11:30:57,814::task::993::Storage.TaskManager.Task::(_decref) Task=`39fffba4-028e-4714-8916-dc7e4c6f1dfc`::ref 0 aborting False >Thread-137651::DEBUG::2014-10-29 11:30:57,836::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:30:57,860::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:30:57,862::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137652::DEBUG::2014-10-29 11:30:57,865::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137652::DEBUG::2014-10-29 11:30:57,868::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:31:00,290::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:00,291::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:00,291::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:00,291::__init__::232::IOProcess::(_processLogs) (202897) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:00,293::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202897) Queuing response >Thread-179::DEBUG::2014-10-29 11:31:00,295::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:31:00,314::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000503053 s, 739 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:31:00,315::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:00,316::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:00,316::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:00,316::__init__::232::IOProcess::(_processLogs) (202898) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:00,318::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202898) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:00,342::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:00,342::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:00,342::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:00,343::__init__::232::IOProcess::(_processLogs) (202899) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:00,343::__init__::232::IOProcess::(_processLogs) (202899) Queuing response >Thread-10269::DEBUG::2014-10-29 11:31:00,344::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:31:00,361::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000506114 s, 992 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:31:00,363::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:00,364::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:00,364::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:00,365::__init__::232::IOProcess::(_processLogs) (202900) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:00,366::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202900) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:00,376::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:00,376::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:00,376::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:00,377::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202901) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:00,379::__init__::232::IOProcess::(_processLogs) (202901) Queuing response >Thread-33::DEBUG::2014-10-29 11:31:00,379::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:31:00,398::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000612919 s, 795 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:31:00,400::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:00,401::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:00,401::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:00,401::__init__::232::IOProcess::(_processLogs) (202902) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:00,401::__init__::232::IOProcess::(_processLogs) (202902) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:00,405::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:00,405::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:00,406::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:00,406::__init__::232::IOProcess::(_processLogs) (202903) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:00,406::__init__::232::IOProcess::(_processLogs) (202903) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:00,407::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:00,407::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:00,408::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:00,408::__init__::232::IOProcess::(_processLogs) (202904) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:00,408::__init__::232::IOProcess::(_processLogs) (202904) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:00,409::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:00,410::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:00,410::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:00,410::__init__::232::IOProcess::(_processLogs) (202905) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:00,410::__init__::232::IOProcess::(_processLogs) (202905) Queuing response >Detector thread::DEBUG::2014-10-29 11:31:00,417::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54964 >Detector thread::DEBUG::2014-10-29 11:31:00,418::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54964 >Detector thread::DEBUG::2014-10-29 11:31:00,418::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54964 >Detector thread::DEBUG::2014-10-29 11:31:00,419::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54964) >Thread-17::DEBUG::2014-10-29 11:31:00,456::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:00,457::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137653::DEBUG::2014-10-29 11:31:00,460::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-17::DEBUG::2014-10-29 11:31:00,461::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-178::DEBUG::2014-10-29 11:31:00,465::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:31:00,466::__init__::232::IOProcess::(_processLogs) (202906) Got request for method 'statvfs' >Thread-137653::DEBUG::2014-10-29 11:31:00,468::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:31:00,487::__init__::232::IOProcess::(_processLogs) (202906) Queuing response >Thread-178::DEBUG::2014-10-29 11:31:00,491::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000620329 s, 819 kB/s\n'; <rc> = 0 >Thread-137653::DEBUG::2014-10-29 11:31:00,492::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.44', 'elapsedTime': '514892', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '29823655', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57725', 'readRate': '0.00', 'truesize': '6010912768', 'writeRate': '51768.17'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.08', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-17::DEBUG::2014-10-29 11:31:00,497::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:00,499::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:00,501::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:00,502::__init__::232::IOProcess::(_processLogs) (202907) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:00,508::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202907) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:00,513::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:00,515::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:00,515::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:00,515::__init__::232::IOProcess::(_processLogs) (202908) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:00,516::__init__::232::IOProcess::(_processLogs) (202908) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:00,517::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:00,517::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:00,517::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:00,518::__init__::232::IOProcess::(_processLogs) (202909) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:00,519::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202909) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:00,520::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:00,520::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:00,520::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:00,520::__init__::232::IOProcess::(_processLogs) (202910) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:00,521::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202910) Queuing response >Detector thread::DEBUG::2014-10-29 11:31:00,681::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54966 >Detector thread::DEBUG::2014-10-29 11:31:00,682::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54966 >Detector thread::DEBUG::2014-10-29 11:31:00,682::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54966 >Detector thread::DEBUG::2014-10-29 11:31:00,682::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54966) >Thread-137654::DEBUG::2014-10-29 11:31:00,722::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa650ef9-4d97-43ae-8c2c-7943613342c2`::moving from state init -> state preparing >Thread-137654::INFO::2014-10-29 11:31:00,723::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137654::INFO::2014-10-29 11:31:00,723::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620329', 'lastCheck': '0.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612919', 'lastCheck': '0.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503053', 'lastCheck': '0.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000506114', 'lastCheck': '0.4', 'valid': True}} >Thread-137654::DEBUG::2014-10-29 11:31:00,724::task::1191::Storage.TaskManager.Task::(prepare) Task=`fa650ef9-4d97-43ae-8c2c-7943613342c2`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620329', 'lastCheck': '0.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612919', 'lastCheck': '0.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503053', 'lastCheck': '0.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000506114', 'lastCheck': '0.4', 'valid': True}} >Thread-137654::DEBUG::2014-10-29 11:31:00,724::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa650ef9-4d97-43ae-8c2c-7943613342c2`::moving from state preparing -> state finished >Thread-137654::DEBUG::2014-10-29 11:31:00,724::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137654::DEBUG::2014-10-29 11:31:00,725::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137654::DEBUG::2014-10-29 11:31:00,725::task::993::Storage.TaskManager.Task::(_decref) Task=`fa650ef9-4d97-43ae-8c2c-7943613342c2`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:00,920::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:00,923::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137655::DEBUG::2014-10-29 11:31:00,926::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:00,928::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:00,930::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137656::DEBUG::2014-10-29 11:31:00,933::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137656::DEBUG::2014-10-29 11:31:00,935::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:31:01,282::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54967 >Detector thread::DEBUG::2014-10-29 11:31:01,283::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54967 >Detector thread::DEBUG::2014-10-29 11:31:01,283::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54967 >Detector thread::DEBUG::2014-10-29 11:31:01,284::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54967) >Thread-137657::DEBUG::2014-10-29 11:31:01,322::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137657::DEBUG::2014-10-29 11:31:01,324::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137657::DEBUG::2014-10-29 11:31:01,341::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137657::DEBUG::2014-10-29 11:31:01,388::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '2', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '2', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:02,253::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:02,254::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:02,256::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:04,779::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:04,782::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137658::DEBUG::2014-10-29 11:31:04,786::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:04,788::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:04,790::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137659::DEBUG::2014-10-29 11:31:04,793::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137659::DEBUG::2014-10-29 11:31:04,795::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:31:05,015::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >Detector thread::DEBUG::2014-10-29 11:31:06,007::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54969 >Detector thread::DEBUG::2014-10-29 11:31:06,008::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54969 >Detector thread::DEBUG::2014-10-29 11:31:06,008::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54969 >Detector thread::DEBUG::2014-10-29 11:31:06,009::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54969) >Thread-137660::DEBUG::2014-10-29 11:31:06,049::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137660::DEBUG::2014-10-29 11:31:06,049::task::595::Storage.TaskManager.Task::(_updateState) Task=`b96fa49c-5c99-4e3b-872d-ecdf982a623d`::moving from state init -> state preparing >Thread-137660::INFO::2014-10-29 11:31:06,050::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137660::DEBUG::2014-10-29 11:31:06,054::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:31:06,057::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:06,058::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:06,058::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:06,058::__init__::232::IOProcess::(_processLogs) (202911) Got request for method 'glob' >Thread-137660::DEBUG::2014-10-29 11:31:06,059::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:31:06,059::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202911) Queuing response >Thread-137660::DEBUG::2014-10-29 11:31:06,061::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137660::INFO::2014-10-29 11:31:06,062::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137660::DEBUG::2014-10-29 11:31:06,062::task::1191::Storage.TaskManager.Task::(prepare) Task=`b96fa49c-5c99-4e3b-872d-ecdf982a623d`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137660::DEBUG::2014-10-29 11:31:06,062::task::595::Storage.TaskManager.Task::(_updateState) Task=`b96fa49c-5c99-4e3b-872d-ecdf982a623d`::moving from state preparing -> state finished >Thread-137660::DEBUG::2014-10-29 11:31:06,062::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137660::DEBUG::2014-10-29 11:31:06,063::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137660::DEBUG::2014-10-29 11:31:06,063::task::993::Storage.TaskManager.Task::(_decref) Task=`b96fa49c-5c99-4e3b-872d-ecdf982a623d`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:31:06,106::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54970 >Detector thread::DEBUG::2014-10-29 11:31:06,107::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54970 >Detector thread::DEBUG::2014-10-29 11:31:06,107::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54970 >Detector thread::DEBUG::2014-10-29 11:31:06,107::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54970) >Thread-137661::DEBUG::2014-10-29 11:31:06,146::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137661::DEBUG::2014-10-29 11:31:06,146::task::595::Storage.TaskManager.Task::(_updateState) Task=`408c2fd4-45db-46d6-accf-624acab07a40`::moving from state init -> state preparing >Thread-137661::INFO::2014-10-29 11:31:06,147::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137661::DEBUG::2014-10-29 11:31:06,147::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137661::DEBUG::2014-10-29 11:31:06,147::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137661::DEBUG::2014-10-29 11:31:06,148::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137661::DEBUG::2014-10-29 11:31:06,148::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137661::DEBUG::2014-10-29 11:31:06,148::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137661::DEBUG::2014-10-29 11:31:06,149::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137661::DEBUG::2014-10-29 11:31:06,242::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137661::DEBUG::2014-10-29 11:31:06,243::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-22::DEBUG::2014-10-29 11:31:06,432::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-137661::DEBUG::2014-10-29 11:31:06,446::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137661::DEBUG::2014-10-29 11:31:06,446::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137661::DEBUG::2014-10-29 11:31:06,447::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137661::DEBUG::2014-10-29 11:31:06,447::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137661::DEBUG::2014-10-29 11:31:06,447::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137661::DEBUG::2014-10-29 11:31:06,448::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137661::DEBUG::2014-10-29 11:31:06,448::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137661::DEBUG::2014-10-29 11:31:06,449::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:31:06,454::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:06,457::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:06,458::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:06,458::__init__::232::IOProcess::(_processLogs) (202912) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:06,460::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202912) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:06,461::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:06,462::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:06,462::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:06,462::__init__::232::IOProcess::(_processLogs) (202913) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:06,462::__init__::232::IOProcess::(_processLogs) (202913) Queuing response >Thread-137661::DEBUG::2014-10-29 11:31:06,469::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:31:06,464::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:06,469::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:06,470::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:06,470::__init__::232::IOProcess::(_processLogs) (202914) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:06,470::__init__::232::IOProcess::(_processLogs) (202914) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:06,471::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:06,472::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:06,472::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:06,473::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202915) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:06,474::__init__::232::IOProcess::(_processLogs) (202915) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:06,475::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:06,475::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:06,475::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:06,476::__init__::232::IOProcess::(_processLogs) (202916) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:31:06,476::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202916) Queuing response >Thread-137661::DEBUG::2014-10-29 11:31:06,477::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:31:06,479::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:06,479::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:06,479::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:06,480::__init__::232::IOProcess::(_processLogs) (202917) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:31:06,480::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202917) Queuing response >Thread-137661::DEBUG::2014-10-29 11:31:06,481::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:31:06,483::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:06,484::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:06,484::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:06,484::__init__::232::IOProcess::(_processLogs) (202918) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:06,485::__init__::232::IOProcess::(_processLogs) (202918) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:06,485::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:06,486::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:06,486::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:06,486::__init__::232::IOProcess::(_processLogs) (202919) Got request for method 'glob' >Thread-137661::DEBUG::2014-10-29 11:31:06,487::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:31:06,487::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202919) Queuing response >Thread-137661::INFO::2014-10-29 11:31:06,488::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137661::INFO::2014-10-29 11:31:06,489::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137661::INFO::2014-10-29 11:31:06,489::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:31:06,490::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:06,490::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:06,490::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:06,491::__init__::232::IOProcess::(_processLogs) (202920) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:31:06,491::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202920) Queuing response >Thread-137661::DEBUG::2014-10-29 11:31:06,492::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137661::DEBUG::2014-10-29 11:31:06,494::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`4be01891-9700-4f8d-a562-fd1ca8c14b3c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137661::DEBUG::2014-10-29 11:31:06,494::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137661::DEBUG::2014-10-29 11:31:06,495::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137661::DEBUG::2014-10-29 11:31:06,495::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`4be01891-9700-4f8d-a562-fd1ca8c14b3c`::Granted request >Thread-137661::DEBUG::2014-10-29 11:31:06,496::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`408c2fd4-45db-46d6-accf-624acab07a40`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137661::DEBUG::2014-10-29 11:31:06,496::task::993::Storage.TaskManager.Task::(_decref) Task=`408c2fd4-45db-46d6-accf-624acab07a40`::ref 1 aborting False >Thread-137661::INFO::2014-10-29 11:31:06,499::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137661::DEBUG::2014-10-29 11:31:06,499::task::1191::Storage.TaskManager.Task::(prepare) Task=`408c2fd4-45db-46d6-accf-624acab07a40`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137661::DEBUG::2014-10-29 11:31:06,499::task::595::Storage.TaskManager.Task::(_updateState) Task=`408c2fd4-45db-46d6-accf-624acab07a40`::moving from state preparing -> state finished >Thread-137661::DEBUG::2014-10-29 11:31:06,499::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137661::DEBUG::2014-10-29 11:31:06,500::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137661::DEBUG::2014-10-29 11:31:06,500::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137661::DEBUG::2014-10-29 11:31:06,500::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137661::DEBUG::2014-10-29 11:31:06,501::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137661::DEBUG::2014-10-29 11:31:06,501::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137661::DEBUG::2014-10-29 11:31:06,501::task::993::Storage.TaskManager.Task::(_decref) Task=`408c2fd4-45db-46d6-accf-624acab07a40`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:31:06,533::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54971 >Detector thread::DEBUG::2014-10-29 11:31:06,534::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54971 >Detector thread::DEBUG::2014-10-29 11:31:06,534::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54971 >Detector thread::DEBUG::2014-10-29 11:31:06,535::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54971) >Thread-137666::DEBUG::2014-10-29 11:31:06,574::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137666::DEBUG::2014-10-29 11:31:06,574::task::595::Storage.TaskManager.Task::(_updateState) Task=`bb1a30a9-5a81-4a20-942e-1eeb9eaa5f3e`::moving from state init -> state preparing >Thread-137666::INFO::2014-10-29 11:31:06,575::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137666::INFO::2014-10-29 11:31:06,575::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620329', 'lastCheck': '6.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612919', 'lastCheck': '6.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503053', 'lastCheck': '6.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000506114', 'lastCheck': '6.2', 'valid': True}} >Thread-137666::DEBUG::2014-10-29 11:31:06,576::task::1191::Storage.TaskManager.Task::(prepare) Task=`bb1a30a9-5a81-4a20-942e-1eeb9eaa5f3e`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000620329', 'lastCheck': '6.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000612919', 'lastCheck': '6.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503053', 'lastCheck': '6.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000506114', 'lastCheck': '6.2', 'valid': True}} >Thread-137666::DEBUG::2014-10-29 11:31:06,576::task::595::Storage.TaskManager.Task::(_updateState) Task=`bb1a30a9-5a81-4a20-942e-1eeb9eaa5f3e`::moving from state preparing -> state finished >Thread-137666::DEBUG::2014-10-29 11:31:06,576::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137666::DEBUG::2014-10-29 11:31:06,576::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137666::DEBUG::2014-10-29 11:31:06,577::task::993::Storage.TaskManager.Task::(_decref) Task=`bb1a30a9-5a81-4a20-942e-1eeb9eaa5f3e`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:07,263::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:07,265::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:07,268::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:07,813::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:07,815::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137667::DEBUG::2014-10-29 11:31:07,820::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:07,822::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:07,824::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137668::DEBUG::2014-10-29 11:31:07,827::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137668::DEBUG::2014-10-29 11:31:07,829::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:31:10,322::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:10,322::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:10,322::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:10,323::__init__::232::IOProcess::(_processLogs) (202921) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:10,323::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202921) Queuing response >Thread-179::DEBUG::2014-10-29 11:31:10,325::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:31:10,344::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000412823 s, 901 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:31:10,346::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:10,346::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:10,346::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:10,347::__init__::232::IOProcess::(_processLogs) (202922) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:10,347::__init__::232::IOProcess::(_processLogs) (202922) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:10,369::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:10,370::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:10,371::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:10,371::__init__::232::IOProcess::(_processLogs) (202923) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:10,371::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202923) Queuing response >Thread-10269::DEBUG::2014-10-29 11:31:10,373::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:31:10,390::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000442731 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:31:10,392::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:10,393::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:10,393::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:10,393::__init__::232::IOProcess::(_processLogs) (202924) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:10,393::__init__::232::IOProcess::(_processLogs) (202924) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:10,413::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:10,413::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:10,413::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:10,414::__init__::232::IOProcess::(_processLogs) (202925) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:10,415::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202925) Queuing response >Thread-33::DEBUG::2014-10-29 11:31:10,416::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:31:10,432::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000535683 s, 909 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:31:10,434::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:10,434::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:10,435::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:10,435::__init__::232::IOProcess::(_processLogs) (202926) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:10,435::__init__::232::IOProcess::(_processLogs) (202926) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:10,437::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:10,438::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:10,439::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:10,439::__init__::232::IOProcess::(_processLogs) (202927) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:10,440::__init__::232::IOProcess::(_processLogs) (202927) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:10,440::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:10,441::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:10,442::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:10,442::__init__::232::IOProcess::(_processLogs) (202928) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:10,442::__init__::232::IOProcess::(_processLogs) (202928) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:10,443::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:10,443::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:10,443::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:10,443::__init__::232::IOProcess::(_processLogs) (202929) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:10,444::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202929) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:10,523::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:10,523::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:10,524::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:10,524::__init__::232::IOProcess::(_processLogs) (202930) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:10,524::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202930) Queuing response >Thread-178::DEBUG::2014-10-29 11:31:10,526::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:31:10,542::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000529881 s, 959 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:31:10,544::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:10,544::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:10,545::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:10,545::__init__::232::IOProcess::(_processLogs) (202931) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:10,545::__init__::232::IOProcess::(_processLogs) (202931) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:10,547::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:10,548::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:10,549::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:10,549::__init__::232::IOProcess::(_processLogs) (202932) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:10,549::__init__::232::IOProcess::(_processLogs) (202932) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:10,550::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:10,551::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:10,551::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:10,552::__init__::232::IOProcess::(_processLogs) (202933) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:10,552::__init__::232::IOProcess::(_processLogs) (202933) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:10,552::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:10,553::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:10,554::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:10,555::__init__::232::IOProcess::(_processLogs) (202934) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:10,555::__init__::232::IOProcess::(_processLogs) (202934) Queuing response >Detector thread::DEBUG::2014-10-29 11:31:10,680::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54972 >Detector thread::DEBUG::2014-10-29 11:31:10,681::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54972 >Detector thread::DEBUG::2014-10-29 11:31:10,681::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54972 >Detector thread::DEBUG::2014-10-29 11:31:10,682::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54972) >Thread-137669::DEBUG::2014-10-29 11:31:10,721::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137669::DEBUG::2014-10-29 11:31:10,723::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137669::DEBUG::2014-10-29 11:31:10,723::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.75', 'elapsedTime': '514903', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '29823655', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57725', 'readRate': '0.00', 'truesize': '6010912768', 'writeRate': '51768.17'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.29', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:31:10,817::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54973 >Detector thread::DEBUG::2014-10-29 11:31:10,818::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54973 >Detector thread::DEBUG::2014-10-29 11:31:10,818::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54973 >Detector thread::DEBUG::2014-10-29 11:31:10,818::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54973) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:10,847::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:10,849::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137671::DEBUG::2014-10-29 11:31:10,853::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:10,855::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:10,857::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137670::DEBUG::2014-10-29 11:31:10,864::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a1099ee-2a8a-47c8-9f00-7446151df395`::moving from state init -> state preparing >Thread-137670::INFO::2014-10-29 11:31:10,866::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137672::DEBUG::2014-10-29 11:31:10,867::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137670::INFO::2014-10-29 11:31:10,870::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000529881', 'lastCheck': '0.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535683', 'lastCheck': '0.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000412823', 'lastCheck': '0.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000442731', 'lastCheck': '0.5', 'valid': True}} >Thread-137670::DEBUG::2014-10-29 11:31:10,872::task::1191::Storage.TaskManager.Task::(prepare) Task=`1a1099ee-2a8a-47c8-9f00-7446151df395`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000529881', 'lastCheck': '0.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535683', 'lastCheck': '0.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000412823', 'lastCheck': '0.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000442731', 'lastCheck': '0.5', 'valid': True}} >Thread-137670::DEBUG::2014-10-29 11:31:10,874::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a1099ee-2a8a-47c8-9f00-7446151df395`::moving from state preparing -> state finished >Thread-137670::DEBUG::2014-10-29 11:31:10,875::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137670::DEBUG::2014-10-29 11:31:10,876::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137670::DEBUG::2014-10-29 11:31:10,877::task::993::Storage.TaskManager.Task::(_decref) Task=`1a1099ee-2a8a-47c8-9f00-7446151df395`::ref 0 aborting False >Thread-137672::DEBUG::2014-10-29 11:31:10,885::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:31:11,437::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54975 >Detector thread::DEBUG::2014-10-29 11:31:11,438::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54975 >Detector thread::DEBUG::2014-10-29 11:31:11,438::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54975 >Detector thread::DEBUG::2014-10-29 11:31:11,438::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54975) >Thread-137673::DEBUG::2014-10-29 11:31:11,477::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137673::DEBUG::2014-10-29 11:31:11,479::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137673::DEBUG::2014-10-29 11:31:11,500::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137673::DEBUG::2014-10-29 11:31:11,548::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '186', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '86', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:12,275::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:12,276::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:12,277::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:13,909::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:13,912::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137674::DEBUG::2014-10-29 11:31:13,915::task::595::Storage.TaskManager.Task::(_updateState) Task=`45cc5690-d6d2-4113-b195-c20cf217ace6`::moving from state init -> state preparing >Thread-137674::INFO::2014-10-29 11:31:13,916::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137674::INFO::2014-10-29 11:31:13,916::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000529881', 'lastCheck': '3.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535683', 'lastCheck': '3.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000412823', 'lastCheck': '3.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000442731', 'lastCheck': '3.5', 'valid': True}} >Thread-137674::DEBUG::2014-10-29 11:31:13,917::task::1191::Storage.TaskManager.Task::(prepare) Task=`45cc5690-d6d2-4113-b195-c20cf217ace6`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000529881', 'lastCheck': '3.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535683', 'lastCheck': '3.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000412823', 'lastCheck': '3.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000442731', 'lastCheck': '3.5', 'valid': True}} >Thread-137674::DEBUG::2014-10-29 11:31:13,917::task::595::Storage.TaskManager.Task::(_updateState) Task=`45cc5690-d6d2-4113-b195-c20cf217ace6`::moving from state preparing -> state finished >Thread-137674::DEBUG::2014-10-29 11:31:13,917::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137674::DEBUG::2014-10-29 11:31:13,917::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137674::DEBUG::2014-10-29 11:31:13,918::task::993::Storage.TaskManager.Task::(_decref) Task=`45cc5690-d6d2-4113-b195-c20cf217ace6`::ref 0 aborting False >Thread-137674::DEBUG::2014-10-29 11:31:13,939::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:13,965::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:13,967::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137675::DEBUG::2014-10-29 11:31:13,970::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137675::DEBUG::2014-10-29 11:31:13,973::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:17,017::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:17,021::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137676::DEBUG::2014-10-29 11:31:17,031::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:17,037::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:17,042::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137677::DEBUG::2014-10-29 11:31:17,051::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137677::DEBUG::2014-10-29 11:31:17,056::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:31:17,151::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54977 >Detector thread::DEBUG::2014-10-29 11:31:17,151::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54977 >Detector thread::DEBUG::2014-10-29 11:31:17,152::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54977 >Detector thread::DEBUG::2014-10-29 11:31:17,152::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54977) >Thread-137678::DEBUG::2014-10-29 11:31:17,192::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137678::DEBUG::2014-10-29 11:31:17,192::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d53fe78-5072-4449-b8d4-58c14f07f1e2`::moving from state init -> state preparing >Thread-137678::INFO::2014-10-29 11:31:17,193::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137678::DEBUG::2014-10-29 11:31:17,207::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:31:17,208::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:17,208::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:17,208::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:17,209::__init__::232::IOProcess::(_processLogs) (202935) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:17,209::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202935) Queuing response >Thread-137678::DEBUG::2014-10-29 11:31:17,210::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137678::DEBUG::2014-10-29 11:31:17,211::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137678::INFO::2014-10-29 11:31:17,211::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137678::DEBUG::2014-10-29 11:31:17,211::task::1191::Storage.TaskManager.Task::(prepare) Task=`1d53fe78-5072-4449-b8d4-58c14f07f1e2`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137678::DEBUG::2014-10-29 11:31:17,212::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d53fe78-5072-4449-b8d4-58c14f07f1e2`::moving from state preparing -> state finished >Thread-137678::DEBUG::2014-10-29 11:31:17,212::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137678::DEBUG::2014-10-29 11:31:17,212::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137678::DEBUG::2014-10-29 11:31:17,212::task::993::Storage.TaskManager.Task::(_decref) Task=`1d53fe78-5072-4449-b8d4-58c14f07f1e2`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:31:17,255::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54978 >Detector thread::DEBUG::2014-10-29 11:31:17,256::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54978 >Detector thread::DEBUG::2014-10-29 11:31:17,256::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54978 >Detector thread::DEBUG::2014-10-29 11:31:17,257::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54978) >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:17,280::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:17,281::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:17,284::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137679::DEBUG::2014-10-29 11:31:17,295::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137679::DEBUG::2014-10-29 11:31:17,295::task::595::Storage.TaskManager.Task::(_updateState) Task=`64302ad3-328c-48f5-a4b4-a7251da32f5b`::moving from state init -> state preparing >Thread-137679::INFO::2014-10-29 11:31:17,296::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137679::DEBUG::2014-10-29 11:31:17,296::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137679::DEBUG::2014-10-29 11:31:17,296::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137679::DEBUG::2014-10-29 11:31:17,297::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137679::DEBUG::2014-10-29 11:31:17,297::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137679::DEBUG::2014-10-29 11:31:17,297::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137679::DEBUG::2014-10-29 11:31:17,298::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137679::DEBUG::2014-10-29 11:31:17,373::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137679::DEBUG::2014-10-29 11:31:17,374::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137679::DEBUG::2014-10-29 11:31:17,550::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137679::DEBUG::2014-10-29 11:31:17,551::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137679::DEBUG::2014-10-29 11:31:17,551::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137679::DEBUG::2014-10-29 11:31:17,552::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137679::DEBUG::2014-10-29 11:31:17,552::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137679::DEBUG::2014-10-29 11:31:17,553::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137679::DEBUG::2014-10-29 11:31:17,553::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137679::DEBUG::2014-10-29 11:31:17,553::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:31:17,559::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:17,563::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:17,563::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:17,563::__init__::232::IOProcess::(_processLogs) (202936) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:17,564::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202936) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:17,566::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:17,566::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:17,567::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:17,567::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:17,567::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:17,568::__init__::232::IOProcess::(_processLogs) (202937) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:17,568::__init__::232::IOProcess::(_processLogs) (202937) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:17,568::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:17,568::__init__::232::IOProcess::(_processLogs) (202938) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:17,569::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:17,569::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:17,569::__init__::232::IOProcess::(_processLogs) (202938) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:17,569::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:17,570::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202939) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:17,573::__init__::232::IOProcess::(_processLogs) (202939) Queuing response >Thread-137679::DEBUG::2014-10-29 11:31:17,578::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:31:17,579::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:17,580::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:17,580::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:17,580::__init__::232::IOProcess::(_processLogs) (202940) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:31:17,581::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202940) Queuing response >Thread-137679::DEBUG::2014-10-29 11:31:17,582::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:31:17,582::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:17,583::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:17,583::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:17,583::__init__::232::IOProcess::(_processLogs) (202941) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:31:17,584::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202941) Queuing response >Thread-137679::DEBUG::2014-10-29 11:31:17,584::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:31:17,586::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:17,587::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:17,588::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:17,588::__init__::232::IOProcess::(_processLogs) (202942) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:17,588::__init__::232::IOProcess::(_processLogs) (202942) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:17,589::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:17,589::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:17,589::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:17,590::__init__::232::IOProcess::(_processLogs) (202943) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:17,590::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202943) Queuing response >Thread-137679::DEBUG::2014-10-29 11:31:17,590::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-137679::INFO::2014-10-29 11:31:17,592::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137679::INFO::2014-10-29 11:31:17,592::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137679::INFO::2014-10-29 11:31:17,592::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:31:17,593::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:17,593::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:17,594::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:17,594::__init__::232::IOProcess::(_processLogs) (202944) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:31:17,595::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202944) Queuing response >Thread-137679::DEBUG::2014-10-29 11:31:17,595::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137679::DEBUG::2014-10-29 11:31:17,597::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`a865d127-c2ab-4579-a447-f626d1ff1bab`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137679::DEBUG::2014-10-29 11:31:17,597::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137679::DEBUG::2014-10-29 11:31:17,598::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137679::DEBUG::2014-10-29 11:31:17,598::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`a865d127-c2ab-4579-a447-f626d1ff1bab`::Granted request >Thread-137679::DEBUG::2014-10-29 11:31:17,599::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`64302ad3-328c-48f5-a4b4-a7251da32f5b`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137679::DEBUG::2014-10-29 11:31:17,599::task::993::Storage.TaskManager.Task::(_decref) Task=`64302ad3-328c-48f5-a4b4-a7251da32f5b`::ref 1 aborting False >Thread-137679::INFO::2014-10-29 11:31:17,602::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137679::DEBUG::2014-10-29 11:31:17,602::task::1191::Storage.TaskManager.Task::(prepare) Task=`64302ad3-328c-48f5-a4b4-a7251da32f5b`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137679::DEBUG::2014-10-29 11:31:17,602::task::595::Storage.TaskManager.Task::(_updateState) Task=`64302ad3-328c-48f5-a4b4-a7251da32f5b`::moving from state preparing -> state finished >Thread-137679::DEBUG::2014-10-29 11:31:17,603::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137679::DEBUG::2014-10-29 11:31:17,603::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137679::DEBUG::2014-10-29 11:31:17,603::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137679::DEBUG::2014-10-29 11:31:17,603::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137679::DEBUG::2014-10-29 11:31:17,604::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137679::DEBUG::2014-10-29 11:31:17,604::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137679::DEBUG::2014-10-29 11:31:17,604::task::993::Storage.TaskManager.Task::(_decref) Task=`64302ad3-328c-48f5-a4b4-a7251da32f5b`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:31:17,627::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54979 >Detector thread::DEBUG::2014-10-29 11:31:17,628::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54979 >Detector thread::DEBUG::2014-10-29 11:31:17,628::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54979 >Detector thread::DEBUG::2014-10-29 11:31:17,628::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54979) >Thread-137684::DEBUG::2014-10-29 11:31:17,667::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137684::DEBUG::2014-10-29 11:31:17,667::task::595::Storage.TaskManager.Task::(_updateState) Task=`8fea6fe0-4dd2-44be-b73f-f7569da3a793`::moving from state init -> state preparing >Thread-137684::INFO::2014-10-29 11:31:17,668::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137684::INFO::2014-10-29 11:31:17,668::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000529881', 'lastCheck': '7.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535683', 'lastCheck': '7.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000412823', 'lastCheck': '7.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000442731', 'lastCheck': '7.3', 'valid': True}} >Thread-137684::DEBUG::2014-10-29 11:31:17,669::task::1191::Storage.TaskManager.Task::(prepare) Task=`8fea6fe0-4dd2-44be-b73f-f7569da3a793`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000529881', 'lastCheck': '7.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535683', 'lastCheck': '7.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000412823', 'lastCheck': '7.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000442731', 'lastCheck': '7.3', 'valid': True}} >Thread-137684::DEBUG::2014-10-29 11:31:17,669::task::595::Storage.TaskManager.Task::(_updateState) Task=`8fea6fe0-4dd2-44be-b73f-f7569da3a793`::moving from state preparing -> state finished >Thread-137684::DEBUG::2014-10-29 11:31:17,669::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137684::DEBUG::2014-10-29 11:31:17,669::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137684::DEBUG::2014-10-29 11:31:17,670::task::993::Storage.TaskManager.Task::(_decref) Task=`8fea6fe0-4dd2-44be-b73f-f7569da3a793`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:20,079::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:20,083::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137685::DEBUG::2014-10-29 11:31:20,086::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:20,089::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:20,091::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137686::DEBUG::2014-10-29 11:31:20,094::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137686::DEBUG::2014-10-29 11:31:20,096::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:31:20,351::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:20,353::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:20,354::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:20,356::__init__::232::IOProcess::(_processLogs) (202945) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:20,358::__init__::232::IOProcess::(_processLogs) (202945) Queuing response >Thread-179::DEBUG::2014-10-29 11:31:20,366::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:31:20,386::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000436115 s, 853 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:31:20,391::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:20,393::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:20,394::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:20,396::__init__::232::IOProcess::(_processLogs) (202946) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:20,401::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202946) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:20,404::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:20,404::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:20,405::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:20,405::__init__::232::IOProcess::(_processLogs) (202947) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:20,407::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202947) Queuing response >Thread-10269::DEBUG::2014-10-29 11:31:20,409::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:31:20,426::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000463213 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:31:20,427::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:20,428::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:20,428::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:20,428::__init__::232::IOProcess::(_processLogs) (202948) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:20,430::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202948) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:20,446::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:20,447::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:20,447::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:20,447::__init__::232::IOProcess::(_processLogs) (202949) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:20,447::__init__::232::IOProcess::(_processLogs) (202949) Queuing response >Thread-33::DEBUG::2014-10-29 11:31:20,449::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:31:20,467::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000521551 s, 934 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:31:20,469::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:20,469::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:20,469::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:20,469::__init__::232::IOProcess::(_processLogs) (202950) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:20,470::__init__::232::IOProcess::(_processLogs) (202950) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:20,472::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:20,472::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:20,472::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:20,473::__init__::232::IOProcess::(_processLogs) (202951) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:20,473::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202951) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:20,474::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:20,475::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:20,475::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:20,475::__init__::232::IOProcess::(_processLogs) (202952) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:20,475::__init__::232::IOProcess::(_processLogs) (202952) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:20,476::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:20,477::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:20,477::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:20,477::__init__::232::IOProcess::(_processLogs) (202953) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:20,478::__init__::232::IOProcess::(_processLogs) (202953) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:20,556::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:20,556::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:20,556::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:20,556::__init__::232::IOProcess::(_processLogs) (202954) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:20,558::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202954) Queuing response >Thread-178::DEBUG::2014-10-29 11:31:20,559::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:31:20,578::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000430821 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:31:20,580::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:20,581::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:20,582::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:20,584::__init__::232::IOProcess::(_processLogs) (202955) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:20,584::__init__::232::IOProcess::(_processLogs) (202955) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:20,585::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:20,585::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:20,585::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:20,585::__init__::232::IOProcess::(_processLogs) (202956) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:20,586::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202956) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:20,587::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:20,588::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:20,588::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:20,589::__init__::232::IOProcess::(_processLogs) (202957) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:20,589::__init__::232::IOProcess::(_processLogs) (202957) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:20,590::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:20,590::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:20,590::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:20,591::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202958) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:20,592::__init__::232::IOProcess::(_processLogs) (202958) Queuing response >Detector thread::DEBUG::2014-10-29 11:31:20,877::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54980 >Detector thread::DEBUG::2014-10-29 11:31:20,878::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54980 >Detector thread::DEBUG::2014-10-29 11:31:20,879::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54980 >Detector thread::DEBUG::2014-10-29 11:31:20,879::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54980) >Thread-137687::DEBUG::2014-10-29 11:31:20,917::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137687::DEBUG::2014-10-29 11:31:20,918::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137687::DEBUG::2014-10-29 11:31:20,919::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.75', 'elapsedTime': '514913', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '29823655', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57725', 'readRate': '0.00', 'truesize': '6010912768', 'writeRate': '51768.17'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.48', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:31:20,964::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54981 >Detector thread::DEBUG::2014-10-29 11:31:20,964::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54981 >Detector thread::DEBUG::2014-10-29 11:31:20,964::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54981 >Detector thread::DEBUG::2014-10-29 11:31:20,965::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54981) >Thread-137688::DEBUG::2014-10-29 11:31:21,004::task::595::Storage.TaskManager.Task::(_updateState) Task=`061f30fe-819c-4d1f-bfd2-40b3739bc473`::moving from state init -> state preparing >Thread-137688::INFO::2014-10-29 11:31:21,005::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137688::INFO::2014-10-29 11:31:21,005::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430821', 'lastCheck': '0.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521551', 'lastCheck': '0.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436115', 'lastCheck': '0.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000463213', 'lastCheck': '0.6', 'valid': True}} >Thread-137688::DEBUG::2014-10-29 11:31:21,006::task::1191::Storage.TaskManager.Task::(prepare) Task=`061f30fe-819c-4d1f-bfd2-40b3739bc473`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430821', 'lastCheck': '0.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521551', 'lastCheck': '0.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436115', 'lastCheck': '0.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000463213', 'lastCheck': '0.6', 'valid': True}} >Thread-137688::DEBUG::2014-10-29 11:31:21,006::task::595::Storage.TaskManager.Task::(_updateState) Task=`061f30fe-819c-4d1f-bfd2-40b3739bc473`::moving from state preparing -> state finished >Thread-137688::DEBUG::2014-10-29 11:31:21,006::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137688::DEBUG::2014-10-29 11:31:21,006::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137688::DEBUG::2014-10-29 11:31:21,007::task::993::Storage.TaskManager.Task::(_decref) Task=`061f30fe-819c-4d1f-bfd2-40b3739bc473`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:31:21,456::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Detector thread::DEBUG::2014-10-29 11:31:21,597::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54983 >Detector thread::DEBUG::2014-10-29 11:31:21,598::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54983 >Detector thread::DEBUG::2014-10-29 11:31:21,598::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54983 >Detector thread::DEBUG::2014-10-29 11:31:21,599::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54983) >Thread-137689::DEBUG::2014-10-29 11:31:21,638::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137689::DEBUG::2014-10-29 11:31:21,640::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137689::DEBUG::2014-10-29 11:31:21,658::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137689::DEBUG::2014-10-29 11:31:21,706::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '170', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '70', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:22,291::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:22,292::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:22,294::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:23,110::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:23,113::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137690::DEBUG::2014-10-29 11:31:23,116::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:23,119::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:23,121::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137691::DEBUG::2014-10-29 11:31:23,124::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137691::DEBUG::2014-10-29 11:31:23,127::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:26,144::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:26,146::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137692::DEBUG::2014-10-29 11:31:26,150::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:26,152::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:26,154::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137693::DEBUG::2014-10-29 11:31:26,157::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137693::DEBUG::2014-10-29 11:31:26,160::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:27,301::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:27,302::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:27,303::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:31:28,252::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54985 >Detector thread::DEBUG::2014-10-29 11:31:28,253::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54985 >Detector thread::DEBUG::2014-10-29 11:31:28,253::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54985 >Detector thread::DEBUG::2014-10-29 11:31:28,254::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54985) >Thread-137694::DEBUG::2014-10-29 11:31:28,293::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137694::DEBUG::2014-10-29 11:31:28,294::task::595::Storage.TaskManager.Task::(_updateState) Task=`38a2431f-47bd-48c5-8b1f-42a6d7304672`::moving from state init -> state preparing >Thread-137694::INFO::2014-10-29 11:31:28,294::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137694::DEBUG::2014-10-29 11:31:28,297::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:31:28,298::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:28,298::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:28,298::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:28,299::__init__::232::IOProcess::(_processLogs) (202959) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:28,301::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202959) Queuing response >Thread-137694::DEBUG::2014-10-29 11:31:28,301::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137694::DEBUG::2014-10-29 11:31:28,302::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137694::INFO::2014-10-29 11:31:28,303::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137694::DEBUG::2014-10-29 11:31:28,303::task::1191::Storage.TaskManager.Task::(prepare) Task=`38a2431f-47bd-48c5-8b1f-42a6d7304672`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137694::DEBUG::2014-10-29 11:31:28,303::task::595::Storage.TaskManager.Task::(_updateState) Task=`38a2431f-47bd-48c5-8b1f-42a6d7304672`::moving from state preparing -> state finished >Thread-137694::DEBUG::2014-10-29 11:31:28,303::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137694::DEBUG::2014-10-29 11:31:28,304::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137694::DEBUG::2014-10-29 11:31:28,304::task::993::Storage.TaskManager.Task::(_decref) Task=`38a2431f-47bd-48c5-8b1f-42a6d7304672`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:31:28,347::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54986 >Detector thread::DEBUG::2014-10-29 11:31:28,348::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54986 >Detector thread::DEBUG::2014-10-29 11:31:28,348::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54986 >Detector thread::DEBUG::2014-10-29 11:31:28,348::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54986) >Thread-137695::DEBUG::2014-10-29 11:31:28,387::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137695::DEBUG::2014-10-29 11:31:28,388::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f031f49-ee64-4192-b9a3-a3e9a6bb5d87`::moving from state init -> state preparing >Thread-137695::INFO::2014-10-29 11:31:28,388::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137695::DEBUG::2014-10-29 11:31:28,388::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137695::DEBUG::2014-10-29 11:31:28,389::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137695::DEBUG::2014-10-29 11:31:28,389::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137695::DEBUG::2014-10-29 11:31:28,389::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137695::DEBUG::2014-10-29 11:31:28,389::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137695::DEBUG::2014-10-29 11:31:28,390::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137695::DEBUG::2014-10-29 11:31:28,483::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137695::DEBUG::2014-10-29 11:31:28,486::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137695::DEBUG::2014-10-29 11:31:28,666::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137695::DEBUG::2014-10-29 11:31:28,667::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137695::DEBUG::2014-10-29 11:31:28,667::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137695::DEBUG::2014-10-29 11:31:28,667::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137695::DEBUG::2014-10-29 11:31:28,668::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137695::DEBUG::2014-10-29 11:31:28,668::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137695::DEBUG::2014-10-29 11:31:28,668::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137695::DEBUG::2014-10-29 11:31:28,669::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:31:28,674::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:28,676::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:28,677::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:28,677::__init__::232::IOProcess::(_processLogs) (202960) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:28,679::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202960) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:28,681::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:28,681::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:28,682::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:28,682::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:28,683::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:28,683::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:28,683::__init__::232::IOProcess::(_processLogs) (202961) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:28,683::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:28,684::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:28,684::__init__::232::IOProcess::(_processLogs) (202962) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:28,684::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:28,684::__init__::232::IOProcess::(_processLogs) (202963) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:28,685::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202961) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:28,687::__init__::232::IOProcess::(_processLogs) (202963) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:28,688::__init__::232::IOProcess::(_processLogs) (202962) Queuing response >Thread-137695::DEBUG::2014-10-29 11:31:28,696::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:31:28,697::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:28,697::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:28,697::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:28,698::__init__::232::IOProcess::(_processLogs) (202964) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:31:28,699::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202964) Queuing response >Thread-137695::DEBUG::2014-10-29 11:31:28,700::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:31:28,701::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:28,701::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:28,702::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:28,702::__init__::232::IOProcess::(_processLogs) (202965) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:31:28,703::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202965) Queuing response >Thread-137695::DEBUG::2014-10-29 11:31:28,703::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:31:28,705::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:28,706::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:28,707::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:28,707::__init__::232::IOProcess::(_processLogs) (202966) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:28,707::__init__::232::IOProcess::(_processLogs) (202966) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:28,708::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:28,708::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:28,708::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:28,708::__init__::232::IOProcess::(_processLogs) (202967) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:28,709::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202967) Queuing response >Thread-137695::DEBUG::2014-10-29 11:31:28,709::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-137695::INFO::2014-10-29 11:31:28,710::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137695::INFO::2014-10-29 11:31:28,711::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137695::INFO::2014-10-29 11:31:28,711::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:31:28,712::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:28,712::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:28,712::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:28,713::__init__::232::IOProcess::(_processLogs) (202968) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:31:28,713::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202968) Queuing response >Thread-137695::DEBUG::2014-10-29 11:31:28,714::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137695::DEBUG::2014-10-29 11:31:28,716::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`05e71bfb-78cb-4fe2-b56e-81088e23ad40`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137695::DEBUG::2014-10-29 11:31:28,716::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137695::DEBUG::2014-10-29 11:31:28,717::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137695::DEBUG::2014-10-29 11:31:28,717::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`05e71bfb-78cb-4fe2-b56e-81088e23ad40`::Granted request >Thread-137695::DEBUG::2014-10-29 11:31:28,718::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8f031f49-ee64-4192-b9a3-a3e9a6bb5d87`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137695::DEBUG::2014-10-29 11:31:28,718::task::993::Storage.TaskManager.Task::(_decref) Task=`8f031f49-ee64-4192-b9a3-a3e9a6bb5d87`::ref 1 aborting False >Thread-137695::INFO::2014-10-29 11:31:28,721::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137695::DEBUG::2014-10-29 11:31:28,721::task::1191::Storage.TaskManager.Task::(prepare) Task=`8f031f49-ee64-4192-b9a3-a3e9a6bb5d87`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137695::DEBUG::2014-10-29 11:31:28,721::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f031f49-ee64-4192-b9a3-a3e9a6bb5d87`::moving from state preparing -> state finished >Thread-137695::DEBUG::2014-10-29 11:31:28,722::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137695::DEBUG::2014-10-29 11:31:28,722::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137695::DEBUG::2014-10-29 11:31:28,722::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137695::DEBUG::2014-10-29 11:31:28,723::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137695::DEBUG::2014-10-29 11:31:28,723::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137695::DEBUG::2014-10-29 11:31:28,723::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137695::DEBUG::2014-10-29 11:31:28,724::task::993::Storage.TaskManager.Task::(_decref) Task=`8f031f49-ee64-4192-b9a3-a3e9a6bb5d87`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:31:28,746::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54987 >Detector thread::DEBUG::2014-10-29 11:31:28,746::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54987 >Detector thread::DEBUG::2014-10-29 11:31:28,747::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54987 >Detector thread::DEBUG::2014-10-29 11:31:28,747::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54987) >Thread-137700::DEBUG::2014-10-29 11:31:28,786::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137700::DEBUG::2014-10-29 11:31:28,787::task::595::Storage.TaskManager.Task::(_updateState) Task=`22f8f43b-8d62-4480-919e-936772d77efb`::moving from state init -> state preparing >Thread-137700::INFO::2014-10-29 11:31:28,787::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137700::INFO::2014-10-29 11:31:28,788::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430821', 'lastCheck': '8.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521551', 'lastCheck': '8.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436115', 'lastCheck': '8.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000463213', 'lastCheck': '8.4', 'valid': True}} >Thread-137700::DEBUG::2014-10-29 11:31:28,788::task::1191::Storage.TaskManager.Task::(prepare) Task=`22f8f43b-8d62-4480-919e-936772d77efb`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430821', 'lastCheck': '8.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521551', 'lastCheck': '8.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436115', 'lastCheck': '8.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000463213', 'lastCheck': '8.4', 'valid': True}} >Thread-137700::DEBUG::2014-10-29 11:31:28,788::task::595::Storage.TaskManager.Task::(_updateState) Task=`22f8f43b-8d62-4480-919e-936772d77efb`::moving from state preparing -> state finished >Thread-137700::DEBUG::2014-10-29 11:31:28,788::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137700::DEBUG::2014-10-29 11:31:28,789::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137700::DEBUG::2014-10-29 11:31:28,789::task::993::Storage.TaskManager.Task::(_decref) Task=`22f8f43b-8d62-4480-919e-936772d77efb`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:29,185::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:29,189::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137701::DEBUG::2014-10-29 11:31:29,192::task::595::Storage.TaskManager.Task::(_updateState) Task=`508dc2c9-f4b6-40bd-964f-d8cab028960c`::moving from state init -> state preparing >Thread-137701::INFO::2014-10-29 11:31:29,193::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137701::INFO::2014-10-29 11:31:29,193::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430821', 'lastCheck': '8.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521551', 'lastCheck': '8.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436115', 'lastCheck': '8.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000463213', 'lastCheck': '8.8', 'valid': True}} >Thread-137701::DEBUG::2014-10-29 11:31:29,194::task::1191::Storage.TaskManager.Task::(prepare) Task=`508dc2c9-f4b6-40bd-964f-d8cab028960c`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000430821', 'lastCheck': '8.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521551', 'lastCheck': '8.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436115', 'lastCheck': '8.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000463213', 'lastCheck': '8.8', 'valid': True}} >Thread-137701::DEBUG::2014-10-29 11:31:29,194::task::595::Storage.TaskManager.Task::(_updateState) Task=`508dc2c9-f4b6-40bd-964f-d8cab028960c`::moving from state preparing -> state finished >Thread-137701::DEBUG::2014-10-29 11:31:29,194::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137701::DEBUG::2014-10-29 11:31:29,194::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137701::DEBUG::2014-10-29 11:31:29,195::task::993::Storage.TaskManager.Task::(_decref) Task=`508dc2c9-f4b6-40bd-964f-d8cab028960c`::ref 0 aborting False >Thread-137701::DEBUG::2014-10-29 11:31:29,232::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:29,256::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:29,258::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137702::DEBUG::2014-10-29 11:31:29,262::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137702::DEBUG::2014-10-29 11:31:29,264::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:31:30,409::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:30,410::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:30,412::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:30,413::__init__::232::IOProcess::(_processLogs) (202969) Got request for method 'statvfs' >Thread-179::DEBUG::2014-10-29 11:31:30,413::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:31:30,415::__init__::232::IOProcess::(_processLogs) (202969) Queuing response >Thread-179::DEBUG::2014-10-29 11:31:30,436::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000543389 s, 685 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:31:30,438::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:30,441::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-10269::DEBUG::2014-10-29 11:31:30,443::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:31:30,442::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:30,464::__init__::232::IOProcess::(_processLogs) (202970) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:30,468::__init__::232::IOProcess::(_processLogs) (202970) Queuing response >Thread-10269::DEBUG::2014-10-29 11:31:30,468::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000583881 s, 860 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:31:30,475::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:30,477::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:30,478::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:30,479::__init__::232::IOProcess::(_processLogs) (202971) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:30,486::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202971) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:30,492::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:30,494::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:30,494::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:30,494::__init__::232::IOProcess::(_processLogs) (202972) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:30,496::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202972) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:30,498::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:30,498::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:30,499::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-33::DEBUG::2014-10-29 11:31:30,501::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:31:30,502::__init__::232::IOProcess::(_processLogs) (202973) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:30,519::__init__::232::IOProcess::(_processLogs) (202973) Queuing response >Thread-33::DEBUG::2014-10-29 11:31:30,521::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000543033 s, 897 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:31:30,522::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:30,522::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:30,523::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:30,523::__init__::232::IOProcess::(_processLogs) (202974) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:30,525::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202974) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:30,526::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:30,527::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:30,527::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:30,528::__init__::232::IOProcess::(_processLogs) (202975) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:30,528::__init__::232::IOProcess::(_processLogs) (202975) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:30,528::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:30,529::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:30,530::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:30,530::__init__::232::IOProcess::(_processLogs) (202976) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:30,531::__init__::232::IOProcess::(_processLogs) (202976) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:30,531::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:30,531::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:30,532::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:30,533::__init__::232::IOProcess::(_processLogs) (202977) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:30,534::__init__::232::IOProcess::(_processLogs) (202977) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:30,594::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:30,595::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:30,597::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-178::DEBUG::2014-10-29 11:31:30,597::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:31:30,598::__init__::232::IOProcess::(_processLogs) (202978) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:30,615::__init__::232::IOProcess::(_processLogs) (202978) Queuing response >Thread-178::DEBUG::2014-10-29 11:31:30,617::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000516215 s, 984 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:31:30,618::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:30,619::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:30,619::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:30,619::__init__::232::IOProcess::(_processLogs) (202979) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:30,621::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202979) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:30,623::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:30,623::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:30,624::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:30,624::__init__::232::IOProcess::(_processLogs) (202980) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:30,625::__init__::232::IOProcess::(_processLogs) (202980) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:30,625::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:30,626::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:30,627::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:30,627::__init__::232::IOProcess::(_processLogs) (202981) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:30,627::__init__::232::IOProcess::(_processLogs) (202981) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:30,628::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:30,628::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:30,629::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:30,630::__init__::232::IOProcess::(_processLogs) (202982) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:30,631::__init__::232::IOProcess::(_processLogs) (202982) Queuing response >Detector thread::DEBUG::2014-10-29 11:31:31,071::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54988 >Detector thread::DEBUG::2014-10-29 11:31:31,072::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54988 >Detector thread::DEBUG::2014-10-29 11:31:31,072::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54988 >Detector thread::DEBUG::2014-10-29 11:31:31,072::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54988) >Detector thread::DEBUG::2014-10-29 11:31:31,088::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54989 >Detector thread::DEBUG::2014-10-29 11:31:31,089::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54989 >Detector thread::DEBUG::2014-10-29 11:31:31,089::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54989 >Detector thread::DEBUG::2014-10-29 11:31:31,089::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54989) >Thread-137703::DEBUG::2014-10-29 11:31:31,112::task::595::Storage.TaskManager.Task::(_updateState) Task=`1dd4fdfb-ef54-408b-81ba-d78525c46baa`::moving from state init -> state preparing >Thread-137703::INFO::2014-10-29 11:31:31,113::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137703::INFO::2014-10-29 11:31:31,113::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000516215', 'lastCheck': '0.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543033', 'lastCheck': '0.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543389', 'lastCheck': '0.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000583881', 'lastCheck': '0.6', 'valid': True}} >Thread-137703::DEBUG::2014-10-29 11:31:31,114::task::1191::Storage.TaskManager.Task::(prepare) Task=`1dd4fdfb-ef54-408b-81ba-d78525c46baa`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000516215', 'lastCheck': '0.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543033', 'lastCheck': '0.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543389', 'lastCheck': '0.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000583881', 'lastCheck': '0.6', 'valid': True}} >Thread-137703::DEBUG::2014-10-29 11:31:31,114::task::595::Storage.TaskManager.Task::(_updateState) Task=`1dd4fdfb-ef54-408b-81ba-d78525c46baa`::moving from state preparing -> state finished >Thread-137703::DEBUG::2014-10-29 11:31:31,114::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137703::DEBUG::2014-10-29 11:31:31,114::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137703::DEBUG::2014-10-29 11:31:31,115::task::993::Storage.TaskManager.Task::(_decref) Task=`1dd4fdfb-ef54-408b-81ba-d78525c46baa`::ref 0 aborting False >Thread-137704::DEBUG::2014-10-29 11:31:31,131::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137704::DEBUG::2014-10-29 11:31:31,136::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137704::DEBUG::2014-10-29 11:31:31,141::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '6.20', 'elapsedTime': '514923', 'displayType': 'vnc', 'cpuSys': '0.80', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '29823655', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57725', 'readRate': '0.00', 'truesize': '6010912768', 'writeRate': '51768.17'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.68', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:31:31,755::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54991 >Detector thread::DEBUG::2014-10-29 11:31:31,755::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54991 >Detector thread::DEBUG::2014-10-29 11:31:31,756::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54991 >Detector thread::DEBUG::2014-10-29 11:31:31,756::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54991) >Thread-137705::DEBUG::2014-10-29 11:31:31,795::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137705::DEBUG::2014-10-29 11:31:31,797::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137705::DEBUG::2014-10-29 11:31:31,816::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137705::DEBUG::2014-10-29 11:31:31,864::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '154', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '54', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:32,309::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:32,310::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:32,312::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:32,336::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:32,339::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137706::DEBUG::2014-10-29 11:31:32,342::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:32,344::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:32,346::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137707::DEBUG::2014-10-29 11:31:32,348::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137707::DEBUG::2014-10-29 11:31:32,351::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:31:35,049::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:35,370::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:35,374::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137708::DEBUG::2014-10-29 11:31:35,377::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:35,380::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:35,381::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137709::DEBUG::2014-10-29 11:31:35,385::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137709::DEBUG::2014-10-29 11:31:35,387::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:31:36,487::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:37,319::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:37,320::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:37,321::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:38,404::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:38,406::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137710::DEBUG::2014-10-29 11:31:38,409::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:38,411::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:38,413::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137711::DEBUG::2014-10-29 11:31:38,415::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137711::DEBUG::2014-10-29 11:31:38,418::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:31:39,356::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54993 >Detector thread::DEBUG::2014-10-29 11:31:39,359::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54993 >Detector thread::DEBUG::2014-10-29 11:31:39,359::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54993 >Detector thread::DEBUG::2014-10-29 11:31:39,359::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54993) >Thread-137712::DEBUG::2014-10-29 11:31:39,397::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137712::DEBUG::2014-10-29 11:31:39,398::task::595::Storage.TaskManager.Task::(_updateState) Task=`5979e2bf-4bb2-4624-8214-d7c42236ca9d`::moving from state init -> state preparing >Thread-137712::INFO::2014-10-29 11:31:39,398::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137712::DEBUG::2014-10-29 11:31:39,415::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:31:39,416::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:39,416::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:39,417::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:39,417::__init__::232::IOProcess::(_processLogs) (202983) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:40,274::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202983) Queuing response >Thread-137712::DEBUG::2014-10-29 11:31:40,276::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137712::DEBUG::2014-10-29 11:31:40,277::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137712::INFO::2014-10-29 11:31:40,278::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137712::DEBUG::2014-10-29 11:31:40,278::task::1191::Storage.TaskManager.Task::(prepare) Task=`5979e2bf-4bb2-4624-8214-d7c42236ca9d`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137712::DEBUG::2014-10-29 11:31:40,278::task::595::Storage.TaskManager.Task::(_updateState) Task=`5979e2bf-4bb2-4624-8214-d7c42236ca9d`::moving from state preparing -> state finished >Thread-137712::DEBUG::2014-10-29 11:31:40,279::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137712::DEBUG::2014-10-29 11:31:40,279::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137712::DEBUG::2014-10-29 11:31:40,279::task::993::Storage.TaskManager.Task::(_decref) Task=`5979e2bf-4bb2-4624-8214-d7c42236ca9d`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:31:40,305::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54994 >Detector thread::DEBUG::2014-10-29 11:31:40,305::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54994 >Detector thread::DEBUG::2014-10-29 11:31:40,306::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54994 >Detector thread::DEBUG::2014-10-29 11:31:40,307::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54994) >Detector thread::DEBUG::2014-10-29 11:31:40,324::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54995 >Detector thread::DEBUG::2014-10-29 11:31:40,325::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54995 >Detector thread::DEBUG::2014-10-29 11:31:40,325::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54995 >Detector thread::DEBUG::2014-10-29 11:31:40,326::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54995) >Thread-137713::DEBUG::2014-10-29 11:31:40,345::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137713::DEBUG::2014-10-29 11:31:40,346::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137713::DEBUG::2014-10-29 11:31:40,347::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.37', 'elapsedTime': '514932', 'displayType': 'vnc', 'cpuSys': '0.87', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '29823655', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57725', 'readRate': '0.00', 'truesize': '6010912768', 'writeRate': '51768.17'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.86', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-137714::DEBUG::2014-10-29 11:31:40,368::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137714::DEBUG::2014-10-29 11:31:40,369::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e3ba50f-05c2-4589-a7bb-41ebf8725444`::moving from state init -> state preparing >Thread-137714::INFO::2014-10-29 11:31:40,370::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137714::DEBUG::2014-10-29 11:31:40,370::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137714::DEBUG::2014-10-29 11:31:40,370::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137714::DEBUG::2014-10-29 11:31:40,370::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137714::DEBUG::2014-10-29 11:31:40,371::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137714::DEBUG::2014-10-29 11:31:40,371::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137714::DEBUG::2014-10-29 11:31:40,372::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137714::DEBUG::2014-10-29 11:31:40,452::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137714::DEBUG::2014-10-29 11:31:40,453::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-17::DEBUG::2014-10-29 11:31:40,493::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:40,494::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:40,494::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:40,494::__init__::232::IOProcess::(_processLogs) (202984) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:40,495::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202984) Queuing response >Thread-179::DEBUG::2014-10-29 11:31:40,497::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:31:40,515::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:40,516::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:40,516::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:40,516::__init__::232::IOProcess::(_processLogs) (202985) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:40,518::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202985) Queuing response >Thread-10269::DEBUG::2014-10-29 11:31:40,520::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:31:40,541::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00074556 s, 499 kB/s\n'; <rc> = 0 >Thread-10269::DEBUG::2014-10-29 11:31:40,548::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000523529 s, 959 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:31:40,552::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:40,555::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:40,557::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:40,558::__init__::232::IOProcess::(_processLogs) (202986) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:40,564::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202986) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:40,569::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:40,575::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:40,577::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:40,577::__init__::232::IOProcess::(_processLogs) (202987) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:40,578::__init__::232::IOProcess::(_processLogs) (202987) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:40,631::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:40,633::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:40,633::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:40,633::__init__::232::IOProcess::(_processLogs) (202988) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:40,634::__init__::232::IOProcess::(_processLogs) (202988) Queuing response >Thread-178::DEBUG::2014-10-29 11:31:40,634::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-137714::DEBUG::2014-10-29 11:31:40,657::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137714::DEBUG::2014-10-29 11:31:40,660::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-178::DEBUG::2014-10-29 11:31:40,660::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000505163 s, 1.0 MB/s\n'; <rc> = 0 >Thread-137714::DEBUG::2014-10-29 11:31:40,664::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-10-29 11:31:40,666::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-137714::DEBUG::2014-10-29 11:31:40,667::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-10-29 11:31:40,668::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:40,670::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-137714::DEBUG::2014-10-29 11:31:40,670::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-10-29 11:31:40,671::__init__::232::IOProcess::(_processLogs) (202989) Got request for method 'statvfs' >Thread-137714::DEBUG::2014-10-29 11:31:40,673::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137714::DEBUG::2014-10-29 11:31:40,676::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-10-29 11:31:40,678::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202989) Queuing response >Thread-137714::DEBUG::2014-10-29 11:31:40,679::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:31:40,686::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:40,691::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:40,693::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:40,693::__init__::232::IOProcess::(_processLogs) (202990) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:40,694::__init__::232::IOProcess::(_processLogs) (202990) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:40,694::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:40,695::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:40,695::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:40,695::__init__::232::IOProcess::(_processLogs) (202991) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:40,696::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202991) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:40,697::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:40,697::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:40,698::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:40,698::__init__::232::IOProcess::(_processLogs) (202992) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:40,698::__init__::232::IOProcess::(_processLogs) (202992) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:40,700::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:40,700::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:40,700::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:40,701::__init__::232::IOProcess::(_processLogs) (202993) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:40,702::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202993) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:40,704::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:40,706::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:40,708::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:40,710::__init__::232::IOProcess::(_processLogs) (202994) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:40,711::__init__::232::IOProcess::(_processLogs) (202994) Queuing response >Thread-137714::DEBUG::2014-10-29 11:31:40,714::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:31:40,717::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:40,718::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:40,719::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:40,720::__init__::232::IOProcess::(_processLogs) (202995) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:40,720::__init__::232::IOProcess::(_processLogs) (202995) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:40,721::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:40,722::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:40,723::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:40,723::__init__::232::IOProcess::(_processLogs) (202996) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:40,723::__init__::232::IOProcess::(_processLogs) (202996) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:40,724::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:40,724::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:40,724::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:40,724::__init__::232::IOProcess::(_processLogs) (202997) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:31:40,725::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202997) Queuing response >Thread-137714::DEBUG::2014-10-29 11:31:40,726::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:31:40,727::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:40,727::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:40,727::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:40,727::__init__::232::IOProcess::(_processLogs) (202998) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:31:40,728::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(202998) Queuing response >Thread-137714::DEBUG::2014-10-29 11:31:40,729::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:31:40,730::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:40,731::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:40,731::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:40,732::__init__::232::IOProcess::(_processLogs) (202999) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:40,732::__init__::232::IOProcess::(_processLogs) (202999) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:40,732::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:40,733::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:40,733::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:40,733::__init__::232::IOProcess::(_processLogs) (203000) Got request for method 'glob' >Thread-137714::DEBUG::2014-10-29 11:31:40,734::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:31:40,734::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203000) Queuing response >Thread-137714::INFO::2014-10-29 11:31:40,735::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137714::INFO::2014-10-29 11:31:40,736::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137714::INFO::2014-10-29 11:31:40,737::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:31:40,739::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:40,740::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:40,740::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:40,740::__init__::232::IOProcess::(_processLogs) (203001) Got request for method 'statvfs' >Thread-33::DEBUG::2014-10-29 11:31:40,742::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:31:40,758::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203001) Queuing response >Thread-33::DEBUG::2014-10-29 11:31:40,761::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000518742 s, 939 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:31:40,761::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:40,763::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:40,764::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:40,764::__init__::232::IOProcess::(_processLogs) (203002) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:31:40,765::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203002) Queuing response >Thread-137714::DEBUG::2014-10-29 11:31:40,766::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:31:40,769::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:40,771::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:40,774::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-137714::DEBUG::2014-10-29 11:31:40,774::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`1ae2abf7-a92c-4bc8-b5b7-dae1f6bf87e8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137714::DEBUG::2014-10-29 11:31:40,776::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-17::DEBUG::2014-10-29 11:31:40,776::__init__::232::IOProcess::(_processLogs) (203003) Got request for method 'statvfs' >Thread-137714::DEBUG::2014-10-29 11:31:40,778::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137714::DEBUG::2014-10-29 11:31:40,780::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`1ae2abf7-a92c-4bc8-b5b7-dae1f6bf87e8`::Granted request >Thread-17::DEBUG::2014-10-29 11:31:40,784::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203003) Queuing response >Thread-137714::DEBUG::2014-10-29 11:31:40,787::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9e3ba50f-05c2-4589-a7bb-41ebf8725444`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137714::DEBUG::2014-10-29 11:31:40,789::task::993::Storage.TaskManager.Task::(_decref) Task=`9e3ba50f-05c2-4589-a7bb-41ebf8725444`::ref 1 aborting False >Thread-17::DEBUG::2014-10-29 11:31:40,791::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:40,793::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:40,795::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:40,797::__init__::232::IOProcess::(_processLogs) (203004) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:40,799::__init__::232::IOProcess::(_processLogs) (203004) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:40,803::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-137714::INFO::2014-10-29 11:31:40,805::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-17::DEBUG::2014-10-29 11:31:40,806::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137714::DEBUG::2014-10-29 11:31:40,807::task::1191::Storage.TaskManager.Task::(prepare) Task=`9e3ba50f-05c2-4589-a7bb-41ebf8725444`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-17::DEBUG::2014-10-29 11:31:40,807::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-137714::DEBUG::2014-10-29 11:31:40,808::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e3ba50f-05c2-4589-a7bb-41ebf8725444`::moving from state preparing -> state finished >Thread-137714::DEBUG::2014-10-29 11:31:40,810::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-17::DEBUG::2014-10-29 11:31:40,810::__init__::232::IOProcess::(_processLogs) (203005) Got request for method 'access' >Thread-137714::DEBUG::2014-10-29 11:31:40,811::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17::DEBUG::2014-10-29 11:31:40,814::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203005) Queuing response >Thread-137714::DEBUG::2014-10-29 11:31:40,815::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137714::DEBUG::2014-10-29 11:31:40,817::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-17::DEBUG::2014-10-29 11:31:40,818::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-137714::DEBUG::2014-10-29 11:31:40,818::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137714::DEBUG::2014-10-29 11:31:40,820::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-17::DEBUG::2014-10-29 11:31:40,819::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:40,821::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-137714::DEBUG::2014-10-29 11:31:40,823::task::993::Storage.TaskManager.Task::(_decref) Task=`9e3ba50f-05c2-4589-a7bb-41ebf8725444`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:31:40,823::__init__::232::IOProcess::(_processLogs) (203006) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:40,825::__init__::232::IOProcess::(_processLogs) (203006) Queuing response >Detector thread::DEBUG::2014-10-29 11:31:40,850::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54997 >Detector thread::DEBUG::2014-10-29 11:31:40,851::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54997 >Detector thread::DEBUG::2014-10-29 11:31:40,851::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54997 >Detector thread::DEBUG::2014-10-29 11:31:40,852::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54997) >Thread-137719::DEBUG::2014-10-29 11:31:40,890::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137719::DEBUG::2014-10-29 11:31:40,890::task::595::Storage.TaskManager.Task::(_updateState) Task=`50ab8c7d-5227-4748-90c4-dd71dad26ea8`::moving from state init -> state preparing >Thread-137719::INFO::2014-10-29 11:31:40,891::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137719::INFO::2014-10-29 11:31:40,891::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505163', 'lastCheck': '0.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518742', 'lastCheck': '0.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00074556', 'lastCheck': '0.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000523529', 'lastCheck': '0.3', 'valid': True}} >Thread-137719::DEBUG::2014-10-29 11:31:40,892::task::1191::Storage.TaskManager.Task::(prepare) Task=`50ab8c7d-5227-4748-90c4-dd71dad26ea8`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505163', 'lastCheck': '0.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518742', 'lastCheck': '0.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00074556', 'lastCheck': '0.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000523529', 'lastCheck': '0.3', 'valid': True}} >Thread-137719::DEBUG::2014-10-29 11:31:40,892::task::595::Storage.TaskManager.Task::(_updateState) Task=`50ab8c7d-5227-4748-90c4-dd71dad26ea8`::moving from state preparing -> state finished >Thread-137719::DEBUG::2014-10-29 11:31:40,892::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137719::DEBUG::2014-10-29 11:31:40,893::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137719::DEBUG::2014-10-29 11:31:40,893::task::993::Storage.TaskManager.Task::(_decref) Task=`50ab8c7d-5227-4748-90c4-dd71dad26ea8`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:31:41,211::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54998 >Detector thread::DEBUG::2014-10-29 11:31:41,211::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54998 >Detector thread::DEBUG::2014-10-29 11:31:41,212::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54998 >Detector thread::DEBUG::2014-10-29 11:31:41,212::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54998) >Thread-137720::DEBUG::2014-10-29 11:31:41,252::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f54eb73-075c-40d1-9fea-5aaa8d189374`::moving from state init -> state preparing >Thread-137720::INFO::2014-10-29 11:31:41,252::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137720::INFO::2014-10-29 11:31:41,253::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505163', 'lastCheck': '0.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518742', 'lastCheck': '0.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00074556', 'lastCheck': '0.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000523529', 'lastCheck': '0.7', 'valid': True}} >Thread-137720::DEBUG::2014-10-29 11:31:41,253::task::1191::Storage.TaskManager.Task::(prepare) Task=`0f54eb73-075c-40d1-9fea-5aaa8d189374`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505163', 'lastCheck': '0.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518742', 'lastCheck': '0.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00074556', 'lastCheck': '0.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000523529', 'lastCheck': '0.7', 'valid': True}} >Thread-137720::DEBUG::2014-10-29 11:31:41,253::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f54eb73-075c-40d1-9fea-5aaa8d189374`::moving from state preparing -> state finished >Thread-137720::DEBUG::2014-10-29 11:31:41,254::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137720::DEBUG::2014-10-29 11:31:41,254::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137720::DEBUG::2014-10-29 11:31:41,254::task::993::Storage.TaskManager.Task::(_decref) Task=`0f54eb73-075c-40d1-9fea-5aaa8d189374`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:41,432::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:41,434::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137721::DEBUG::2014-10-29 11:31:41,438::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:41,440::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:41,442::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137722::DEBUG::2014-10-29 11:31:41,445::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137722::DEBUG::2014-10-29 11:31:41,447::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:31:41,913::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:54999 >Detector thread::DEBUG::2014-10-29 11:31:41,913::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:54999 >Detector thread::DEBUG::2014-10-29 11:31:41,914::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:54999 >Detector thread::DEBUG::2014-10-29 11:31:41,914::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 54999) >Thread-137723::DEBUG::2014-10-29 11:31:41,953::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137723::DEBUG::2014-10-29 11:31:41,955::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137723::DEBUG::2014-10-29 11:31:41,975::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137723::DEBUG::2014-10-29 11:31:42,033::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '137', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '37', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:42,328::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:42,329::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:42,330::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:44,460::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:44,463::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137724::DEBUG::2014-10-29 11:31:44,467::task::595::Storage.TaskManager.Task::(_updateState) Task=`82253ee4-76df-4aa4-a04c-5548ece3a6ba`::moving from state init -> state preparing >Thread-137724::INFO::2014-10-29 11:31:44,468::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137724::INFO::2014-10-29 11:31:44,468::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505163', 'lastCheck': '3.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518742', 'lastCheck': '3.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00074556', 'lastCheck': '3.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000523529', 'lastCheck': '3.9', 'valid': True}} >Thread-137724::DEBUG::2014-10-29 11:31:44,469::task::1191::Storage.TaskManager.Task::(prepare) Task=`82253ee4-76df-4aa4-a04c-5548ece3a6ba`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505163', 'lastCheck': '3.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518742', 'lastCheck': '3.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00074556', 'lastCheck': '3.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000523529', 'lastCheck': '3.9', 'valid': True}} >Thread-137724::DEBUG::2014-10-29 11:31:44,469::task::595::Storage.TaskManager.Task::(_updateState) Task=`82253ee4-76df-4aa4-a04c-5548ece3a6ba`::moving from state preparing -> state finished >Thread-137724::DEBUG::2014-10-29 11:31:44,469::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137724::DEBUG::2014-10-29 11:31:44,469::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137724::DEBUG::2014-10-29 11:31:44,470::task::993::Storage.TaskManager.Task::(_decref) Task=`82253ee4-76df-4aa4-a04c-5548ece3a6ba`::ref 0 aborting False >Thread-137724::DEBUG::2014-10-29 11:31:44,490::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:44,513::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:44,515::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137725::DEBUG::2014-10-29 11:31:44,518::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137725::DEBUG::2014-10-29 11:31:44,520::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:47,338::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:47,339::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:47,340::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:47,600::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:47,602::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137726::DEBUG::2014-10-29 11:31:47,606::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:47,608::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:47,610::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137727::DEBUG::2014-10-29 11:31:47,613::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137727::DEBUG::2014-10-29 11:31:47,615::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:31:50,327::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55000 >Detector thread::DEBUG::2014-10-29 11:31:50,328::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55000 >Detector thread::DEBUG::2014-10-29 11:31:50,329::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55000 >Detector thread::DEBUG::2014-10-29 11:31:50,330::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55000) >Thread-137728::DEBUG::2014-10-29 11:31:50,368::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8147aad-1cdb-4b38-baa9-5366e0ad1d2c`::moving from state init -> state preparing >Thread-137728::INFO::2014-10-29 11:31:50,369::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137728::INFO::2014-10-29 11:31:50,370::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505163', 'lastCheck': '9.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518742', 'lastCheck': '9.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00074556', 'lastCheck': '9.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000523529', 'lastCheck': '9.8', 'valid': True}} >Thread-137728::DEBUG::2014-10-29 11:31:50,370::task::1191::Storage.TaskManager.Task::(prepare) Task=`d8147aad-1cdb-4b38-baa9-5366e0ad1d2c`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505163', 'lastCheck': '9.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000518742', 'lastCheck': '9.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00074556', 'lastCheck': '9.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000523529', 'lastCheck': '9.8', 'valid': True}} >Thread-137728::DEBUG::2014-10-29 11:31:50,370::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8147aad-1cdb-4b38-baa9-5366e0ad1d2c`::moving from state preparing -> state finished >Thread-137728::DEBUG::2014-10-29 11:31:50,370::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137728::DEBUG::2014-10-29 11:31:50,371::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137728::DEBUG::2014-10-29 11:31:50,371::task::993::Storage.TaskManager.Task::(_decref) Task=`d8147aad-1cdb-4b38-baa9-5366e0ad1d2c`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:31:50,506::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55001 >Detector thread::DEBUG::2014-10-29 11:31:50,507::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55001 >Detector thread::DEBUG::2014-10-29 11:31:50,507::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55001 >Detector thread::DEBUG::2014-10-29 11:31:50,508::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55001) >Thread-137729::DEBUG::2014-10-29 11:31:50,547::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137729::DEBUG::2014-10-29 11:31:50,548::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137729::DEBUG::2014-10-29 11:31:50,549::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.37', 'elapsedTime': '514943', 'displayType': 'vnc', 'cpuSys': '0.87', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '29823655', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '57725', 'readRate': '0.00', 'truesize': '6010912768', 'writeRate': '51768.17'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.06', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-17::DEBUG::2014-10-29 11:31:50,578::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:50,579::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:50,579::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-179::DEBUG::2014-10-29 11:31:50,580::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 38dc6c98-2b6a-45c0-b765-c5ce685415f9 >Thread-17::DEBUG::2014-10-29 11:31:50,580::__init__::232::IOProcess::(_processLogs) (203007) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:50,591::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203007) Queuing response >Thread-10269::DEBUG::2014-10-29 11:31:50,594::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:31:50,613::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:50,615::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:50,616::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:50,617::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10269::DEBUG::2014-10-29 11:31:50,619::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000873698 s, 575 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:31:50,619::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:50,623::__init__::232::IOProcess::(_processLogs) (203008) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:50,623::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:50,623::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:50,623::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:50,624::__init__::232::IOProcess::(_processLogs) (203009) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:50,624::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:50,624::__init__::232::IOProcess::(_processLogs) (203010) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:50,624::__init__::232::IOProcess::(_processLogs) (203010) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:50,626::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203008) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:50,627::__init__::232::IOProcess::(_processLogs) (203009) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:50,644::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:50,648::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-17::DEBUG::2014-10-29 11:31:50,649::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-179::DEBUG::2014-10-29 11:31:50,653::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9 >Thread-17::DEBUG::2014-10-29 11:31:50,655::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:50,662::__init__::232::IOProcess::(_processLogs) (203011) Got request for method 'glob' >JsonRpcServer::DEBUG::2014-10-29 11:31:50,664::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:31:50,670::__init__::232::IOProcess::(_processLogs) (203011) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:50,681::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-137734::DEBUG::2014-10-29 11:31:50,684::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:31:50,685::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:50,689::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:50,691::__init__::232::IOProcess::(_processLogs) (203012) Got request for method 'statvfs' >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:50,693::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-17::DEBUG::2014-10-29 11:31:50,698::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203012) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:50,704::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >JsonRpcServer::DEBUG::2014-10-29 11:31:50,704::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:31:50,707::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:50,709::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:50,711::__init__::232::IOProcess::(_processLogs) (203013) Got request for method 'touch' >Thread-137735::DEBUG::2014-10-29 11:31:50,716::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:31:50,716::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203013) Queuing response >Thread-179::DEBUG::2014-10-29 11:31:50,719::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:31:50,725::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:50,726::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:50,728::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:50,729::__init__::232::IOProcess::(_processLogs) (203014) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:31:50,732::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203014) Queuing response >Thread-179::DEBUG::2014-10-29 11:31:50,732::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nsednev_rhevm_3_5_second_SD', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=00000002-0002-0002-0002-000000000321', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_rhevm_3_5_second_SD', 'ROLE=Regular', 'SDUUID=38dc6c98-2b6a-45c0-b765-c5ce685415f9', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=ea5c54387b91bc1e37853d7501f0d1b2d7d233e7'] >Thread-17::DEBUG::2014-10-29 11:31:50,735::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:50,740::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:50,743::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-178::DEBUG::2014-10-29 11:31:50,743::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-137735::DEBUG::2014-10-29 11:31:50,763::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:31:50,745::__init__::232::IOProcess::(_processLogs) (203015) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:50,768::__init__::232::IOProcess::(_processLogs) (203015) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:50,773::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-178::DEBUG::2014-10-29 11:31:50,772::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000964579 s, 527 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:31:50,774::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:50,778::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:50,778::__init__::232::IOProcess::(_processLogs) (203016) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:50,778::__init__::232::IOProcess::(_processLogs) (203016) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:50,779::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:50,779::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:50,779::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:50,780::__init__::232::IOProcess::(_processLogs) (203017) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:50,781::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203017) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:50,783::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:50,783::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:50,783::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:50,783::__init__::232::IOProcess::(_processLogs) (203018) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:50,784::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203018) Queuing response >Thread-179::DEBUG::2014-10-29 11:31:50,784::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-179::INFO::2014-10-29 11:31:50,786::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 38dc6c98-2b6a-45c0-b765-c5ce685415f9_imageNS already registered >Thread-179::INFO::2014-10-29 11:31:50,787::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 38dc6c98-2b6a-45c0-b765-c5ce685415f9_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:31:50,788::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:50,790::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:50,791::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:50,791::__init__::232::IOProcess::(_processLogs) (203019) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:50,792::__init__::232::IOProcess::(_processLogs) (203019) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:50,792::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:50,793::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:50,793::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:50,793::__init__::232::IOProcess::(_processLogs) (203020) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:50,793::__init__::232::IOProcess::(_processLogs) (203020) Queuing response >Thread-179::DEBUG::2014-10-29 11:31:50,795::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:31:50,814::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-179::DEBUG::2014-10-29 11:31:50,819::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000463274 s, 803 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:31:50,820::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:50,821::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:50,822::__init__::232::IOProcess::(_processLogs) (203021) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:50,822::__init__::232::IOProcess::(_processLogs) (203021) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:50,823::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:50,824::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:50,824::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:50,825::__init__::232::IOProcess::(_processLogs) (203022) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:50,825::__init__::232::IOProcess::(_processLogs) (203022) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:50,825::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:50,826::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:50,826::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:50,826::__init__::232::IOProcess::(_processLogs) (203023) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:50,828::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203023) Queuing response >Thread-33::DEBUG::2014-10-29 11:31:50,839::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:31:50,845::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:50,851::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:50,852::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:50,853::__init__::232::IOProcess::(_processLogs) (203024) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:50,853::__init__::232::IOProcess::(_processLogs) (203024) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:50,853::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:50,854::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:50,854::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:50,854::__init__::232::IOProcess::(_processLogs) (203025) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:50,855::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203025) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:50,856::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:50,856::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:50,857::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:50,857::__init__::232::IOProcess::(_processLogs) (203026) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:50,858::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203026) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:50,862::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:50,864::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:50,865::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:50,867::__init__::232::IOProcess::(_processLogs) (203027) Got request for method 'glob' >Thread-33::DEBUG::2014-10-29 11:31:50,869::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:31:50,871::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203027) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:50,873::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:50,873::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:50,873::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:50,874::__init__::232::IOProcess::(_processLogs) (203028) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:31:50,874::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203028) Queuing response >Thread-33::DEBUG::2014-10-29 11:31:50,875::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:31:50,876::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:50,877::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:50,877::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:50,877::__init__::232::IOProcess::(_processLogs) (203029) Got request for method 'readfile' >Thread-33::DEBUG::2014-10-29 11:31:50,878::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:31:50,878::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203029) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:50,881::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:50,882::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:50,883::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:50,883::__init__::232::IOProcess::(_processLogs) (203030) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:50,884::__init__::232::IOProcess::(_processLogs) (203030) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:50,884::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:50,884::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-33::DEBUG::2014-10-29 11:31:50,885::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:31:50,885::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-33::INFO::2014-10-29 11:31:50,886::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:31:50,887::__init__::232::IOProcess::(_processLogs) (203031) Got request for method 'glob' >Thread-33::INFO::2014-10-29 11:31:50,888::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:31:50,889::__init__::232::IOProcess::(_processLogs) (203031) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:50,890::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:50,891::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:50,891::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:50,891::__init__::232::IOProcess::(_processLogs) (203032) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:50,893::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203032) Queuing response >Thread-33::DEBUG::2014-10-29 11:31:50,894::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:31:50,911::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000501757 s, 971 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:31:50,912::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:50,913::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:50,913::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:50,913::__init__::232::IOProcess::(_processLogs) (203033) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:31:50,915::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203033) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:50,916::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:50,917::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:50,918::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:50,918::__init__::232::IOProcess::(_processLogs) (203034) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:50,919::__init__::232::IOProcess::(_processLogs) (203034) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:50,919::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:50,920::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:50,920::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:50,921::__init__::232::IOProcess::(_processLogs) (203035) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:50,921::__init__::232::IOProcess::(_processLogs) (203035) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:50,922::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:50,923::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:50,923::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:50,925::__init__::232::IOProcess::(_processLogs) (203036) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:50,925::__init__::232::IOProcess::(_processLogs) (203036) Queuing response >Detector thread::DEBUG::2014-10-29 11:31:51,475::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55004 >Detector thread::DEBUG::2014-10-29 11:31:51,475::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55004 >Detector thread::DEBUG::2014-10-29 11:31:51,475::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55004 >Detector thread::DEBUG::2014-10-29 11:31:51,476::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55004) >Thread-22::DEBUG::2014-10-29 11:31:51,491::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a70f4ec-1cc8-4c88-9e71-d74815bfa147`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:31:51,491::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:31:51,492::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:51,493::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:51,493::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:51,493::__init__::232::IOProcess::(_processLogs) (203037) Got request for method 'stat' >Thread-137740::DEBUG::2014-10-29 11:31:51,516::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137740::DEBUG::2014-10-29 11:31:51,517::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd7f24d6-22a8-4052-aae2-b87b1649c2fd`::moving from state init -> state preparing >Thread-137740::INFO::2014-10-29 11:31:51,517::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137740::DEBUG::2014-10-29 11:31:51,520::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:31:51,521::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:51,521::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:51,521::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:51,521::__init__::232::IOProcess::(_processLogs) (203038) Got request for method 'glob' >Detector thread::DEBUG::2014-10-29 11:31:52,075::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55005 >Detector thread::DEBUG::2014-10-29 11:31:52,075::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55005 >Detector thread::DEBUG::2014-10-29 11:31:52,076::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55005 >Detector thread::DEBUG::2014-10-29 11:31:52,076::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55005) >Thread-137741::DEBUG::2014-10-29 11:31:52,115::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137741::DEBUG::2014-10-29 11:31:52,118::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137741::DEBUG::2014-10-29 11:31:52,136::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137741::DEBUG::2014-10-29 11:31:52,197::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '121', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '21', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-17::DEBUG::2014-10-29 11:31:52,271::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203038) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:52,271::__init__::232::IOProcess::(_processLogs) (203037) Queuing response >Thread-137740::DEBUG::2014-10-29 11:31:52,273::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137740::DEBUG::2014-10-29 11:31:52,276::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-17::DEBUG::2014-10-29 11:31:52,276::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-137740::INFO::2014-10-29 11:31:52,278::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137740::DEBUG::2014-10-29 11:31:52,280::task::1191::Storage.TaskManager.Task::(prepare) Task=`fd7f24d6-22a8-4052-aae2-b87b1649c2fd`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137740::DEBUG::2014-10-29 11:31:52,282::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd7f24d6-22a8-4052-aae2-b87b1649c2fd`::moving from state preparing -> state finished >Thread-17::DEBUG::2014-10-29 11:31:52,284::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-137740::DEBUG::2014-10-29 11:31:52,284::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::INFO::2014-10-29 11:31:52,285::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010912768', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:31:52,287::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-137740::DEBUG::2014-10-29 11:31:52,287::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2014-10-29 11:31:52,288::task::1191::Storage.TaskManager.Task::(prepare) Task=`2a70f4ec-1cc8-4c88-9e71-d74815bfa147`::finished: {'truesize': '6010912768', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:31:52,289::__init__::232::IOProcess::(_processLogs) (203039) Got request for method 'stat' >Thread-22::DEBUG::2014-10-29 11:31:52,291::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a70f4ec-1cc8-4c88-9e71-d74815bfa147`::moving from state preparing -> state finished >Thread-137740::DEBUG::2014-10-29 11:31:52,291::task::993::Storage.TaskManager.Task::(_decref) Task=`fd7f24d6-22a8-4052-aae2-b87b1649c2fd`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:31:52,292::__init__::232::IOProcess::(_processLogs) (203039) Queuing response >Thread-22::DEBUG::2014-10-29 11:31:52,293::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-10-29 11:31:52,295::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2014-10-29 11:31:52,297::task::993::Storage.TaskManager.Task::(_decref) Task=`2a70f4ec-1cc8-4c88-9e71-d74815bfa147`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:31:52,347::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55006 >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:52,349::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:31:52,350::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55006 >Detector thread::DEBUG::2014-10-29 11:31:52,353::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55006 >Detector thread::DEBUG::2014-10-29 11:31:52,355::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55006) >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:52,357::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:52,361::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-22::DEBUG::2014-10-29 11:31:52,384::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-137742::DEBUG::2014-10-29 11:31:52,387::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137742::DEBUG::2014-10-29 11:31:52,388::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a8f790b-c962-4853-b0ae-a1104addba8a`::moving from state init -> state preparing >Thread-137742::INFO::2014-10-29 11:31:52,388::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137742::DEBUG::2014-10-29 11:31:52,389::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137742::DEBUG::2014-10-29 11:31:52,389::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137742::DEBUG::2014-10-29 11:31:52,389::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137742::DEBUG::2014-10-29 11:31:52,389::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137742::DEBUG::2014-10-29 11:31:52,390::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137742::DEBUG::2014-10-29 11:31:52,390::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137742::DEBUG::2014-10-29 11:31:52,472::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137742::DEBUG::2014-10-29 11:31:52,473::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137742::DEBUG::2014-10-29 11:31:52,647::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137742::DEBUG::2014-10-29 11:31:52,649::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137742::DEBUG::2014-10-29 11:31:52,650::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137742::DEBUG::2014-10-29 11:31:52,650::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137742::DEBUG::2014-10-29 11:31:52,651::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137742::DEBUG::2014-10-29 11:31:52,651::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137742::DEBUG::2014-10-29 11:31:52,651::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137742::DEBUG::2014-10-29 11:31:52,652::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:31:52,655::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:52,656::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:52,656::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:52,656::__init__::232::IOProcess::(_processLogs) (203040) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:52,659::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203040) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:52,664::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:52,665::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:52,665::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:52,665::__init__::232::IOProcess::(_processLogs) (203041) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:52,665::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:52,666::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:52,666::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:52,666::__init__::232::IOProcess::(_processLogs) (203042) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:52,666::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:52,667::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:52,667::__init__::232::IOProcess::(_processLogs) (203041) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:52,668::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:52,670::__init__::232::IOProcess::(_processLogs) (203043) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:31:52,671::__init__::232::IOProcess::(_processLogs) (203042) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:52,673::__init__::232::IOProcess::(_processLogs) (203043) Queuing response >Thread-137742::DEBUG::2014-10-29 11:31:52,678::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:31:52,679::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:52,680::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:52,680::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:52,680::__init__::232::IOProcess::(_processLogs) (203044) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:31:52,681::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203044) Queuing response >Thread-137742::DEBUG::2014-10-29 11:31:52,681::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:31:52,682::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:52,683::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:52,683::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:52,684::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203045) Got request for method 'readfile' >Thread-137742::DEBUG::2014-10-29 11:31:52,684::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:31:52,685::__init__::232::IOProcess::(_processLogs) (203045) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:52,687::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:52,688::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:52,689::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:31:52,689::__init__::232::IOProcess::(_processLogs) (203046) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:31:52,689::__init__::232::IOProcess::(_processLogs) (203046) Queuing response >Thread-17::DEBUG::2014-10-29 11:31:52,690::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:52,690::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137742::DEBUG::2014-10-29 11:31:52,691::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:31:52,691::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-137742::INFO::2014-10-29 11:31:52,694::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:31:52,696::__init__::232::IOProcess::(_processLogs) (203047) Got request for method 'glob' >Thread-137742::INFO::2014-10-29 11:31:52,697::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:31:52,699::__init__::232::IOProcess::(_processLogs) (203047) Queuing response >Thread-137742::INFO::2014-10-29 11:31:52,700::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:31:52,704::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:31:52,706::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:31:52,709::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-137742::DEBUG::2014-10-29 11:31:52,709::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:31:52,712::__init__::232::IOProcess::(_processLogs) (203048) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:31:52,715::__init__::232::IOProcess::(_processLogs) (203048) Queuing response >Thread-137742::DEBUG::2014-10-29 11:31:52,720::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`0c29d880-96e6-4dbf-8d3f-c1eda7962277`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137742::DEBUG::2014-10-29 11:31:52,721::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137742::DEBUG::2014-10-29 11:31:52,723::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137742::DEBUG::2014-10-29 11:31:52,723::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`0c29d880-96e6-4dbf-8d3f-c1eda7962277`::Granted request >Thread-137742::DEBUG::2014-10-29 11:31:52,724::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3a8f790b-c962-4853-b0ae-a1104addba8a`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137742::DEBUG::2014-10-29 11:31:52,724::task::993::Storage.TaskManager.Task::(_decref) Task=`3a8f790b-c962-4853-b0ae-a1104addba8a`::ref 1 aborting False >Thread-137742::INFO::2014-10-29 11:31:52,731::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137742::DEBUG::2014-10-29 11:31:52,731::task::1191::Storage.TaskManager.Task::(prepare) Task=`3a8f790b-c962-4853-b0ae-a1104addba8a`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137742::DEBUG::2014-10-29 11:31:52,732::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a8f790b-c962-4853-b0ae-a1104addba8a`::moving from state preparing -> state finished >Thread-137742::DEBUG::2014-10-29 11:31:52,732::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137742::DEBUG::2014-10-29 11:31:52,732::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137742::DEBUG::2014-10-29 11:31:52,733::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137742::DEBUG::2014-10-29 11:31:52,733::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137742::DEBUG::2014-10-29 11:31:52,733::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137742::DEBUG::2014-10-29 11:31:52,733::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137742::DEBUG::2014-10-29 11:31:52,734::task::993::Storage.TaskManager.Task::(_decref) Task=`3a8f790b-c962-4853-b0ae-a1104addba8a`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:31:52,767::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55007 >Detector thread::DEBUG::2014-10-29 11:31:52,768::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55007 >Detector thread::DEBUG::2014-10-29 11:31:52,768::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55007 >Detector thread::DEBUG::2014-10-29 11:31:52,769::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55007) >Thread-137747::DEBUG::2014-10-29 11:31:52,808::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137747::DEBUG::2014-10-29 11:31:52,808::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ed5b22a-01db-4433-9858-7a025059ebad`::moving from state init -> state preparing >Thread-137747::INFO::2014-10-29 11:31:52,809::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137747::INFO::2014-10-29 11:31:52,809::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000964579', 'lastCheck': '2.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000501757', 'lastCheck': '1.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463274', 'lastCheck': '2.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000873698', 'lastCheck': '2.1', 'valid': True}} >Thread-137747::DEBUG::2014-10-29 11:31:52,810::task::1191::Storage.TaskManager.Task::(prepare) Task=`9ed5b22a-01db-4433-9858-7a025059ebad`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000964579', 'lastCheck': '2.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000501757', 'lastCheck': '1.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463274', 'lastCheck': '2.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000873698', 'lastCheck': '2.1', 'valid': True}} >Thread-137747::DEBUG::2014-10-29 11:31:52,810::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ed5b22a-01db-4433-9858-7a025059ebad`::moving from state preparing -> state finished >Thread-137747::DEBUG::2014-10-29 11:31:52,810::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137747::DEBUG::2014-10-29 11:31:52,810::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137747::DEBUG::2014-10-29 11:31:52,811::task::993::Storage.TaskManager.Task::(_decref) Task=`9ed5b22a-01db-4433-9858-7a025059ebad`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:53,791::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:53,793::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137748::DEBUG::2014-10-29 11:31:53,796::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:53,798::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:53,800::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137749::DEBUG::2014-10-29 11:31:53,805::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137749::DEBUG::2014-10-29 11:31:53,807::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:56,823::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:56,826::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137750::DEBUG::2014-10-29 11:31:56,830::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:56,832::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:56,834::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137751::DEBUG::2014-10-29 11:31:56,837::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137751::DEBUG::2014-10-29 11:31:56,840::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:57,367::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:57,368::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:31:57,369::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:59,855::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:59,857::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137752::DEBUG::2014-10-29 11:31:59,860::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a247073-1583-4b0f-be75-fd9bce1310d0`::moving from state init -> state preparing >Thread-137752::INFO::2014-10-29 11:31:59,861::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137752::INFO::2014-10-29 11:31:59,861::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000964579', 'lastCheck': '9.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000501757', 'lastCheck': '8.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463274', 'lastCheck': '9.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000873698', 'lastCheck': '9.2', 'valid': True}} >Thread-137752::DEBUG::2014-10-29 11:31:59,861::task::1191::Storage.TaskManager.Task::(prepare) Task=`0a247073-1583-4b0f-be75-fd9bce1310d0`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000964579', 'lastCheck': '9.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000501757', 'lastCheck': '8.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463274', 'lastCheck': '9.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000873698', 'lastCheck': '9.2', 'valid': True}} >Thread-137752::DEBUG::2014-10-29 11:31:59,862::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a247073-1583-4b0f-be75-fd9bce1310d0`::moving from state preparing -> state finished >Thread-137752::DEBUG::2014-10-29 11:31:59,862::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137752::DEBUG::2014-10-29 11:31:59,862::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137752::DEBUG::2014-10-29 11:31:59,863::task::993::Storage.TaskManager.Task::(_decref) Task=`0a247073-1583-4b0f-be75-fd9bce1310d0`::ref 0 aborting False >Thread-137752::DEBUG::2014-10-29 11:31:59,905::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:31:59,930::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:31:59,931::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137753::DEBUG::2014-10-29 11:31:59,934::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137753::DEBUG::2014-10-29 11:31:59,937::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:32:00,442::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55008 >Detector thread::DEBUG::2014-10-29 11:32:00,443::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55008 >Detector thread::DEBUG::2014-10-29 11:32:00,443::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55008 >Detector thread::DEBUG::2014-10-29 11:32:00,444::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55008) >Thread-137754::DEBUG::2014-10-29 11:32:00,483::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe9559e8-1920-4372-bd1d-f69ad2306745`::moving from state init -> state preparing >Thread-137754::INFO::2014-10-29 11:32:00,484::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137754::INFO::2014-10-29 11:32:00,484::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000964579', 'lastCheck': '9.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000501757', 'lastCheck': '9.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463274', 'lastCheck': '9.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000873698', 'lastCheck': '9.8', 'valid': True}} >Thread-137754::DEBUG::2014-10-29 11:32:00,485::task::1191::Storage.TaskManager.Task::(prepare) Task=`fe9559e8-1920-4372-bd1d-f69ad2306745`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000964579', 'lastCheck': '9.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000501757', 'lastCheck': '9.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000463274', 'lastCheck': '9.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000873698', 'lastCheck': '9.8', 'valid': True}} >Thread-137754::DEBUG::2014-10-29 11:32:00,485::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe9559e8-1920-4372-bd1d-f69ad2306745`::moving from state preparing -> state finished >Thread-137754::DEBUG::2014-10-29 11:32:00,485::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137754::DEBUG::2014-10-29 11:32:00,485::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137754::DEBUG::2014-10-29 11:32:00,486::task::993::Storage.TaskManager.Task::(_decref) Task=`fe9559e8-1920-4372-bd1d-f69ad2306745`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:32:00,702::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:00,702::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:00,703::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:00,703::__init__::232::IOProcess::(_processLogs) (203049) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:00,703::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203049) Queuing response >Thread-10269::DEBUG::2014-10-29 11:32:00,705::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:32:00,721::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00045548 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:32:00,723::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:00,724::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:00,724::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:00,724::__init__::232::IOProcess::(_processLogs) (203050) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:00,726::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203050) Queuing response >Detector thread::DEBUG::2014-10-29 11:32:00,743::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55009 >Detector thread::DEBUG::2014-10-29 11:32:00,744::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55009 >Detector thread::DEBUG::2014-10-29 11:32:00,744::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55009 >Detector thread::DEBUG::2014-10-29 11:32:00,745::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55009) >Thread-137755::DEBUG::2014-10-29 11:32:00,783::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137755::DEBUG::2014-10-29 11:32:00,784::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137755::DEBUG::2014-10-29 11:32:00,785::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.47', 'elapsedTime': '514953', 'displayType': 'vnc', 'cpuSys': '0.63', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '29821903', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '58544', 'readRate': '0.00', 'truesize': '6010912768', 'writeRate': '37663.18'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.40', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-17::DEBUG::2014-10-29 11:32:00,843::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:00,843::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:00,843::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:00,844::__init__::232::IOProcess::(_processLogs) (203051) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:00,845::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203051) Queuing response >Thread-178::DEBUG::2014-10-29 11:32:00,847::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:32:00,867::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:00,869::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-179::DEBUG::2014-10-29 11:32:00,870::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:32:00,871::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:00,891::__init__::232::IOProcess::(_processLogs) (203052) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:32:00,892::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00353028 s, 144 kB/s\n'; <rc> = 0 >Thread-179::DEBUG::2014-10-29 11:32:00,893::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000521272 s, 714 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:32:00,894::__init__::232::IOProcess::(_processLogs) (203052) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:00,899::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:00,899::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:00,900::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:00,900::__init__::232::IOProcess::(_processLogs) (203053) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:00,902::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203053) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:00,904::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:00,904::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:00,904::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:00,904::__init__::232::IOProcess::(_processLogs) (203054) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:00,905::__init__::232::IOProcess::(_processLogs) (203054) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:00,907::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:00,908::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:00,908::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:00,908::__init__::232::IOProcess::(_processLogs) (203055) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:00,909::__init__::232::IOProcess::(_processLogs) (203055) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:00,911::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:00,913::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:00,913::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:00,913::__init__::232::IOProcess::(_processLogs) (203056) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:00,914::__init__::232::IOProcess::(_processLogs) (203056) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:00,914::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:00,915::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:00,915::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:00,915::__init__::232::IOProcess::(_processLogs) (203057) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:00,916::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203057) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:00,925::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:00,925::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:00,926::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:00,926::__init__::232::IOProcess::(_processLogs) (203058) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:00,927::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203058) Queuing response >Thread-33::DEBUG::2014-10-29 11:32:00,929::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:32:00,946::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000526024 s, 926 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:32:00,947::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:00,948::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:00,948::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:00,948::__init__::232::IOProcess::(_processLogs) (203059) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:00,949::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203059) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:00,951::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:00,952::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:00,952::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:00,953::__init__::232::IOProcess::(_processLogs) (203060) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:00,953::__init__::232::IOProcess::(_processLogs) (203060) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:00,953::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:00,954::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:00,955::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:00,955::__init__::232::IOProcess::(_processLogs) (203061) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:00,955::__init__::232::IOProcess::(_processLogs) (203061) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:00,956::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:00,957::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:00,958::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:00,959::__init__::232::IOProcess::(_processLogs) (203062) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:00,959::__init__::232::IOProcess::(_processLogs) (203062) Queuing response >Detector thread::DEBUG::2014-10-29 11:32:01,245::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55011 >Detector thread::DEBUG::2014-10-29 11:32:01,246::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55011 >Detector thread::DEBUG::2014-10-29 11:32:01,246::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55011 >Detector thread::DEBUG::2014-10-29 11:32:01,246::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55011) >Thread-137756::DEBUG::2014-10-29 11:32:01,285::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137756::DEBUG::2014-10-29 11:32:01,287::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137756::DEBUG::2014-10-29 11:32:01,306::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137756::DEBUG::2014-10-29 11:32:01,351::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '5', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '5', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:02,373::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:02,375::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:02,377::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:02,985::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:02,988::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137757::DEBUG::2014-10-29 11:32:02,992::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:02,994::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:02,996::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137758::DEBUG::2014-10-29 11:32:02,999::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137758::DEBUG::2014-10-29 11:32:03,001::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:32:03,374::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55013 >Detector thread::DEBUG::2014-10-29 11:32:03,374::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55013 >Detector thread::DEBUG::2014-10-29 11:32:03,375::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55013 >Detector thread::DEBUG::2014-10-29 11:32:03,375::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55013) >Thread-137759::DEBUG::2014-10-29 11:32:03,415::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137759::DEBUG::2014-10-29 11:32:03,415::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a2bcf9a-ae31-4f75-8f89-ed61baab4aff`::moving from state init -> state preparing >Thread-137759::INFO::2014-10-29 11:32:03,416::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137759::DEBUG::2014-10-29 11:32:03,419::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:32:03,420::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:03,421::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:03,421::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:03,421::__init__::232::IOProcess::(_processLogs) (203063) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:32:03,422::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203063) Queuing response >Thread-137759::DEBUG::2014-10-29 11:32:03,423::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137759::DEBUG::2014-10-29 11:32:03,423::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137759::INFO::2014-10-29 11:32:03,424::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137759::DEBUG::2014-10-29 11:32:03,424::task::1191::Storage.TaskManager.Task::(prepare) Task=`6a2bcf9a-ae31-4f75-8f89-ed61baab4aff`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137759::DEBUG::2014-10-29 11:32:03,424::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a2bcf9a-ae31-4f75-8f89-ed61baab4aff`::moving from state preparing -> state finished >Thread-137759::DEBUG::2014-10-29 11:32:03,425::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137759::DEBUG::2014-10-29 11:32:03,425::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137759::DEBUG::2014-10-29 11:32:03,425::task::993::Storage.TaskManager.Task::(_decref) Task=`6a2bcf9a-ae31-4f75-8f89-ed61baab4aff`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:32:03,468::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55014 >Detector thread::DEBUG::2014-10-29 11:32:03,469::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55014 >Detector thread::DEBUG::2014-10-29 11:32:03,469::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55014 >Detector thread::DEBUG::2014-10-29 11:32:03,470::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55014) >Thread-137760::DEBUG::2014-10-29 11:32:03,508::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137760::DEBUG::2014-10-29 11:32:03,508::task::595::Storage.TaskManager.Task::(_updateState) Task=`544d7a46-7ff9-47e5-9694-3133a770fa1a`::moving from state init -> state preparing >Thread-137760::INFO::2014-10-29 11:32:03,509::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137760::DEBUG::2014-10-29 11:32:03,509::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137760::DEBUG::2014-10-29 11:32:03,509::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137760::DEBUG::2014-10-29 11:32:03,510::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137760::DEBUG::2014-10-29 11:32:03,510::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137760::DEBUG::2014-10-29 11:32:03,510::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137760::DEBUG::2014-10-29 11:32:03,511::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137760::DEBUG::2014-10-29 11:32:03,596::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137760::DEBUG::2014-10-29 11:32:03,597::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137760::DEBUG::2014-10-29 11:32:03,772::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137760::DEBUG::2014-10-29 11:32:03,773::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137760::DEBUG::2014-10-29 11:32:03,773::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137760::DEBUG::2014-10-29 11:32:03,773::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137760::DEBUG::2014-10-29 11:32:03,774::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137760::DEBUG::2014-10-29 11:32:03,774::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137760::DEBUG::2014-10-29 11:32:03,775::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137760::DEBUG::2014-10-29 11:32:03,775::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:32:03,779::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:03,779::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:03,780::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:03,780::__init__::232::IOProcess::(_processLogs) (203064) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:32:03,781::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203064) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:03,785::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:03,786::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:03,787::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:03,787::__init__::232::IOProcess::(_processLogs) (203065) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:32:03,788::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203065) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:03,792::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:03,794::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:03,795::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:03,799::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203066) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:32:03,802::__init__::232::IOProcess::(_processLogs) (203066) Queuing response >Thread-137760::DEBUG::2014-10-29 11:32:03,802::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:32:03,804::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:03,805::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:03,806::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:03,806::__init__::232::IOProcess::(_processLogs) (203067) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:32:03,807::__init__::232::IOProcess::(_processLogs) (203067) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:03,807::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:03,807::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:03,807::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:03,808::__init__::232::IOProcess::(_processLogs) (203068) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:32:03,808::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203068) Queuing response >Thread-137760::DEBUG::2014-10-29 11:32:03,809::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:32:03,810::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:03,810::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:03,811::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:03,811::__init__::232::IOProcess::(_processLogs) (203069) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:32:03,812::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203069) Queuing response >Thread-137760::DEBUG::2014-10-29 11:32:03,812::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:32:03,814::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:03,814::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:03,815::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:03,816::__init__::232::IOProcess::(_processLogs) (203070) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:03,816::__init__::232::IOProcess::(_processLogs) (203070) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:03,817::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:03,817::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:03,817::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:03,818::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203071) Got request for method 'glob' >Thread-137760::DEBUG::2014-10-29 11:32:03,818::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-137760::INFO::2014-10-29 11:32:03,819::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:32:03,819::__init__::232::IOProcess::(_processLogs) (203071) Queuing response >Thread-137760::INFO::2014-10-29 11:32:03,820::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137760::INFO::2014-10-29 11:32:03,821::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:32:03,822::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:03,822::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:03,822::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:03,823::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203072) Got request for method 'readfile' >Thread-137760::DEBUG::2014-10-29 11:32:03,823::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:32:03,824::__init__::232::IOProcess::(_processLogs) (203072) Queuing response >Thread-137760::DEBUG::2014-10-29 11:32:03,827::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`c774502a-6ea3-454b-b95f-9b4622fc2f18`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137760::DEBUG::2014-10-29 11:32:03,827::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137760::DEBUG::2014-10-29 11:32:03,828::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137760::DEBUG::2014-10-29 11:32:03,828::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`c774502a-6ea3-454b-b95f-9b4622fc2f18`::Granted request >Thread-137760::DEBUG::2014-10-29 11:32:03,828::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`544d7a46-7ff9-47e5-9694-3133a770fa1a`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137760::DEBUG::2014-10-29 11:32:03,829::task::993::Storage.TaskManager.Task::(_decref) Task=`544d7a46-7ff9-47e5-9694-3133a770fa1a`::ref 1 aborting False >Thread-137760::INFO::2014-10-29 11:32:03,831::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137760::DEBUG::2014-10-29 11:32:03,832::task::1191::Storage.TaskManager.Task::(prepare) Task=`544d7a46-7ff9-47e5-9694-3133a770fa1a`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137760::DEBUG::2014-10-29 11:32:03,832::task::595::Storage.TaskManager.Task::(_updateState) Task=`544d7a46-7ff9-47e5-9694-3133a770fa1a`::moving from state preparing -> state finished >Thread-137760::DEBUG::2014-10-29 11:32:03,832::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137760::DEBUG::2014-10-29 11:32:03,833::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137760::DEBUG::2014-10-29 11:32:03,833::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137760::DEBUG::2014-10-29 11:32:03,833::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137760::DEBUG::2014-10-29 11:32:03,833::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137760::DEBUG::2014-10-29 11:32:03,834::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137760::DEBUG::2014-10-29 11:32:03,834::task::993::Storage.TaskManager.Task::(_decref) Task=`544d7a46-7ff9-47e5-9694-3133a770fa1a`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:32:03,856::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55015 >Detector thread::DEBUG::2014-10-29 11:32:03,857::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55015 >Detector thread::DEBUG::2014-10-29 11:32:03,857::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55015 >Detector thread::DEBUG::2014-10-29 11:32:03,857::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55015) >Thread-137765::DEBUG::2014-10-29 11:32:03,896::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137765::DEBUG::2014-10-29 11:32:03,896::task::595::Storage.TaskManager.Task::(_updateState) Task=`609b7d66-7c84-4a2d-8641-40e1242c0195`::moving from state init -> state preparing >Thread-137765::INFO::2014-10-29 11:32:03,897::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137765::INFO::2014-10-29 11:32:03,897::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00353028', 'lastCheck': '3.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526024', 'lastCheck': '2.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521272', 'lastCheck': '3.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00045548', 'lastCheck': '3.2', 'valid': True}} >Thread-137765::DEBUG::2014-10-29 11:32:03,898::task::1191::Storage.TaskManager.Task::(prepare) Task=`609b7d66-7c84-4a2d-8641-40e1242c0195`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00353028', 'lastCheck': '3.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526024', 'lastCheck': '2.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521272', 'lastCheck': '3.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00045548', 'lastCheck': '3.2', 'valid': True}} >Thread-137765::DEBUG::2014-10-29 11:32:03,898::task::595::Storage.TaskManager.Task::(_updateState) Task=`609b7d66-7c84-4a2d-8641-40e1242c0195`::moving from state preparing -> state finished >Thread-137765::DEBUG::2014-10-29 11:32:03,898::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137765::DEBUG::2014-10-29 11:32:03,898::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137765::DEBUG::2014-10-29 11:32:03,899::task::993::Storage.TaskManager.Task::(_decref) Task=`609b7d66-7c84-4a2d-8641-40e1242c0195`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-10-29 11:32:05,083::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:06,027::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:06,030::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137766::DEBUG::2014-10-29 11:32:06,034::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:06,037::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:06,038::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137767::DEBUG::2014-10-29 11:32:06,041::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137767::DEBUG::2014-10-29 11:32:06,044::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:07,384::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:07,385::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:07,388::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-22::DEBUG::2014-10-29 11:32:07,407::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:09,058::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:09,060::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137768::DEBUG::2014-10-29 11:32:09,063::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:09,066::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:09,068::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137769::DEBUG::2014-10-29 11:32:09,070::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137769::DEBUG::2014-10-29 11:32:09,073::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:32:10,540::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55016 >Detector thread::DEBUG::2014-10-29 11:32:10,540::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55016 >Detector thread::DEBUG::2014-10-29 11:32:10,541::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55016 >Detector thread::DEBUG::2014-10-29 11:32:10,541::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55016) >Thread-137770::DEBUG::2014-10-29 11:32:10,584::task::595::Storage.TaskManager.Task::(_updateState) Task=`166892eb-e18d-4e60-9ee4-28e7a53f37dd`::moving from state init -> state preparing >Thread-137770::INFO::2014-10-29 11:32:10,584::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137770::INFO::2014-10-29 11:32:10,586::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00353028', 'lastCheck': '9.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526024', 'lastCheck': '9.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521272', 'lastCheck': '9.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00045548', 'lastCheck': '9.9', 'valid': True}} >Thread-137770::DEBUG::2014-10-29 11:32:10,586::task::1191::Storage.TaskManager.Task::(prepare) Task=`166892eb-e18d-4e60-9ee4-28e7a53f37dd`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00353028', 'lastCheck': '9.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000526024', 'lastCheck': '9.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000521272', 'lastCheck': '9.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00045548', 'lastCheck': '9.9', 'valid': True}} >Thread-137770::DEBUG::2014-10-29 11:32:10,586::task::595::Storage.TaskManager.Task::(_updateState) Task=`166892eb-e18d-4e60-9ee4-28e7a53f37dd`::moving from state preparing -> state finished >Thread-137770::DEBUG::2014-10-29 11:32:10,587::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137770::DEBUG::2014-10-29 11:32:10,587::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137770::DEBUG::2014-10-29 11:32:10,587::task::993::Storage.TaskManager.Task::(_decref) Task=`166892eb-e18d-4e60-9ee4-28e7a53f37dd`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:32:10,729::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:10,730::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:10,730::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:10,731::__init__::232::IOProcess::(_processLogs) (203073) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:10,732::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203073) Queuing response >Thread-10269::DEBUG::2014-10-29 11:32:10,734::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:32:10,754::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000453007 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:32:10,756::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:10,756::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:10,757::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:10,757::__init__::232::IOProcess::(_processLogs) (203074) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:10,759::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203074) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:10,912::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:10,912::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:10,913::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:10,913::__init__::232::IOProcess::(_processLogs) (203075) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:10,913::__init__::232::IOProcess::(_processLogs) (203075) Queuing response >Thread-179::DEBUG::2014-10-29 11:32:10,914::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:32:10,934::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000425561 s, 874 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:32:10,935::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:10,938::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:10,940::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:10,941::__init__::232::IOProcess::(_processLogs) (203076) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:32:10,941::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:32:10,942::__init__::232::IOProcess::(_processLogs) (203076) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:10,959::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:10,965::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Detector thread::DEBUG::2014-10-29 11:32:10,965::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55017 >Thread-178::DEBUG::2014-10-29 11:32:10,968::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.0051512 s, 98.6 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:32:10,969::__init__::232::IOProcess::(_processLogs) Extracting request information... >Detector thread::DEBUG::2014-10-29 11:32:10,973::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55017 >Thread-17::DEBUG::2014-10-29 11:32:10,973::__init__::232::IOProcess::(_processLogs) (203077) Got request for method 'statvfs' >Detector thread::DEBUG::2014-10-29 11:32:10,975::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55017 >Thread-17::DEBUG::2014-10-29 11:32:10,975::__init__::232::IOProcess::(_processLogs) (203077) Queuing response >Detector thread::DEBUG::2014-10-29 11:32:10,977::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55017) >Thread-17::DEBUG::2014-10-29 11:32:10,982::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:10,982::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:10,982::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:10,983::__init__::232::IOProcess::(_processLogs) (203078) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:10,984::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203078) Queuing response >Thread-33::DEBUG::2014-10-29 11:32:10,985::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:32:11,002::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:11,004::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-137771::DEBUG::2014-10-29 11:32:11,006::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-33::DEBUG::2014-10-29 11:32:11,008::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00268474 s, 181 kB/s\n'; <rc> = 0 >Thread-137771::DEBUG::2014-10-29 11:32:11,015::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:32:11,019::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-137771::DEBUG::2014-10-29 11:32:11,022::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.42', 'elapsedTime': '514963', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '29821903', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '58544', 'readRate': '0.00', 'truesize': '6010912768', 'writeRate': '37663.18'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.60', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-17::DEBUG::2014-10-29 11:32:11,023::__init__::232::IOProcess::(_processLogs) (203079) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:11,025::__init__::232::IOProcess::(_processLogs) (203079) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:11,028::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:11,030::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:11,031::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:11,033::__init__::232::IOProcess::(_processLogs) (203080) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:11,040::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203080) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:11,042::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:11,043::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:11,043::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:11,044::__init__::232::IOProcess::(_processLogs) (203081) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:11,044::__init__::232::IOProcess::(_processLogs) (203081) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:11,044::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:11,044::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:11,046::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:11,046::__init__::232::IOProcess::(_processLogs) (203082) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:11,047::__init__::232::IOProcess::(_processLogs) (203082) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:11,047::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:11,048::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:11,048::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:11,048::__init__::232::IOProcess::(_processLogs) (203083) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:11,049::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203083) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:11,052::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:11,053::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:11,053::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:11,054::__init__::232::IOProcess::(_processLogs) (203084) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:11,054::__init__::232::IOProcess::(_processLogs) (203084) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:11,055::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:11,056::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:11,057::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:11,057::__init__::232::IOProcess::(_processLogs) (203085) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:11,058::__init__::232::IOProcess::(_processLogs) (203085) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:11,059::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:11,060::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:11,060::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:11,060::__init__::232::IOProcess::(_processLogs) (203086) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:11,061::__init__::232::IOProcess::(_processLogs) (203086) Queuing response >Detector thread::DEBUG::2014-10-29 11:32:11,399::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55019 >Detector thread::DEBUG::2014-10-29 11:32:11,399::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55019 >Detector thread::DEBUG::2014-10-29 11:32:11,399::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55019 >Detector thread::DEBUG::2014-10-29 11:32:11,400::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55019) >Thread-137772::DEBUG::2014-10-29 11:32:11,439::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137772::DEBUG::2014-10-29 11:32:11,441::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137772::DEBUG::2014-10-29 11:32:11,459::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137772::DEBUG::2014-10-29 11:32:11,506::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '190', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '90', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:12,088::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:12,090::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137773::DEBUG::2014-10-29 11:32:12,094::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:12,097::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:12,098::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137774::DEBUG::2014-10-29 11:32:12,102::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137774::DEBUG::2014-10-29 11:32:12,104::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:12,396::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:12,397::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:12,399::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:32:14,478::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55021 >Detector thread::DEBUG::2014-10-29 11:32:14,479::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55021 >Detector thread::DEBUG::2014-10-29 11:32:14,479::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55021 >Detector thread::DEBUG::2014-10-29 11:32:14,480::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55021) >Thread-137775::DEBUG::2014-10-29 11:32:14,519::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137775::DEBUG::2014-10-29 11:32:14,520::task::595::Storage.TaskManager.Task::(_updateState) Task=`af73651c-0414-4519-ba4e-e05832150b0f`::moving from state init -> state preparing >Thread-137775::INFO::2014-10-29 11:32:14,520::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137775::DEBUG::2014-10-29 11:32:14,523::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:32:14,524::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:14,524::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:14,524::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:14,525::__init__::232::IOProcess::(_processLogs) (203087) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:32:14,526::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203087) Queuing response >Thread-137775::DEBUG::2014-10-29 11:32:14,526::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137775::DEBUG::2014-10-29 11:32:14,528::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137775::INFO::2014-10-29 11:32:14,528::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137775::DEBUG::2014-10-29 11:32:14,528::task::1191::Storage.TaskManager.Task::(prepare) Task=`af73651c-0414-4519-ba4e-e05832150b0f`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137775::DEBUG::2014-10-29 11:32:14,529::task::595::Storage.TaskManager.Task::(_updateState) Task=`af73651c-0414-4519-ba4e-e05832150b0f`::moving from state preparing -> state finished >Thread-137775::DEBUG::2014-10-29 11:32:14,529::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137775::DEBUG::2014-10-29 11:32:14,529::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137775::DEBUG::2014-10-29 11:32:14,529::task::993::Storage.TaskManager.Task::(_decref) Task=`af73651c-0414-4519-ba4e-e05832150b0f`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:32:14,573::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55022 >Detector thread::DEBUG::2014-10-29 11:32:14,573::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55022 >Detector thread::DEBUG::2014-10-29 11:32:14,574::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55022 >Detector thread::DEBUG::2014-10-29 11:32:14,574::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55022) >Thread-137776::DEBUG::2014-10-29 11:32:14,613::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137776::DEBUG::2014-10-29 11:32:14,614::task::595::Storage.TaskManager.Task::(_updateState) Task=`fad94a3f-5868-431a-a6ad-01c60b2df1d5`::moving from state init -> state preparing >Thread-137776::INFO::2014-10-29 11:32:14,614::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137776::DEBUG::2014-10-29 11:32:14,614::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137776::DEBUG::2014-10-29 11:32:14,615::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137776::DEBUG::2014-10-29 11:32:14,615::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137776::DEBUG::2014-10-29 11:32:14,615::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137776::DEBUG::2014-10-29 11:32:14,615::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137776::DEBUG::2014-10-29 11:32:14,616::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137776::DEBUG::2014-10-29 11:32:14,708::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137776::DEBUG::2014-10-29 11:32:14,710::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137776::DEBUG::2014-10-29 11:32:14,880::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137776::DEBUG::2014-10-29 11:32:14,882::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137776::DEBUG::2014-10-29 11:32:14,884::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137776::DEBUG::2014-10-29 11:32:14,887::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137776::DEBUG::2014-10-29 11:32:14,890::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137776::DEBUG::2014-10-29 11:32:14,890::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137776::DEBUG::2014-10-29 11:32:14,892::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137776::DEBUG::2014-10-29 11:32:14,893::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:32:14,905::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:14,909::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:14,909::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:14,910::__init__::232::IOProcess::(_processLogs) (203088) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:32:14,913::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203088) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:14,916::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:14,917::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:14,917::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:14,917::__init__::232::IOProcess::(_processLogs) (203089) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:32:14,917::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203089) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:14,918::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:14,919::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:14,920::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:14,922::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:14,924::__init__::232::IOProcess::(_processLogs) (203090) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:32:14,926::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:14,928::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:14,930::__init__::232::IOProcess::(_processLogs) (203091) Got request for method 'glob' >Thread-137776::DEBUG::2014-10-29 11:32:14,932::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:32:14,932::__init__::232::IOProcess::(_processLogs) (203090) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:14,934::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203091) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:14,936::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:14,936::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:14,937::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:14,937::__init__::232::IOProcess::(_processLogs) (203092) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:32:14,938::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203092) Queuing response >Thread-137776::DEBUG::2014-10-29 11:32:14,939::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:32:14,941::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:14,941::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:14,941::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:14,941::__init__::232::IOProcess::(_processLogs) (203093) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:32:14,942::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203093) Queuing response >Thread-137776::DEBUG::2014-10-29 11:32:14,943::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:32:14,945::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:14,945::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:14,945::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:14,946::__init__::232::IOProcess::(_processLogs) (203094) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:14,946::__init__::232::IOProcess::(_processLogs) (203094) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:14,947::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:14,947::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:14,948::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:14,948::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203095) Got request for method 'glob' >Thread-137776::DEBUG::2014-10-29 11:32:14,948::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:32:14,950::__init__::232::IOProcess::(_processLogs) (203095) Queuing response >Thread-137776::INFO::2014-10-29 11:32:14,950::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137776::INFO::2014-10-29 11:32:14,951::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137776::INFO::2014-10-29 11:32:14,952::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:32:14,952::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:14,953::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:14,953::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:14,953::__init__::232::IOProcess::(_processLogs) (203096) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:32:14,954::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203096) Queuing response >Thread-137776::DEBUG::2014-10-29 11:32:14,955::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137776::DEBUG::2014-10-29 11:32:14,957::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`80437df1-dd5f-4488-a2dc-a930cecb3bda`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137776::DEBUG::2014-10-29 11:32:14,957::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137776::DEBUG::2014-10-29 11:32:14,958::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137776::DEBUG::2014-10-29 11:32:14,958::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`80437df1-dd5f-4488-a2dc-a930cecb3bda`::Granted request >Thread-137776::DEBUG::2014-10-29 11:32:14,959::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fad94a3f-5868-431a-a6ad-01c60b2df1d5`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137776::DEBUG::2014-10-29 11:32:14,960::task::993::Storage.TaskManager.Task::(_decref) Task=`fad94a3f-5868-431a-a6ad-01c60b2df1d5`::ref 1 aborting False >Thread-137776::INFO::2014-10-29 11:32:14,964::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137776::DEBUG::2014-10-29 11:32:14,964::task::1191::Storage.TaskManager.Task::(prepare) Task=`fad94a3f-5868-431a-a6ad-01c60b2df1d5`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137776::DEBUG::2014-10-29 11:32:14,965::task::595::Storage.TaskManager.Task::(_updateState) Task=`fad94a3f-5868-431a-a6ad-01c60b2df1d5`::moving from state preparing -> state finished >Thread-137776::DEBUG::2014-10-29 11:32:14,965::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137776::DEBUG::2014-10-29 11:32:14,966::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137776::DEBUG::2014-10-29 11:32:14,966::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137776::DEBUG::2014-10-29 11:32:14,967::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137776::DEBUG::2014-10-29 11:32:14,967::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137776::DEBUG::2014-10-29 11:32:14,967::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137776::DEBUG::2014-10-29 11:32:14,968::task::993::Storage.TaskManager.Task::(_decref) Task=`fad94a3f-5868-431a-a6ad-01c60b2df1d5`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:32:14,989::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55023 >Detector thread::DEBUG::2014-10-29 11:32:14,990::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55023 >Detector thread::DEBUG::2014-10-29 11:32:14,990::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55023 >Detector thread::DEBUG::2014-10-29 11:32:14,991::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55023) >Thread-137781::DEBUG::2014-10-29 11:32:15,029::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137781::DEBUG::2014-10-29 11:32:15,030::task::595::Storage.TaskManager.Task::(_updateState) Task=`69c79fbf-3b43-4dce-8f2c-e9c2104a7575`::moving from state init -> state preparing >Thread-137781::INFO::2014-10-29 11:32:15,030::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137781::INFO::2014-10-29 11:32:15,031::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0051512', 'lastCheck': '4.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00268474', 'lastCheck': '4.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425561', 'lastCheck': '4.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000453007', 'lastCheck': '4.3', 'valid': True}} >Thread-137781::DEBUG::2014-10-29 11:32:15,031::task::1191::Storage.TaskManager.Task::(prepare) Task=`69c79fbf-3b43-4dce-8f2c-e9c2104a7575`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0051512', 'lastCheck': '4.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00268474', 'lastCheck': '4.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425561', 'lastCheck': '4.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000453007', 'lastCheck': '4.3', 'valid': True}} >Thread-137781::DEBUG::2014-10-29 11:32:15,031::task::595::Storage.TaskManager.Task::(_updateState) Task=`69c79fbf-3b43-4dce-8f2c-e9c2104a7575`::moving from state preparing -> state finished >Thread-137781::DEBUG::2014-10-29 11:32:15,031::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137781::DEBUG::2014-10-29 11:32:15,032::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137781::DEBUG::2014-10-29 11:32:15,032::task::993::Storage.TaskManager.Task::(_decref) Task=`69c79fbf-3b43-4dce-8f2c-e9c2104a7575`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:15,131::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:15,139::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137782::DEBUG::2014-10-29 11:32:15,142::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa3312c1-7873-4894-8cfc-d42f05027793`::moving from state init -> state preparing >Thread-137782::INFO::2014-10-29 11:32:15,143::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137782::INFO::2014-10-29 11:32:15,144::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0051512', 'lastCheck': '4.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00268474', 'lastCheck': '4.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425561', 'lastCheck': '4.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000453007', 'lastCheck': '4.4', 'valid': True}} >Thread-137782::DEBUG::2014-10-29 11:32:15,144::task::1191::Storage.TaskManager.Task::(prepare) Task=`fa3312c1-7873-4894-8cfc-d42f05027793`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0051512', 'lastCheck': '4.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00268474', 'lastCheck': '4.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425561', 'lastCheck': '4.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000453007', 'lastCheck': '4.4', 'valid': True}} >Thread-137782::DEBUG::2014-10-29 11:32:15,144::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa3312c1-7873-4894-8cfc-d42f05027793`::moving from state preparing -> state finished >Thread-137782::DEBUG::2014-10-29 11:32:15,144::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137782::DEBUG::2014-10-29 11:32:15,145::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137782::DEBUG::2014-10-29 11:32:15,145::task::993::Storage.TaskManager.Task::(_decref) Task=`fa3312c1-7873-4894-8cfc-d42f05027793`::ref 0 aborting False >Thread-137782::DEBUG::2014-10-29 11:32:15,202::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:15,227::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:15,229::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137783::DEBUG::2014-10-29 11:32:15,233::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137783::DEBUG::2014-10-29 11:32:15,235::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:17,405::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:17,408::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:17,411::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:18,278::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:18,281::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137784::DEBUG::2014-10-29 11:32:18,284::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:18,287::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:18,289::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137785::DEBUG::2014-10-29 11:32:18,292::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137785::DEBUG::2014-10-29 11:32:18,294::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:32:20,667::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55024 >Detector thread::DEBUG::2014-10-29 11:32:20,668::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55024 >Detector thread::DEBUG::2014-10-29 11:32:20,668::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55024 >Detector thread::DEBUG::2014-10-29 11:32:20,668::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55024) >Thread-137786::DEBUG::2014-10-29 11:32:20,708::task::595::Storage.TaskManager.Task::(_updateState) Task=`20da0414-ffdc-4b84-a153-a33b07c452d1`::moving from state init -> state preparing >Thread-137786::INFO::2014-10-29 11:32:20,708::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137786::INFO::2014-10-29 11:32:20,709::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0051512', 'lastCheck': '9.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00268474', 'lastCheck': '9.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425561', 'lastCheck': '9.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000453007', 'lastCheck': '9.9', 'valid': True}} >Thread-137786::DEBUG::2014-10-29 11:32:20,709::task::1191::Storage.TaskManager.Task::(prepare) Task=`20da0414-ffdc-4b84-a153-a33b07c452d1`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0051512', 'lastCheck': '9.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00268474', 'lastCheck': '9.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425561', 'lastCheck': '9.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000453007', 'lastCheck': '9.9', 'valid': True}} >Thread-137786::DEBUG::2014-10-29 11:32:20,710::task::595::Storage.TaskManager.Task::(_updateState) Task=`20da0414-ffdc-4b84-a153-a33b07c452d1`::moving from state preparing -> state finished >Thread-137786::DEBUG::2014-10-29 11:32:20,710::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137786::DEBUG::2014-10-29 11:32:20,710::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137786::DEBUG::2014-10-29 11:32:20,710::task::993::Storage.TaskManager.Task::(_decref) Task=`20da0414-ffdc-4b84-a153-a33b07c452d1`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:32:20,764::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:20,765::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:20,765::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:20,765::__init__::232::IOProcess::(_processLogs) (203097) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:20,766::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203097) Queuing response >Thread-10269::DEBUG::2014-10-29 11:32:20,768::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:32:20,793::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000541251 s, 927 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:32:20,797::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:20,797::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:20,799::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:20,799::__init__::232::IOProcess::(_processLogs) (203098) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:20,801::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203098) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:20,975::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:20,977::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:20,978::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:20,978::__init__::232::IOProcess::(_processLogs) (203099) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:20,979::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203099) Queuing response >Thread-179::DEBUG::2014-10-29 11:32:20,980::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:32:20,997::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000519039 s, 717 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:32:20,999::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:20,999::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:21,000::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:21,000::__init__::232::IOProcess::(_processLogs) (203100) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:21,001::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203100) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:21,058::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:21,058::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:21,058::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:21,058::__init__::232::IOProcess::(_processLogs) (203101) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:21,060::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203101) Queuing response >Thread-178::DEBUG::2014-10-29 11:32:21,062::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:32:21,063::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:21,080::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:21,080::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:21,081::__init__::232::IOProcess::(_processLogs) (203102) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:21,083::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203102) Queuing response >Thread-33::DEBUG::2014-10-29 11:32:21,086::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:32:21,086::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00261415 s, 194 kB/s\n'; <rc> = 0 >Thread-33::DEBUG::2014-10-29 11:32:21,106::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000444916 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:32:21,107::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:21,109::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:21,109::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:21,110::__init__::232::IOProcess::(_processLogs) (203103) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:21,111::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203103) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:21,113::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:21,113::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:21,114::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:21,114::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:21,117::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:21,118::__init__::232::IOProcess::(_processLogs) (203104) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:21,118::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:21,119::__init__::232::IOProcess::(_processLogs) (203105) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:21,119::__init__::232::IOProcess::(_processLogs) (203104) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:21,119::__init__::232::IOProcess::(_processLogs) (203105) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:21,120::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:21,120::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:21,120::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:21,120::__init__::232::IOProcess::(_processLogs) (203106) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:21,121::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203106) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:21,122::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:21,123::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:21,123::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:21,123::__init__::232::IOProcess::(_processLogs) (203107) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:21,123::__init__::232::IOProcess::(_processLogs) (203107) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:21,125::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:21,125::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:21,126::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:21,127::__init__::232::IOProcess::(_processLogs) (203108) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:21,127::__init__::232::IOProcess::(_processLogs) (203108) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:21,128::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:21,128::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:21,128::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:21,128::__init__::232::IOProcess::(_processLogs) (203109) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:21,129::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203109) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:21,130::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:21,131::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:21,132::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:21,132::__init__::232::IOProcess::(_processLogs) (203110) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:21,133::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203110) Queuing response >Detector thread::DEBUG::2014-10-29 11:32:21,198::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55025 >Detector thread::DEBUG::2014-10-29 11:32:21,198::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55025 >Detector thread::DEBUG::2014-10-29 11:32:21,199::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55025 >Detector thread::DEBUG::2014-10-29 11:32:21,199::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55025) >Thread-137787::DEBUG::2014-10-29 11:32:21,238::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137787::DEBUG::2014-10-29 11:32:21,239::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137787::DEBUG::2014-10-29 11:32:21,240::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.42', 'elapsedTime': '514973', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '29821903', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '58544', 'readRate': '0.00', 'truesize': '6010912768', 'writeRate': '37663.18'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.83', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:21,317::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:21,320::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137788::DEBUG::2014-10-29 11:32:21,323::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:21,325::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:21,327::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137789::DEBUG::2014-10-29 11:32:21,330::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137789::DEBUG::2014-10-29 11:32:21,332::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:32:21,552::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55027 >Detector thread::DEBUG::2014-10-29 11:32:21,553::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55027 >Detector thread::DEBUG::2014-10-29 11:32:21,553::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55027 >Detector thread::DEBUG::2014-10-29 11:32:21,554::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55027) >Thread-137790::DEBUG::2014-10-29 11:32:21,593::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137790::DEBUG::2014-10-29 11:32:21,595::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137790::DEBUG::2014-10-29 11:32:21,614::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137790::DEBUG::2014-10-29 11:32:21,661::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '175', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '75', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:22,418::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:22,420::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:22,421::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-22::DEBUG::2014-10-29 11:32:22,432::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:24,347::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:24,349::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137791::DEBUG::2014-10-29 11:32:24,352::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:24,354::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:24,356::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137792::DEBUG::2014-10-29 11:32:24,359::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137792::DEBUG::2014-10-29 11:32:24,361::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:32:25,605::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55029 >Detector thread::DEBUG::2014-10-29 11:32:25,606::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55029 >Detector thread::DEBUG::2014-10-29 11:32:25,607::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55029 >Detector thread::DEBUG::2014-10-29 11:32:25,607::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55029) >Thread-137793::DEBUG::2014-10-29 11:32:25,646::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137793::DEBUG::2014-10-29 11:32:25,647::task::595::Storage.TaskManager.Task::(_updateState) Task=`19edf350-7e6a-48c7-9e86-87339c6d91ec`::moving from state init -> state preparing >Thread-137793::INFO::2014-10-29 11:32:25,647::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137793::DEBUG::2014-10-29 11:32:25,654::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:32:25,655::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:25,655::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:25,656::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:25,656::__init__::232::IOProcess::(_processLogs) (203111) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:32:25,656::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203111) Queuing response >Thread-137793::DEBUG::2014-10-29 11:32:25,657::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137793::DEBUG::2014-10-29 11:32:25,658::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137793::INFO::2014-10-29 11:32:25,658::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137793::DEBUG::2014-10-29 11:32:25,658::task::1191::Storage.TaskManager.Task::(prepare) Task=`19edf350-7e6a-48c7-9e86-87339c6d91ec`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137793::DEBUG::2014-10-29 11:32:25,658::task::595::Storage.TaskManager.Task::(_updateState) Task=`19edf350-7e6a-48c7-9e86-87339c6d91ec`::moving from state preparing -> state finished >Thread-137793::DEBUG::2014-10-29 11:32:25,659::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137793::DEBUG::2014-10-29 11:32:25,659::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137793::DEBUG::2014-10-29 11:32:25,659::task::993::Storage.TaskManager.Task::(_decref) Task=`19edf350-7e6a-48c7-9e86-87339c6d91ec`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:32:25,702::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55030 >Detector thread::DEBUG::2014-10-29 11:32:25,703::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55030 >Detector thread::DEBUG::2014-10-29 11:32:25,703::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55030 >Detector thread::DEBUG::2014-10-29 11:32:25,703::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55030) >Thread-137794::DEBUG::2014-10-29 11:32:25,742::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137794::DEBUG::2014-10-29 11:32:25,742::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d621fee-33e5-42a8-b302-df7b21340277`::moving from state init -> state preparing >Thread-137794::INFO::2014-10-29 11:32:25,743::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137794::DEBUG::2014-10-29 11:32:25,743::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137794::DEBUG::2014-10-29 11:32:25,743::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137794::DEBUG::2014-10-29 11:32:25,744::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137794::DEBUG::2014-10-29 11:32:25,744::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137794::DEBUG::2014-10-29 11:32:25,744::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137794::DEBUG::2014-10-29 11:32:25,745::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137794::DEBUG::2014-10-29 11:32:25,837::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137794::DEBUG::2014-10-29 11:32:25,838::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137794::DEBUG::2014-10-29 11:32:26,029::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137794::DEBUG::2014-10-29 11:32:26,029::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137794::DEBUG::2014-10-29 11:32:26,030::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137794::DEBUG::2014-10-29 11:32:26,030::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137794::DEBUG::2014-10-29 11:32:26,031::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137794::DEBUG::2014-10-29 11:32:26,031::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137794::DEBUG::2014-10-29 11:32:26,031::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137794::DEBUG::2014-10-29 11:32:26,032::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:32:26,041::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:26,042::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:26,042::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:26,042::__init__::232::IOProcess::(_processLogs) (203112) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:32:26,043::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203112) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:26,044::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:26,044::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:26,044::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:26,045::__init__::232::IOProcess::(_processLogs) (203113) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:32:26,046::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203113) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:26,049::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:26,051::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:26,053::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:26,054::__init__::232::IOProcess::(_processLogs) (203114) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:32:26,058::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203114) Queuing response >Thread-137794::DEBUG::2014-10-29 11:32:26,060::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:32:26,061::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:26,063::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:26,064::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:26,064::__init__::232::IOProcess::(_processLogs) (203115) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:32:26,064::__init__::232::IOProcess::(_processLogs) (203115) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:26,064::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:26,065::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:26,065::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:26,065::__init__::232::IOProcess::(_processLogs) (203116) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:32:26,066::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203116) Queuing response >Thread-137794::DEBUG::2014-10-29 11:32:26,067::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:32:26,068::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:26,069::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:26,069::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:26,069::__init__::232::IOProcess::(_processLogs) (203117) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:32:26,070::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203117) Queuing response >Thread-137794::DEBUG::2014-10-29 11:32:26,070::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:32:26,072::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:26,073::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:26,074::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:26,074::__init__::232::IOProcess::(_processLogs) (203118) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:26,074::__init__::232::IOProcess::(_processLogs) (203118) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:26,075::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:26,075::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:26,075::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:26,076::__init__::232::IOProcess::(_processLogs) (203119) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:32:26,076::__init__::232::IOProcess::(_processLogs) (203119) Queuing response >Thread-137794::DEBUG::2014-10-29 11:32:26,077::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-137794::INFO::2014-10-29 11:32:26,077::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137794::INFO::2014-10-29 11:32:26,077::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137794::INFO::2014-10-29 11:32:26,077::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:32:26,078::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:26,079::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:26,079::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:26,079::__init__::232::IOProcess::(_processLogs) (203120) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:32:26,080::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203120) Queuing response >Thread-137794::DEBUG::2014-10-29 11:32:26,080::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137794::DEBUG::2014-10-29 11:32:26,082::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`38bc3ce2-699b-42e1-b26e-12f9770ccb4a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137794::DEBUG::2014-10-29 11:32:26,083::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137794::DEBUG::2014-10-29 11:32:26,083::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137794::DEBUG::2014-10-29 11:32:26,083::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`38bc3ce2-699b-42e1-b26e-12f9770ccb4a`::Granted request >Thread-137794::DEBUG::2014-10-29 11:32:26,084::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7d621fee-33e5-42a8-b302-df7b21340277`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137794::DEBUG::2014-10-29 11:32:26,084::task::993::Storage.TaskManager.Task::(_decref) Task=`7d621fee-33e5-42a8-b302-df7b21340277`::ref 1 aborting False >Thread-137794::INFO::2014-10-29 11:32:26,087::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137794::DEBUG::2014-10-29 11:32:26,087::task::1191::Storage.TaskManager.Task::(prepare) Task=`7d621fee-33e5-42a8-b302-df7b21340277`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137794::DEBUG::2014-10-29 11:32:26,088::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d621fee-33e5-42a8-b302-df7b21340277`::moving from state preparing -> state finished >Thread-137794::DEBUG::2014-10-29 11:32:26,088::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137794::DEBUG::2014-10-29 11:32:26,088::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137794::DEBUG::2014-10-29 11:32:26,089::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137794::DEBUG::2014-10-29 11:32:26,089::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137794::DEBUG::2014-10-29 11:32:26,089::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137794::DEBUG::2014-10-29 11:32:26,089::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137794::DEBUG::2014-10-29 11:32:26,090::task::993::Storage.TaskManager.Task::(_decref) Task=`7d621fee-33e5-42a8-b302-df7b21340277`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:32:26,112::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55031 >Detector thread::DEBUG::2014-10-29 11:32:26,113::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55031 >Detector thread::DEBUG::2014-10-29 11:32:26,113::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55031 >Detector thread::DEBUG::2014-10-29 11:32:26,113::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55031) >Thread-137799::DEBUG::2014-10-29 11:32:26,152::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137799::DEBUG::2014-10-29 11:32:26,152::task::595::Storage.TaskManager.Task::(_updateState) Task=`96afe009-2b93-49d1-ac5b-b56772dd67c8`::moving from state init -> state preparing >Thread-137799::INFO::2014-10-29 11:32:26,153::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137799::INFO::2014-10-29 11:32:26,154::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00261415', 'lastCheck': '5.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444916', 'lastCheck': '5.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519039', 'lastCheck': '5.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000541251', 'lastCheck': '5.4', 'valid': True}} >Thread-137799::DEBUG::2014-10-29 11:32:26,154::task::1191::Storage.TaskManager.Task::(prepare) Task=`96afe009-2b93-49d1-ac5b-b56772dd67c8`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00261415', 'lastCheck': '5.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444916', 'lastCheck': '5.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519039', 'lastCheck': '5.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000541251', 'lastCheck': '5.4', 'valid': True}} >Thread-137799::DEBUG::2014-10-29 11:32:26,154::task::595::Storage.TaskManager.Task::(_updateState) Task=`96afe009-2b93-49d1-ac5b-b56772dd67c8`::moving from state preparing -> state finished >Thread-137799::DEBUG::2014-10-29 11:32:26,154::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137799::DEBUG::2014-10-29 11:32:26,155::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137799::DEBUG::2014-10-29 11:32:26,155::task::993::Storage.TaskManager.Task::(_decref) Task=`96afe009-2b93-49d1-ac5b-b56772dd67c8`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:27,378::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:27,380::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137800::DEBUG::2014-10-29 11:32:27,383::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:27,385::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:27,387::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137801::DEBUG::2014-10-29 11:32:27,390::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137801::DEBUG::2014-10-29 11:32:27,393::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:27,429::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:27,430::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:27,433::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:32:30,391::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55032 >Detector thread::DEBUG::2014-10-29 11:32:30,392::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55032 >Detector thread::DEBUG::2014-10-29 11:32:30,392::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55032 >Detector thread::DEBUG::2014-10-29 11:32:30,393::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55032) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:30,407::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:30,409::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137803::DEBUG::2014-10-29 11:32:30,412::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc378808-bfc8-4bab-ac10-15d0cb81c60c`::moving from state init -> state preparing >Thread-137803::INFO::2014-10-29 11:32:30,413::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137803::INFO::2014-10-29 11:32:30,413::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00261415', 'lastCheck': '9.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444916', 'lastCheck': '9.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519039', 'lastCheck': '9.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000541251', 'lastCheck': '9.6', 'valid': True}} >Thread-137803::DEBUG::2014-10-29 11:32:30,414::task::1191::Storage.TaskManager.Task::(prepare) Task=`cc378808-bfc8-4bab-ac10-15d0cb81c60c`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00261415', 'lastCheck': '9.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444916', 'lastCheck': '9.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519039', 'lastCheck': '9.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000541251', 'lastCheck': '9.6', 'valid': True}} >Thread-137803::DEBUG::2014-10-29 11:32:30,414::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc378808-bfc8-4bab-ac10-15d0cb81c60c`::moving from state preparing -> state finished >Thread-137803::DEBUG::2014-10-29 11:32:30,414::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137803::DEBUG::2014-10-29 11:32:30,415::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137803::DEBUG::2014-10-29 11:32:30,415::task::993::Storage.TaskManager.Task::(_decref) Task=`cc378808-bfc8-4bab-ac10-15d0cb81c60c`::ref 0 aborting False >Thread-137802::DEBUG::2014-10-29 11:32:30,431::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137802::DEBUG::2014-10-29 11:32:30,432::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137802::DEBUG::2014-10-29 11:32:30,433::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '6.09', 'elapsedTime': '514982', 'displayType': 'vnc', 'cpuSys': '0.87', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '29821903', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '58544', 'readRate': '0.00', 'truesize': '6010912768', 'writeRate': '37663.18'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '2.00', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-137803::DEBUG::2014-10-29 11:32:30,462::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:30,485::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:30,487::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137804::DEBUG::2014-10-29 11:32:30,490::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137804::DEBUG::2014-10-29 11:32:30,492::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:32:30,776::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55034 >Detector thread::DEBUG::2014-10-29 11:32:30,776::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55034 >Detector thread::DEBUG::2014-10-29 11:32:30,777::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55034 >Detector thread::DEBUG::2014-10-29 11:32:30,777::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55034) >Thread-17::DEBUG::2014-10-29 11:32:30,804::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:30,804::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:30,805::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:30,805::__init__::232::IOProcess::(_processLogs) (203121) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:30,806::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203121) Queuing response >Thread-10269::DEBUG::2014-10-29 11:32:30,808::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-137805::DEBUG::2014-10-29 11:32:30,829::task::595::Storage.TaskManager.Task::(_updateState) Task=`89c19c45-7a2a-4d73-9a13-4b99ba6bbaf5`::moving from state init -> state preparing >Thread-10269::DEBUG::2014-10-29 11:32:30,829::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000592889 s, 847 kB/s\n'; <rc> = 0 >Thread-137805::INFO::2014-10-29 11:32:30,832::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-17::DEBUG::2014-10-29 11:32:30,834::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:30,836::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137805::INFO::2014-10-29 11:32:30,836::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00261415', 'lastCheck': '9.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444916', 'lastCheck': '9.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519039', 'lastCheck': '9.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000541251', 'lastCheck': '10.0', 'valid': True}} >Thread-17::DEBUG::2014-10-29 11:32:30,837::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-137805::DEBUG::2014-10-29 11:32:30,838::task::1191::Storage.TaskManager.Task::(prepare) Task=`89c19c45-7a2a-4d73-9a13-4b99ba6bbaf5`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00261415', 'lastCheck': '9.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000444916', 'lastCheck': '9.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000519039', 'lastCheck': '9.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000541251', 'lastCheck': '10.0', 'valid': True}} >Thread-17::DEBUG::2014-10-29 11:32:30,838::__init__::232::IOProcess::(_processLogs) (203122) Got request for method 'statvfs' >Thread-137805::DEBUG::2014-10-29 11:32:30,839::task::595::Storage.TaskManager.Task::(_updateState) Task=`89c19c45-7a2a-4d73-9a13-4b99ba6bbaf5`::moving from state preparing -> state finished >Thread-137805::DEBUG::2014-10-29 11:32:30,841::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137805::DEBUG::2014-10-29 11:32:30,842::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137805::DEBUG::2014-10-29 11:32:30,843::task::993::Storage.TaskManager.Task::(_decref) Task=`89c19c45-7a2a-4d73-9a13-4b99ba6bbaf5`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:32:30,845::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203122) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:31,006::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:31,007::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:31,007::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:31,009::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203123) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:31,011::__init__::232::IOProcess::(_processLogs) (203123) Queuing response >Thread-179::DEBUG::2014-10-29 11:32:31,011::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:32:31,032::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00050934 s, 730 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:32:31,034::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:31,034::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:31,034::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:31,035::__init__::232::IOProcess::(_processLogs) (203124) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:31,037::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203124) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:31,132::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:31,133::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:31,133::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:31,133::__init__::232::IOProcess::(_processLogs) (203125) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:31,136::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203125) Queuing response >Thread-178::DEBUG::2014-10-29 11:32:31,137::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:32:31,156::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000605021 s, 840 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:32:31,159::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-33::DEBUG::2014-10-29 11:32:31,162::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:32:31,162::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:31,179::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:31,182::__init__::232::IOProcess::(_processLogs) (203126) Got request for method 'statvfs' >Thread-33::DEBUG::2014-10-29 11:32:31,182::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000483338 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:32:31,184::__init__::232::IOProcess::(_processLogs) (203126) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:31,186::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:31,186::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:31,186::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:31,186::__init__::232::IOProcess::(_processLogs) (203127) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:31,188::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203127) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:31,190::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:31,190::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:31,190::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:31,190::__init__::232::IOProcess::(_processLogs) (203128) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:31,191::__init__::232::IOProcess::(_processLogs) (203128) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:31,194::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:31,195::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:31,195::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:31,196::__init__::232::IOProcess::(_processLogs) (203129) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:31,196::__init__::232::IOProcess::(_processLogs) (203129) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:31,196::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:31,197::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:31,198::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:31,198::__init__::232::IOProcess::(_processLogs) (203130) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:31,198::__init__::232::IOProcess::(_processLogs) (203130) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:31,199::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:31,199::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:31,200::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:31,200::__init__::232::IOProcess::(_processLogs) (203131) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:31,201::__init__::232::IOProcess::(_processLogs) (203131) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:31,201::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:31,202::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:31,203::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:31,203::__init__::232::IOProcess::(_processLogs) (203132) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:31,203::__init__::232::IOProcess::(_processLogs) (203132) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:31,204::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:31,204::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:31,205::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:31,206::__init__::232::IOProcess::(_processLogs) (203133) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:31,207::__init__::232::IOProcess::(_processLogs) (203133) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:31,207::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:31,208::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:31,209::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:31,210::__init__::232::IOProcess::(_processLogs) (203134) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:31,210::__init__::232::IOProcess::(_processLogs) (203134) Queuing response >Detector thread::DEBUG::2014-10-29 11:32:31,712::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55035 >Detector thread::DEBUG::2014-10-29 11:32:31,712::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55035 >Detector thread::DEBUG::2014-10-29 11:32:31,713::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55035 >Detector thread::DEBUG::2014-10-29 11:32:31,713::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55035) >Thread-137806::DEBUG::2014-10-29 11:32:31,752::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137806::DEBUG::2014-10-29 11:32:31,754::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137806::DEBUG::2014-10-29 11:32:31,772::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137806::DEBUG::2014-10-29 11:32:31,818::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '159', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '59', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:32,440::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:32,442::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:32,443::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:33,543::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:33,545::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137807::DEBUG::2014-10-29 11:32:33,548::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:33,551::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:33,553::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137808::DEBUG::2014-10-29 11:32:33,555::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137808::DEBUG::2014-10-29 11:32:33,558::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:32:35,119::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:36,578::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:36,582::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137809::DEBUG::2014-10-29 11:32:36,586::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:36,589::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:36,591::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137810::DEBUG::2014-10-29 11:32:36,595::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137810::DEBUG::2014-10-29 11:32:36,597::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:32:36,753::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55037 >Detector thread::DEBUG::2014-10-29 11:32:36,753::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55037 >Detector thread::DEBUG::2014-10-29 11:32:36,754::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55037 >Detector thread::DEBUG::2014-10-29 11:32:36,754::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55037) >Thread-137811::DEBUG::2014-10-29 11:32:36,794::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137811::DEBUG::2014-10-29 11:32:36,794::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f974a83-06f3-4696-bc3c-5ee02134948e`::moving from state init -> state preparing >Thread-137811::INFO::2014-10-29 11:32:36,795::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137811::DEBUG::2014-10-29 11:32:36,798::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:32:36,799::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:36,799::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:36,799::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:36,800::__init__::232::IOProcess::(_processLogs) (203135) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:32:36,801::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203135) Queuing response >Thread-137811::DEBUG::2014-10-29 11:32:36,802::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137811::DEBUG::2014-10-29 11:32:36,802::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137811::INFO::2014-10-29 11:32:36,803::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137811::DEBUG::2014-10-29 11:32:36,803::task::1191::Storage.TaskManager.Task::(prepare) Task=`1f974a83-06f3-4696-bc3c-5ee02134948e`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137811::DEBUG::2014-10-29 11:32:36,803::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f974a83-06f3-4696-bc3c-5ee02134948e`::moving from state preparing -> state finished >Thread-137811::DEBUG::2014-10-29 11:32:36,803::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137811::DEBUG::2014-10-29 11:32:36,804::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137811::DEBUG::2014-10-29 11:32:36,804::task::993::Storage.TaskManager.Task::(_decref) Task=`1f974a83-06f3-4696-bc3c-5ee02134948e`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:32:36,848::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55038 >Detector thread::DEBUG::2014-10-29 11:32:36,849::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55038 >Detector thread::DEBUG::2014-10-29 11:32:36,849::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55038 >Detector thread::DEBUG::2014-10-29 11:32:36,850::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55038) >Thread-137812::DEBUG::2014-10-29 11:32:36,889::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137812::DEBUG::2014-10-29 11:32:36,889::task::595::Storage.TaskManager.Task::(_updateState) Task=`dac7e27c-0431-47fa-a689-fdf25581572f`::moving from state init -> state preparing >Thread-137812::INFO::2014-10-29 11:32:36,890::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137812::DEBUG::2014-10-29 11:32:36,890::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137812::DEBUG::2014-10-29 11:32:36,890::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137812::DEBUG::2014-10-29 11:32:36,891::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137812::DEBUG::2014-10-29 11:32:36,891::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137812::DEBUG::2014-10-29 11:32:36,891::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137812::DEBUG::2014-10-29 11:32:36,892::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137812::DEBUG::2014-10-29 11:32:36,983::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137812::DEBUG::2014-10-29 11:32:36,985::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137812::DEBUG::2014-10-29 11:32:37,159::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137812::DEBUG::2014-10-29 11:32:37,160::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137812::DEBUG::2014-10-29 11:32:37,161::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137812::DEBUG::2014-10-29 11:32:37,161::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137812::DEBUG::2014-10-29 11:32:37,161::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137812::DEBUG::2014-10-29 11:32:37,162::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137812::DEBUG::2014-10-29 11:32:37,162::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137812::DEBUG::2014-10-29 11:32:37,162::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:32:37,173::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:37,173::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:37,174::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:37,174::__init__::232::IOProcess::(_processLogs) (203136) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:32:37,174::__init__::232::IOProcess::(_processLogs) (203136) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:37,175::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:37,177::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:37,177::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:37,177::__init__::232::IOProcess::(_processLogs) (203137) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:32:37,179::__init__::232::IOProcess::(_processLogs) (203137) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:37,181::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:37,183::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:37,185::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:37,187::__init__::232::IOProcess::(_processLogs) (203138) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:32:37,191::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203138) Queuing response >Thread-137812::DEBUG::2014-10-29 11:32:37,192::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:32:37,195::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:37,195::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:37,196::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:37,196::__init__::232::IOProcess::(_processLogs) (203139) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:32:37,197::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203139) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:37,198::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:37,198::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:37,198::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:37,198::__init__::232::IOProcess::(_processLogs) (203140) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:32:37,204::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203140) Queuing response >Thread-137812::DEBUG::2014-10-29 11:32:37,205::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:32:37,206::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:37,206::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:37,207::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:37,207::__init__::232::IOProcess::(_processLogs) (203141) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:32:37,208::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203141) Queuing response >Thread-137812::DEBUG::2014-10-29 11:32:37,208::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:32:37,210::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:37,210::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:37,211::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:37,212::__init__::232::IOProcess::(_processLogs) (203142) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:37,212::__init__::232::IOProcess::(_processLogs) (203142) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:37,213::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:37,213::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:37,214::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-137812::DEBUG::2014-10-29 11:32:37,214::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:32:37,215::__init__::232::IOProcess::(_processLogs) (203143) Got request for method 'glob' >Thread-137812::INFO::2014-10-29 11:32:37,215::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137812::INFO::2014-10-29 11:32:37,216::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:32:37,217::__init__::232::IOProcess::(_processLogs) (203143) Queuing response >Thread-137812::INFO::2014-10-29 11:32:37,218::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:32:37,219::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:37,219::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:37,219::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:37,220::__init__::232::IOProcess::(_processLogs) (203144) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:32:37,220::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203144) Queuing response >Thread-137812::DEBUG::2014-10-29 11:32:37,221::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137812::DEBUG::2014-10-29 11:32:37,223::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`05970bfc-5f3f-49c3-a2d9-f9ca269917bf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137812::DEBUG::2014-10-29 11:32:37,223::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137812::DEBUG::2014-10-29 11:32:37,224::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137812::DEBUG::2014-10-29 11:32:37,224::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`05970bfc-5f3f-49c3-a2d9-f9ca269917bf`::Granted request >Thread-137812::DEBUG::2014-10-29 11:32:37,225::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`dac7e27c-0431-47fa-a689-fdf25581572f`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137812::DEBUG::2014-10-29 11:32:37,225::task::993::Storage.TaskManager.Task::(_decref) Task=`dac7e27c-0431-47fa-a689-fdf25581572f`::ref 1 aborting False >Thread-137812::INFO::2014-10-29 11:32:37,228::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137812::DEBUG::2014-10-29 11:32:37,228::task::1191::Storage.TaskManager.Task::(prepare) Task=`dac7e27c-0431-47fa-a689-fdf25581572f`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137812::DEBUG::2014-10-29 11:32:37,228::task::595::Storage.TaskManager.Task::(_updateState) Task=`dac7e27c-0431-47fa-a689-fdf25581572f`::moving from state preparing -> state finished >Thread-137812::DEBUG::2014-10-29 11:32:37,228::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137812::DEBUG::2014-10-29 11:32:37,229::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137812::DEBUG::2014-10-29 11:32:37,229::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137812::DEBUG::2014-10-29 11:32:37,229::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137812::DEBUG::2014-10-29 11:32:37,230::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137812::DEBUG::2014-10-29 11:32:37,230::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137812::DEBUG::2014-10-29 11:32:37,230::task::993::Storage.TaskManager.Task::(_decref) Task=`dac7e27c-0431-47fa-a689-fdf25581572f`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:32:37,252::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55039 >Detector thread::DEBUG::2014-10-29 11:32:37,253::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55039 >Detector thread::DEBUG::2014-10-29 11:32:37,253::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55039 >Detector thread::DEBUG::2014-10-29 11:32:37,254::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55039) >Thread-137817::DEBUG::2014-10-29 11:32:37,292::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137817::DEBUG::2014-10-29 11:32:37,293::task::595::Storage.TaskManager.Task::(_updateState) Task=`559f86e4-703d-417f-abba-a370093ce84a`::moving from state init -> state preparing >Thread-137817::INFO::2014-10-29 11:32:37,293::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137817::INFO::2014-10-29 11:32:37,294::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000605021', 'lastCheck': '6.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000483338', 'lastCheck': '6.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050934', 'lastCheck': '6.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000592889', 'lastCheck': '6.4', 'valid': True}} >Thread-137817::DEBUG::2014-10-29 11:32:37,294::task::1191::Storage.TaskManager.Task::(prepare) Task=`559f86e4-703d-417f-abba-a370093ce84a`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000605021', 'lastCheck': '6.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000483338', 'lastCheck': '6.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050934', 'lastCheck': '6.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000592889', 'lastCheck': '6.4', 'valid': True}} >Thread-137817::DEBUG::2014-10-29 11:32:37,294::task::595::Storage.TaskManager.Task::(_updateState) Task=`559f86e4-703d-417f-abba-a370093ce84a`::moving from state preparing -> state finished >Thread-137817::DEBUG::2014-10-29 11:32:37,294::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137817::DEBUG::2014-10-29 11:32:37,295::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137817::DEBUG::2014-10-29 11:32:37,295::task::993::Storage.TaskManager.Task::(_decref) Task=`559f86e4-703d-417f-abba-a370093ce84a`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:37,450::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:37,453::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:37,455::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-22::DEBUG::2014-10-29 11:32:37,459::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:39,624::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:39,626::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137818::DEBUG::2014-10-29 11:32:39,629::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:39,632::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:39,634::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137819::DEBUG::2014-10-29 11:32:39,637::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137819::DEBUG::2014-10-29 11:32:39,639::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:32:40,588::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55040 >Detector thread::DEBUG::2014-10-29 11:32:40,588::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55040 >Detector thread::DEBUG::2014-10-29 11:32:40,588::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55040 >Detector thread::DEBUG::2014-10-29 11:32:40,589::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55040) >Thread-137820::DEBUG::2014-10-29 11:32:40,628::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137820::DEBUG::2014-10-29 11:32:40,629::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137820::DEBUG::2014-10-29 11:32:40,630::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.30', 'elapsedTime': '514993', 'displayType': 'vnc', 'cpuSys': '1.26', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '29821903', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '58544', 'readRate': '0.00', 'truesize': '6010912768', 'writeRate': '37663.18'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.17', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-17::DEBUG::2014-10-29 11:32:40,848::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:40,849::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:40,849::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:40,849::__init__::232::IOProcess::(_processLogs) (203145) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:40,851::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203145) Queuing response >Thread-10269::DEBUG::2014-10-29 11:32:40,852::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:32:40,871::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000436467 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:32:40,872::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:40,873::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:40,873::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:40,873::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203146) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:40,874::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203146) Queuing response >Detector thread::DEBUG::2014-10-29 11:32:40,900::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55042 >Detector thread::DEBUG::2014-10-29 11:32:40,901::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55042 >Detector thread::DEBUG::2014-10-29 11:32:40,901::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55042 >Detector thread::DEBUG::2014-10-29 11:32:40,902::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55042) >Thread-137821::DEBUG::2014-10-29 11:32:40,941::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b600893-f84b-4ea0-a2e0-87155ef784c9`::moving from state init -> state preparing >Thread-137821::INFO::2014-10-29 11:32:40,942::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137821::INFO::2014-10-29 11:32:40,942::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000605021', 'lastCheck': '9.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000483338', 'lastCheck': '9.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050934', 'lastCheck': '9.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000436467', 'lastCheck': '0.1', 'valid': True}} >Thread-137821::DEBUG::2014-10-29 11:32:40,943::task::1191::Storage.TaskManager.Task::(prepare) Task=`2b600893-f84b-4ea0-a2e0-87155ef784c9`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000605021', 'lastCheck': '9.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000483338', 'lastCheck': '9.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050934', 'lastCheck': '9.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000436467', 'lastCheck': '0.1', 'valid': True}} >Thread-137821::DEBUG::2014-10-29 11:32:40,943::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b600893-f84b-4ea0-a2e0-87155ef784c9`::moving from state preparing -> state finished >Thread-137821::DEBUG::2014-10-29 11:32:40,943::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137821::DEBUG::2014-10-29 11:32:40,943::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137821::DEBUG::2014-10-29 11:32:40,944::task::993::Storage.TaskManager.Task::(_decref) Task=`2b600893-f84b-4ea0-a2e0-87155ef784c9`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:32:41,047::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:41,048::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:41,048::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:41,048::__init__::232::IOProcess::(_processLogs) (203147) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:41,050::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203147) Queuing response >Thread-179::DEBUG::2014-10-29 11:32:41,052::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:32:41,071::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000473443 s, 786 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:32:41,072::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:41,075::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:41,076::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:41,076::__init__::232::IOProcess::(_processLogs) (203148) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:41,076::__init__::232::IOProcess::(_processLogs) (203148) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:41,208::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:41,210::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-178::DEBUG::2014-10-29 11:32:41,212::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:32:41,213::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:41,230::__init__::232::IOProcess::(_processLogs) (203149) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:41,230::__init__::232::IOProcess::(_processLogs) (203149) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:41,232::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:41,232::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-178::DEBUG::2014-10-29 11:32:41,234::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00182627 s, 278 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:32:41,237::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:41,239::__init__::232::IOProcess::(_processLogs) (203150) Got request for method 'statvfs' >Thread-33::DEBUG::2014-10-29 11:32:41,239::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:32:41,241::__init__::232::IOProcess::(_processLogs) (203150) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:41,261::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:41,261::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:41,262::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:41,263::__init__::232::IOProcess::(_processLogs) (203151) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:41,263::__init__::232::IOProcess::(_processLogs) (203151) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:41,264::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:41,265::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:41,265::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:41,266::__init__::232::IOProcess::(_processLogs) (203152) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:41,266::__init__::232::IOProcess::(_processLogs) (203152) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:41,267::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:41,267::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:41,269::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:41,271::__init__::232::IOProcess::(_processLogs) (203153) Got request for method 'access' >Thread-33::DEBUG::2014-10-29 11:32:41,272::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000472672 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:32:41,273::__init__::232::IOProcess::(_processLogs) (203153) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:41,276::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:41,276::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:41,277::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:41,277::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:41,280::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:41,282::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:41,282::__init__::232::IOProcess::(_processLogs) (203154) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:41,282::__init__::232::IOProcess::(_processLogs) (203155) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:41,282::__init__::232::IOProcess::(_processLogs) (203154) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:41,283::__init__::232::IOProcess::(_processLogs) (203155) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:41,283::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:41,284::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:41,285::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:41,285::__init__::232::IOProcess::(_processLogs) (203156) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:41,286::__init__::232::IOProcess::(_processLogs) (203156) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:41,286::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:41,287::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:41,288::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:41,288::__init__::232::IOProcess::(_processLogs) (203157) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:41,288::__init__::232::IOProcess::(_processLogs) (203157) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:41,289::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:41,289::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:41,290::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:41,290::__init__::232::IOProcess::(_processLogs) (203158) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:41,292::__init__::232::IOProcess::(_processLogs) (203158) Queuing response >Detector thread::DEBUG::2014-10-29 11:32:41,866::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55043 >Detector thread::DEBUG::2014-10-29 11:32:41,866::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55043 >Detector thread::DEBUG::2014-10-29 11:32:41,867::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55043 >Detector thread::DEBUG::2014-10-29 11:32:41,867::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55043) >Thread-137822::DEBUG::2014-10-29 11:32:41,906::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137822::DEBUG::2014-10-29 11:32:41,909::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137822::DEBUG::2014-10-29 11:32:41,929::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137822::DEBUG::2014-10-29 11:32:41,977::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '143', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '43', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:42,459::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:42,462::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:42,463::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:42,653::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:42,656::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137823::DEBUG::2014-10-29 11:32:42,659::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:42,661::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:42,663::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137824::DEBUG::2014-10-29 11:32:42,667::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137824::DEBUG::2014-10-29 11:32:42,669::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:45,684::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:45,686::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137825::DEBUG::2014-10-29 11:32:45,689::task::595::Storage.TaskManager.Task::(_updateState) Task=`966bd751-fde6-4f62-8dfc-30f7c4b4b3c8`::moving from state init -> state preparing >Thread-137825::INFO::2014-10-29 11:32:45,690::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137825::INFO::2014-10-29 11:32:45,691::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00182627', 'lastCheck': '4.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000472672', 'lastCheck': '4.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473443', 'lastCheck': '4.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000436467', 'lastCheck': '4.8', 'valid': True}} >Thread-137825::DEBUG::2014-10-29 11:32:45,691::task::1191::Storage.TaskManager.Task::(prepare) Task=`966bd751-fde6-4f62-8dfc-30f7c4b4b3c8`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00182627', 'lastCheck': '4.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000472672', 'lastCheck': '4.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473443', 'lastCheck': '4.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000436467', 'lastCheck': '4.8', 'valid': True}} >Thread-137825::DEBUG::2014-10-29 11:32:45,691::task::595::Storage.TaskManager.Task::(_updateState) Task=`966bd751-fde6-4f62-8dfc-30f7c4b4b3c8`::moving from state preparing -> state finished >Thread-137825::DEBUG::2014-10-29 11:32:45,692::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137825::DEBUG::2014-10-29 11:32:45,692::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137825::DEBUG::2014-10-29 11:32:45,692::task::993::Storage.TaskManager.Task::(_decref) Task=`966bd751-fde6-4f62-8dfc-30f7c4b4b3c8`::ref 0 aborting False >Thread-137825::DEBUG::2014-10-29 11:32:45,713::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:45,736::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:45,739::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137826::DEBUG::2014-10-29 11:32:45,743::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137826::DEBUG::2014-10-29 11:32:45,745::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:47,471::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:47,474::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:47,476::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:32:47,867::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55045 >Detector thread::DEBUG::2014-10-29 11:32:47,867::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55045 >Detector thread::DEBUG::2014-10-29 11:32:47,868::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55045 >Detector thread::DEBUG::2014-10-29 11:32:47,868::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55045) >Thread-137827::DEBUG::2014-10-29 11:32:47,908::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137827::DEBUG::2014-10-29 11:32:47,909::task::595::Storage.TaskManager.Task::(_updateState) Task=`50c07143-eb52-4979-a55d-f19691a5aabb`::moving from state init -> state preparing >Thread-137827::INFO::2014-10-29 11:32:47,909::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137827::DEBUG::2014-10-29 11:32:47,927::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:32:47,928::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:47,929::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:47,929::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:47,929::__init__::232::IOProcess::(_processLogs) (203159) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:32:47,930::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203159) Queuing response >Thread-137827::DEBUG::2014-10-29 11:32:47,931::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137827::DEBUG::2014-10-29 11:32:47,931::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137827::INFO::2014-10-29 11:32:47,932::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137827::DEBUG::2014-10-29 11:32:47,932::task::1191::Storage.TaskManager.Task::(prepare) Task=`50c07143-eb52-4979-a55d-f19691a5aabb`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137827::DEBUG::2014-10-29 11:32:47,932::task::595::Storage.TaskManager.Task::(_updateState) Task=`50c07143-eb52-4979-a55d-f19691a5aabb`::moving from state preparing -> state finished >Thread-137827::DEBUG::2014-10-29 11:32:47,932::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137827::DEBUG::2014-10-29 11:32:47,933::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137827::DEBUG::2014-10-29 11:32:47,933::task::993::Storage.TaskManager.Task::(_decref) Task=`50c07143-eb52-4979-a55d-f19691a5aabb`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:32:47,976::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55046 >Detector thread::DEBUG::2014-10-29 11:32:47,977::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55046 >Detector thread::DEBUG::2014-10-29 11:32:47,977::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55046 >Detector thread::DEBUG::2014-10-29 11:32:47,978::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55046) >Thread-137828::DEBUG::2014-10-29 11:32:48,017::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137828::DEBUG::2014-10-29 11:32:48,017::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1817a6f-e221-4f83-bce5-87231609547c`::moving from state init -> state preparing >Thread-137828::INFO::2014-10-29 11:32:48,018::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137828::DEBUG::2014-10-29 11:32:48,018::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137828::DEBUG::2014-10-29 11:32:48,018::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137828::DEBUG::2014-10-29 11:32:48,019::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137828::DEBUG::2014-10-29 11:32:48,019::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137828::DEBUG::2014-10-29 11:32:48,019::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137828::DEBUG::2014-10-29 11:32:48,020::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137828::DEBUG::2014-10-29 11:32:48,107::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137828::DEBUG::2014-10-29 11:32:48,108::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137828::DEBUG::2014-10-29 11:32:48,288::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137828::DEBUG::2014-10-29 11:32:48,289::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137828::DEBUG::2014-10-29 11:32:48,290::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137828::DEBUG::2014-10-29 11:32:48,290::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137828::DEBUG::2014-10-29 11:32:48,290::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137828::DEBUG::2014-10-29 11:32:48,291::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137828::DEBUG::2014-10-29 11:32:48,291::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137828::DEBUG::2014-10-29 11:32:48,291::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:32:48,300::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:48,301::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:48,302::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:48,302::__init__::232::IOProcess::(_processLogs) (203160) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:32:48,303::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203160) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:48,303::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:48,304::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:48,304::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:48,304::__init__::232::IOProcess::(_processLogs) (203161) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:32:48,304::__init__::232::IOProcess::(_processLogs) (203161) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:48,310::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:48,312::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:48,314::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:48,316::__init__::232::IOProcess::(_processLogs) (203162) Got request for method 'glob' >Thread-137828::DEBUG::2014-10-29 11:32:48,319::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:32:48,319::__init__::232::IOProcess::(_processLogs) (203162) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:48,321::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:48,321::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:48,321::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:48,322::__init__::232::IOProcess::(_processLogs) (203163) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:32:48,323::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203163) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:48,324::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:48,324::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:48,324::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:48,325::__init__::232::IOProcess::(_processLogs) (203164) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:32:48,325::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203164) Queuing response >Thread-137828::DEBUG::2014-10-29 11:32:48,326::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:32:48,327::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:48,327::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:48,327::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:48,328::__init__::232::IOProcess::(_processLogs) (203165) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:32:48,328::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203165) Queuing response >Thread-137828::DEBUG::2014-10-29 11:32:48,329::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:32:48,331::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:48,331::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:48,332::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:48,333::__init__::232::IOProcess::(_processLogs) (203166) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:48,333::__init__::232::IOProcess::(_processLogs) (203166) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:48,333::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:48,334::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137828::DEBUG::2014-10-29 11:32:48,334::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:32:48,334::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-137828::INFO::2014-10-29 11:32:48,336::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:32:48,336::__init__::232::IOProcess::(_processLogs) (203167) Got request for method 'glob' >Thread-137828::INFO::2014-10-29 11:32:48,337::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:32:48,338::__init__::232::IOProcess::(_processLogs) (203167) Queuing response >Thread-137828::INFO::2014-10-29 11:32:48,338::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:32:48,340::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:48,340::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:48,340::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:48,341::__init__::232::IOProcess::(_processLogs) (203168) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:32:48,341::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203168) Queuing response >Thread-137828::DEBUG::2014-10-29 11:32:48,342::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137828::DEBUG::2014-10-29 11:32:48,344::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`fd59c4fa-5df7-47b1-8f88-63b630176cc4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137828::DEBUG::2014-10-29 11:32:48,344::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137828::DEBUG::2014-10-29 11:32:48,346::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137828::DEBUG::2014-10-29 11:32:48,347::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`fd59c4fa-5df7-47b1-8f88-63b630176cc4`::Granted request >Thread-137828::DEBUG::2014-10-29 11:32:48,347::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e1817a6f-e221-4f83-bce5-87231609547c`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137828::DEBUG::2014-10-29 11:32:48,348::task::993::Storage.TaskManager.Task::(_decref) Task=`e1817a6f-e221-4f83-bce5-87231609547c`::ref 1 aborting False >Thread-137828::INFO::2014-10-29 11:32:48,350::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137828::DEBUG::2014-10-29 11:32:48,351::task::1191::Storage.TaskManager.Task::(prepare) Task=`e1817a6f-e221-4f83-bce5-87231609547c`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137828::DEBUG::2014-10-29 11:32:48,351::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1817a6f-e221-4f83-bce5-87231609547c`::moving from state preparing -> state finished >Thread-137828::DEBUG::2014-10-29 11:32:48,351::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137828::DEBUG::2014-10-29 11:32:48,352::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137828::DEBUG::2014-10-29 11:32:48,352::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137828::DEBUG::2014-10-29 11:32:48,352::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137828::DEBUG::2014-10-29 11:32:48,353::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137828::DEBUG::2014-10-29 11:32:48,353::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137828::DEBUG::2014-10-29 11:32:48,353::task::993::Storage.TaskManager.Task::(_decref) Task=`e1817a6f-e221-4f83-bce5-87231609547c`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:32:48,376::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55047 >Detector thread::DEBUG::2014-10-29 11:32:48,376::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55047 >Detector thread::DEBUG::2014-10-29 11:32:48,377::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55047 >Detector thread::DEBUG::2014-10-29 11:32:48,377::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55047) >Thread-137833::DEBUG::2014-10-29 11:32:48,416::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137833::DEBUG::2014-10-29 11:32:48,416::task::595::Storage.TaskManager.Task::(_updateState) Task=`0500e209-c10c-4a79-ae25-2bc0cb705a31`::moving from state init -> state preparing >Thread-137833::INFO::2014-10-29 11:32:48,417::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137833::INFO::2014-10-29 11:32:48,417::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00182627', 'lastCheck': '7.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000472672', 'lastCheck': '7.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473443', 'lastCheck': '7.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000436467', 'lastCheck': '7.5', 'valid': True}} >Thread-137833::DEBUG::2014-10-29 11:32:48,418::task::1191::Storage.TaskManager.Task::(prepare) Task=`0500e209-c10c-4a79-ae25-2bc0cb705a31`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00182627', 'lastCheck': '7.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000472672', 'lastCheck': '7.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473443', 'lastCheck': '7.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000436467', 'lastCheck': '7.5', 'valid': True}} >Thread-137833::DEBUG::2014-10-29 11:32:48,418::task::595::Storage.TaskManager.Task::(_updateState) Task=`0500e209-c10c-4a79-ae25-2bc0cb705a31`::moving from state preparing -> state finished >Thread-137833::DEBUG::2014-10-29 11:32:48,418::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137833::DEBUG::2014-10-29 11:32:48,418::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137833::DEBUG::2014-10-29 11:32:48,419::task::993::Storage.TaskManager.Task::(_decref) Task=`0500e209-c10c-4a79-ae25-2bc0cb705a31`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:48,797::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:48,799::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137834::DEBUG::2014-10-29 11:32:48,802::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:48,805::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:48,806::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137835::DEBUG::2014-10-29 11:32:48,810::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137835::DEBUG::2014-10-29 11:32:48,812::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:32:50,782::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55048 >Detector thread::DEBUG::2014-10-29 11:32:50,782::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55048 >Detector thread::DEBUG::2014-10-29 11:32:50,783::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55048 >Detector thread::DEBUG::2014-10-29 11:32:50,783::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55048) >Thread-137836::DEBUG::2014-10-29 11:32:50,822::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137836::DEBUG::2014-10-29 11:32:50,823::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137836::DEBUG::2014-10-29 11:32:50,824::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.30', 'elapsedTime': '515003', 'displayType': 'vnc', 'cpuSys': '1.26', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '29821903', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '58544', 'readRate': '0.00', 'truesize': '6010912768', 'writeRate': '37663.18'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.36', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-17::DEBUG::2014-10-29 11:32:50,877::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:50,877::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:50,877::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:50,878::__init__::232::IOProcess::(_processLogs) (203169) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:50,879::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203169) Queuing response >Thread-10269::DEBUG::2014-10-29 11:32:50,879::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:32:50,900::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000626349 s, 801 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:32:50,902::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:50,902::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:50,902::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:50,903::__init__::232::IOProcess::(_processLogs) (203170) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:50,903::__init__::232::IOProcess::(_processLogs) (203170) Queuing response >Detector thread::DEBUG::2014-10-29 11:32:51,008::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55050 >Detector thread::DEBUG::2014-10-29 11:32:51,009::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55050 >Detector thread::DEBUG::2014-10-29 11:32:51,009::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55050 >Detector thread::DEBUG::2014-10-29 11:32:51,010::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55050) >Thread-137837::DEBUG::2014-10-29 11:32:51,049::task::595::Storage.TaskManager.Task::(_updateState) Task=`07e3ca57-adc6-4a57-aa1b-4baf077476c9`::moving from state init -> state preparing >Thread-137837::INFO::2014-10-29 11:32:51,050::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137837::INFO::2014-10-29 11:32:51,050::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00182627', 'lastCheck': '9.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000472672', 'lastCheck': '9.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473443', 'lastCheck': '10.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000626349', 'lastCheck': '0.1', 'valid': True}} >Thread-137837::DEBUG::2014-10-29 11:32:51,051::task::1191::Storage.TaskManager.Task::(prepare) Task=`07e3ca57-adc6-4a57-aa1b-4baf077476c9`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00182627', 'lastCheck': '9.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000472672', 'lastCheck': '9.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000473443', 'lastCheck': '10.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000626349', 'lastCheck': '0.1', 'valid': True}} >Thread-137837::DEBUG::2014-10-29 11:32:51,051::task::595::Storage.TaskManager.Task::(_updateState) Task=`07e3ca57-adc6-4a57-aa1b-4baf077476c9`::moving from state preparing -> state finished >Thread-137837::DEBUG::2014-10-29 11:32:51,051::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137837::DEBUG::2014-10-29 11:32:51,051::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137837::DEBUG::2014-10-29 11:32:51,052::task::993::Storage.TaskManager.Task::(_decref) Task=`07e3ca57-adc6-4a57-aa1b-4baf077476c9`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:32:51,078::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:51,080::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:51,081::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:51,081::__init__::232::IOProcess::(_processLogs) (203171) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:51,087::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203171) Queuing response >Thread-179::DEBUG::2014-10-29 11:32:51,089::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:32:51,109::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000571019 s, 651 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:32:51,114::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:51,116::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:51,117::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:51,119::__init__::232::IOProcess::(_processLogs) (203172) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:51,126::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203172) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:51,282::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:51,283::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:51,297::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-178::DEBUG::2014-10-29 11:32:51,299::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:32:51,300::__init__::232::IOProcess::(_processLogs) (203173) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:51,323::__init__::232::IOProcess::(_processLogs) (203173) Queuing response >Thread-178::DEBUG::2014-10-29 11:32:51,325::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000510535 s, 995 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:32:51,326::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:51,328::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:51,328::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:51,329::__init__::232::IOProcess::(_processLogs) (203174) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:51,330::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203174) Queuing response >Thread-33::DEBUG::2014-10-29 11:32:51,332::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:32:51,333::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:51,350::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-33::DEBUG::2014-10-29 11:32:51,354::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000673685 s, 723 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:32:51,358::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:51,360::__init__::232::IOProcess::(_processLogs) (203175) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:51,360::__init__::232::IOProcess::(_processLogs) (203175) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:51,361::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:51,361::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:51,362::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:51,362::__init__::232::IOProcess::(_processLogs) (203176) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:32:51,362::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:51,362::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:51,363::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:51,363::__init__::232::IOProcess::(_processLogs) (203177) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:51,363::__init__::232::IOProcess::(_processLogs) (203177) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:51,364::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203176) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:51,367::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:51,367::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:51,368::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:51,369::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:51,378::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:51,379::__init__::232::IOProcess::(_processLogs) (203178) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:51,380::__init__::232::IOProcess::(_processLogs) (203178) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:51,380::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:51,380::__init__::232::IOProcess::(_processLogs) (203179) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:51,381::__init__::232::IOProcess::(_processLogs) (203179) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:51,385::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:51,385::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:51,385::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:51,386::__init__::232::IOProcess::(_processLogs) (203180) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:51,386::__init__::232::IOProcess::(_processLogs) (203180) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:51,387::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:51,388::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:51,390::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:51,390::__init__::232::IOProcess::(_processLogs) (203181) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:51,391::__init__::232::IOProcess::(_processLogs) (203181) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:51,391::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:51,392::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:51,393::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:51,393::__init__::232::IOProcess::(_processLogs) (203182) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:51,394::__init__::232::IOProcess::(_processLogs) (203182) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:51,831::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:51,834::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137838::DEBUG::2014-10-29 11:32:51,838::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:51,840::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:51,842::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137839::DEBUG::2014-10-29 11:32:51,845::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137839::DEBUG::2014-10-29 11:32:51,847::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:32:52,026::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55051 >Detector thread::DEBUG::2014-10-29 11:32:52,027::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55051 >Detector thread::DEBUG::2014-10-29 11:32:52,027::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55051 >Detector thread::DEBUG::2014-10-29 11:32:52,028::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55051) >Thread-137840::DEBUG::2014-10-29 11:32:52,066::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137840::DEBUG::2014-10-29 11:32:52,067::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137840::DEBUG::2014-10-29 11:32:52,085::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137840::DEBUG::2014-10-29 11:32:52,131::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '127', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '27', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-22::DEBUG::2014-10-29 11:32:52,465::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a47771d-0cd6-4d0f-b6f2-04ae49130efa`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:32:52,466::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:32:52,467::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:52,467::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:52,468::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:52,468::__init__::232::IOProcess::(_processLogs) (203183) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:32:52,469::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203183) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:52,471::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:52,471::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:52,472::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-22::INFO::2014-10-29 11:32:52,473::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010912768', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:32:52,474::__init__::232::IOProcess::(_processLogs) (203184) Got request for method 'stat' >Thread-22::DEBUG::2014-10-29 11:32:52,474::task::1191::Storage.TaskManager.Task::(prepare) Task=`9a47771d-0cd6-4d0f-b6f2-04ae49130efa`::finished: {'truesize': '6010912768', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:32:52,479::__init__::232::IOProcess::(_processLogs) (203184) Queuing response >Thread-22::DEBUG::2014-10-29 11:32:52,480::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a47771d-0cd6-4d0f-b6f2-04ae49130efa`::moving from state preparing -> state finished >Thread-22::DEBUG::2014-10-29 11:32:52,482::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:52,484::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-22::DEBUG::2014-10-29 11:32:52,484::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2014-10-29 11:32:52,486::task::993::Storage.TaskManager.Task::(_decref) Task=`9a47771d-0cd6-4d0f-b6f2-04ae49130efa`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:52,488::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:52,490::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-22::DEBUG::2014-10-29 11:32:52,557::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:54,862::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:54,864::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137841::DEBUG::2014-10-29 11:32:54,868::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:54,870::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:54,872::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137842::DEBUG::2014-10-29 11:32:54,875::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137842::DEBUG::2014-10-29 11:32:54,877::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:57,497::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:57,499::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:32:57,500::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:57,894::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:57,897::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137843::DEBUG::2014-10-29 11:32:57,900::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:32:57,903::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:32:57,905::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137844::DEBUG::2014-10-29 11:32:57,907::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137844::DEBUG::2014-10-29 11:32:57,910::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:32:59,004::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55053 >Detector thread::DEBUG::2014-10-29 11:32:59,005::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55053 >Detector thread::DEBUG::2014-10-29 11:32:59,005::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55053 >Detector thread::DEBUG::2014-10-29 11:32:59,005::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55053) >Thread-137845::DEBUG::2014-10-29 11:32:59,045::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137845::DEBUG::2014-10-29 11:32:59,046::task::595::Storage.TaskManager.Task::(_updateState) Task=`bdaaadf3-19d3-47f5-8dac-5f117da093d1`::moving from state init -> state preparing >Thread-137845::INFO::2014-10-29 11:32:59,046::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137845::DEBUG::2014-10-29 11:32:59,049::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:32:59,050::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:59,050::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:59,050::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:59,051::__init__::232::IOProcess::(_processLogs) (203185) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:32:59,053::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203185) Queuing response >Thread-137845::DEBUG::2014-10-29 11:32:59,053::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137845::DEBUG::2014-10-29 11:32:59,054::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137845::INFO::2014-10-29 11:32:59,054::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137845::DEBUG::2014-10-29 11:32:59,055::task::1191::Storage.TaskManager.Task::(prepare) Task=`bdaaadf3-19d3-47f5-8dac-5f117da093d1`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137845::DEBUG::2014-10-29 11:32:59,055::task::595::Storage.TaskManager.Task::(_updateState) Task=`bdaaadf3-19d3-47f5-8dac-5f117da093d1`::moving from state preparing -> state finished >Thread-137845::DEBUG::2014-10-29 11:32:59,055::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137845::DEBUG::2014-10-29 11:32:59,055::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137845::DEBUG::2014-10-29 11:32:59,056::task::993::Storage.TaskManager.Task::(_decref) Task=`bdaaadf3-19d3-47f5-8dac-5f117da093d1`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:32:59,099::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55054 >Detector thread::DEBUG::2014-10-29 11:32:59,100::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55054 >Detector thread::DEBUG::2014-10-29 11:32:59,100::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55054 >Detector thread::DEBUG::2014-10-29 11:32:59,101::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55054) >Thread-137846::DEBUG::2014-10-29 11:32:59,139::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137846::DEBUG::2014-10-29 11:32:59,139::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f48b13a-4b92-4a08-8409-057fa242cc3f`::moving from state init -> state preparing >Thread-137846::INFO::2014-10-29 11:32:59,140::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137846::DEBUG::2014-10-29 11:32:59,140::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137846::DEBUG::2014-10-29 11:32:59,140::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137846::DEBUG::2014-10-29 11:32:59,141::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137846::DEBUG::2014-10-29 11:32:59,141::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137846::DEBUG::2014-10-29 11:32:59,141::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137846::DEBUG::2014-10-29 11:32:59,142::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137846::DEBUG::2014-10-29 11:32:59,233::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137846::DEBUG::2014-10-29 11:32:59,233::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137846::DEBUG::2014-10-29 11:32:59,416::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137846::DEBUG::2014-10-29 11:32:59,417::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137846::DEBUG::2014-10-29 11:32:59,417::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137846::DEBUG::2014-10-29 11:32:59,417::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137846::DEBUG::2014-10-29 11:32:59,418::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137846::DEBUG::2014-10-29 11:32:59,418::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137846::DEBUG::2014-10-29 11:32:59,419::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137846::DEBUG::2014-10-29 11:32:59,419::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:32:59,426::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:59,427::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:59,428::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:59,428::__init__::232::IOProcess::(_processLogs) (203186) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:32:59,429::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203186) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:59,431::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:59,433::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:59,434::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:59,436::__init__::232::IOProcess::(_processLogs) (203187) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:32:59,438::__init__::232::IOProcess::(_processLogs) (203187) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:59,440::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:59,442::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:59,443::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-137846::DEBUG::2014-10-29 11:32:59,445::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:32:59,446::__init__::232::IOProcess::(_processLogs) (203188) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:32:59,448::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203188) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:59,449::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:59,449::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:59,450::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:59,451::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203189) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:32:59,451::__init__::232::IOProcess::(_processLogs) (203189) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:59,452::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:59,452::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:59,452::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:59,453::__init__::232::IOProcess::(_processLogs) (203190) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:32:59,453::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203190) Queuing response >Thread-137846::DEBUG::2014-10-29 11:32:59,454::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:32:59,455::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:59,455::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:59,456::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:59,456::__init__::232::IOProcess::(_processLogs) (203191) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:32:59,457::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203191) Queuing response >Thread-137846::DEBUG::2014-10-29 11:32:59,457::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:32:59,459::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:59,459::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:59,460::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:59,461::__init__::232::IOProcess::(_processLogs) (203192) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:32:59,461::__init__::232::IOProcess::(_processLogs) (203192) Queuing response >Thread-17::DEBUG::2014-10-29 11:32:59,461::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:59,462::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:59,463::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-137846::DEBUG::2014-10-29 11:32:59,462::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:32:59,464::__init__::232::IOProcess::(_processLogs) (203193) Got request for method 'glob' >Thread-137846::INFO::2014-10-29 11:32:59,464::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:32:59,465::__init__::232::IOProcess::(_processLogs) (203193) Queuing response >Thread-137846::INFO::2014-10-29 11:32:59,465::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137846::INFO::2014-10-29 11:32:59,466::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:32:59,467::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:32:59,467::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:32:59,468::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:32:59,468::__init__::232::IOProcess::(_processLogs) (203194) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:32:59,469::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203194) Queuing response >Thread-137846::DEBUG::2014-10-29 11:32:59,469::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137846::DEBUG::2014-10-29 11:32:59,472::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`84885e11-c72d-4eee-88a2-9fb706fd171d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137846::DEBUG::2014-10-29 11:32:59,472::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137846::DEBUG::2014-10-29 11:32:59,472::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137846::DEBUG::2014-10-29 11:32:59,472::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`84885e11-c72d-4eee-88a2-9fb706fd171d`::Granted request >Thread-137846::DEBUG::2014-10-29 11:32:59,473::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8f48b13a-4b92-4a08-8409-057fa242cc3f`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137846::DEBUG::2014-10-29 11:32:59,473::task::993::Storage.TaskManager.Task::(_decref) Task=`8f48b13a-4b92-4a08-8409-057fa242cc3f`::ref 1 aborting False >Thread-137846::INFO::2014-10-29 11:32:59,476::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137846::DEBUG::2014-10-29 11:32:59,476::task::1191::Storage.TaskManager.Task::(prepare) Task=`8f48b13a-4b92-4a08-8409-057fa242cc3f`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137846::DEBUG::2014-10-29 11:32:59,477::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f48b13a-4b92-4a08-8409-057fa242cc3f`::moving from state preparing -> state finished >Thread-137846::DEBUG::2014-10-29 11:32:59,477::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137846::DEBUG::2014-10-29 11:32:59,477::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137846::DEBUG::2014-10-29 11:32:59,478::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137846::DEBUG::2014-10-29 11:32:59,478::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137846::DEBUG::2014-10-29 11:32:59,478::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137846::DEBUG::2014-10-29 11:32:59,478::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137846::DEBUG::2014-10-29 11:32:59,479::task::993::Storage.TaskManager.Task::(_decref) Task=`8f48b13a-4b92-4a08-8409-057fa242cc3f`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:32:59,500::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55055 >Detector thread::DEBUG::2014-10-29 11:32:59,501::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55055 >Detector thread::DEBUG::2014-10-29 11:32:59,501::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55055 >Detector thread::DEBUG::2014-10-29 11:32:59,502::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55055) >Thread-137851::DEBUG::2014-10-29 11:32:59,541::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137851::DEBUG::2014-10-29 11:32:59,541::task::595::Storage.TaskManager.Task::(_updateState) Task=`d4476b33-9942-47fa-a632-8f20bee7720e`::moving from state init -> state preparing >Thread-137851::INFO::2014-10-29 11:32:59,542::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137851::INFO::2014-10-29 11:32:59,542::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000510535', 'lastCheck': '8.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673685', 'lastCheck': '8.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571019', 'lastCheck': '8.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000626349', 'lastCheck': '8.6', 'valid': True}} >Thread-137851::DEBUG::2014-10-29 11:32:59,543::task::1191::Storage.TaskManager.Task::(prepare) Task=`d4476b33-9942-47fa-a632-8f20bee7720e`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000510535', 'lastCheck': '8.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673685', 'lastCheck': '8.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571019', 'lastCheck': '8.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000626349', 'lastCheck': '8.6', 'valid': True}} >Thread-137851::DEBUG::2014-10-29 11:32:59,543::task::595::Storage.TaskManager.Task::(_updateState) Task=`d4476b33-9942-47fa-a632-8f20bee7720e`::moving from state preparing -> state finished >Thread-137851::DEBUG::2014-10-29 11:32:59,543::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137851::DEBUG::2014-10-29 11:32:59,543::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137851::DEBUG::2014-10-29 11:32:59,544::task::993::Storage.TaskManager.Task::(_decref) Task=`d4476b33-9942-47fa-a632-8f20bee7720e`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:33:00,906::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:00,909::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:00,910::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-10269::DEBUG::2014-10-29 11:33:00,910::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:33:00,911::__init__::232::IOProcess::(_processLogs) (203195) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:00,932::__init__::232::IOProcess::(_processLogs) (203195) Queuing response >Thread-10269::DEBUG::2014-10-29 11:33:00,934::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000489993 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:33:00,936::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:00,936::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:00,936::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:00,937::__init__::232::IOProcess::(_processLogs) (203196) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:00,937::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203196) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:00,945::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:00,952::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137852::DEBUG::2014-10-29 11:33:00,957::task::595::Storage.TaskManager.Task::(_updateState) Task=`b3fcb44f-b3b3-4084-8385-661b5d0d2170`::moving from state init -> state preparing >Thread-137852::INFO::2014-10-29 11:33:00,957::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137852::INFO::2014-10-29 11:33:00,958::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000510535', 'lastCheck': '9.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673685', 'lastCheck': '9.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571019', 'lastCheck': '9.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000489993', 'lastCheck': '0.0', 'valid': True}} >Thread-137852::DEBUG::2014-10-29 11:33:00,958::task::1191::Storage.TaskManager.Task::(prepare) Task=`b3fcb44f-b3b3-4084-8385-661b5d0d2170`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000510535', 'lastCheck': '9.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673685', 'lastCheck': '9.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571019', 'lastCheck': '9.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000489993', 'lastCheck': '0.0', 'valid': True}} >Thread-137852::DEBUG::2014-10-29 11:33:00,959::task::595::Storage.TaskManager.Task::(_updateState) Task=`b3fcb44f-b3b3-4084-8385-661b5d0d2170`::moving from state preparing -> state finished >Thread-137852::DEBUG::2014-10-29 11:33:00,959::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137852::DEBUG::2014-10-29 11:33:00,959::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137852::DEBUG::2014-10-29 11:33:00,960::task::993::Storage.TaskManager.Task::(_decref) Task=`b3fcb44f-b3b3-4084-8385-661b5d0d2170`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:33:00,979::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55056 >Detector thread::DEBUG::2014-10-29 11:33:00,980::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55056 >Detector thread::DEBUG::2014-10-29 11:33:00,980::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55056 >Detector thread::DEBUG::2014-10-29 11:33:00,981::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55056) >Thread-137852::DEBUG::2014-10-29 11:33:00,990::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-137853::DEBUG::2014-10-29 11:33:01,020::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:01,023::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-137853::DEBUG::2014-10-29 11:33:01,023::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137853::DEBUG::2014-10-29 11:33:01,028::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.60', 'elapsedTime': '515013', 'displayType': 'vnc', 'cpuSys': '0.66', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '3808877', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '83911', 'readRate': '0.00', 'truesize': '6010912768', 'writeRate': '40160.44'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.46', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpcServer::DEBUG::2014-10-29 11:33:01,029::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137854::DEBUG::2014-10-29 11:33:01,039::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137854::DEBUG::2014-10-29 11:33:01,055::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:33:01,131::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:01,133::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-179::DEBUG::2014-10-29 11:33:01,135::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:33:01,135::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:01,154::__init__::232::IOProcess::(_processLogs) (203197) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:01,154::__init__::232::IOProcess::(_processLogs) (203197) Queuing response >Thread-179::DEBUG::2014-10-29 11:33:01,157::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000822353 s, 452 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:33:01,160::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:01,160::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:01,160::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:01,161::__init__::232::IOProcess::(_processLogs) (203198) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:01,161::__init__::232::IOProcess::(_processLogs) (203198) Queuing response >Detector thread::DEBUG::2014-10-29 11:33:01,170::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55058 >Detector thread::DEBUG::2014-10-29 11:33:01,171::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55058 >Detector thread::DEBUG::2014-10-29 11:33:01,171::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55058 >Detector thread::DEBUG::2014-10-29 11:33:01,171::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55058) >Thread-137855::DEBUG::2014-10-29 11:33:01,214::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6e366d0-1069-4ad3-9377-a439bac97150`::moving from state init -> state preparing >Thread-137855::INFO::2014-10-29 11:33:01,216::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137855::INFO::2014-10-29 11:33:01,219::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000510535', 'lastCheck': '9.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673685', 'lastCheck': '9.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000822353', 'lastCheck': '0.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000489993', 'lastCheck': '0.3', 'valid': True}} >Thread-137855::DEBUG::2014-10-29 11:33:01,219::task::1191::Storage.TaskManager.Task::(prepare) Task=`e6e366d0-1069-4ad3-9377-a439bac97150`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000510535', 'lastCheck': '9.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673685', 'lastCheck': '9.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000822353', 'lastCheck': '0.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000489993', 'lastCheck': '0.3', 'valid': True}} >Thread-137855::DEBUG::2014-10-29 11:33:01,220::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6e366d0-1069-4ad3-9377-a439bac97150`::moving from state preparing -> state finished >Thread-137855::DEBUG::2014-10-29 11:33:01,220::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137855::DEBUG::2014-10-29 11:33:01,220::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137855::DEBUG::2014-10-29 11:33:01,221::task::993::Storage.TaskManager.Task::(_decref) Task=`e6e366d0-1069-4ad3-9377-a439bac97150`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:33:01,391::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:01,391::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:01,392::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:01,392::__init__::232::IOProcess::(_processLogs) (203199) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:01,393::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203199) Queuing response >Thread-178::DEBUG::2014-10-29 11:33:01,396::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:33:01,416::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-33::DEBUG::2014-10-29 11:33:01,420::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:33:01,420::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-178::DEBUG::2014-10-29 11:33:01,420::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.0012615 s, 403 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:33:01,438::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-33::DEBUG::2014-10-29 11:33:01,441::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.00067099 s, 726 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:33:01,441::__init__::232::IOProcess::(_processLogs) (203200) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:01,443::__init__::232::IOProcess::(_processLogs) (203200) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:01,444::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:01,444::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:01,445::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:01,445::__init__::232::IOProcess::(_processLogs) (203201) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:01,446::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203201) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:01,448::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:01,448::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:01,448::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:01,449::__init__::232::IOProcess::(_processLogs) (203202) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:01,449::__init__::232::IOProcess::(_processLogs) (203202) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:01,452::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:01,453::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:01,454::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:01,454::__init__::232::IOProcess::(_processLogs) (203203) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:01,454::__init__::232::IOProcess::(_processLogs) (203203) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:01,454::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:01,455::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:01,456::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:01,457::__init__::232::IOProcess::(_processLogs) (203204) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:01,457::__init__::232::IOProcess::(_processLogs) (203204) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:01,457::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:01,457::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:01,458::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:01,459::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203205) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:01,459::__init__::232::IOProcess::(_processLogs) (203205) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:01,460::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:01,461::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:01,461::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:01,462::__init__::232::IOProcess::(_processLogs) (203206) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:01,462::__init__::232::IOProcess::(_processLogs) (203206) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:01,462::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:01,462::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:01,463::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:01,463::__init__::232::IOProcess::(_processLogs) (203207) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:01,464::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203207) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:01,466::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:01,467::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:01,468::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:01,468::__init__::232::IOProcess::(_processLogs) (203208) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:01,468::__init__::232::IOProcess::(_processLogs) (203208) Queuing response >Detector thread::DEBUG::2014-10-29 11:33:02,175::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55059 >Detector thread::DEBUG::2014-10-29 11:33:02,176::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55059 >Detector thread::DEBUG::2014-10-29 11:33:02,177::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55059 >Detector thread::DEBUG::2014-10-29 11:33:02,177::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55059) >Thread-137856::DEBUG::2014-10-29 11:33:02,216::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137856::DEBUG::2014-10-29 11:33:02,218::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137856::DEBUG::2014-10-29 11:33:02,237::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137856::DEBUG::2014-10-29 11:33:02,286::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '112', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '12', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:02,507::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:02,508::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:02,511::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:04,120::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:04,123::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137857::DEBUG::2014-10-29 11:33:04,126::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:04,129::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:04,130::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137858::DEBUG::2014-10-29 11:33:04,133::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137858::DEBUG::2014-10-29 11:33:04,135::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:33:05,163::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:07,155::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:07,158::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137859::DEBUG::2014-10-29 11:33:07,162::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:07,164::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:07,166::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137860::DEBUG::2014-10-29 11:33:07,170::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137860::DEBUG::2014-10-29 11:33:07,172::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:07,513::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:07,515::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:07,516::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-22::DEBUG::2014-10-29 11:33:07,580::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Detector thread::DEBUG::2014-10-29 11:33:10,105::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55061 >Detector thread::DEBUG::2014-10-29 11:33:10,108::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55061 >Detector thread::DEBUG::2014-10-29 11:33:10,108::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55061 >Detector thread::DEBUG::2014-10-29 11:33:10,108::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55061) >Thread-137861::DEBUG::2014-10-29 11:33:10,146::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137861::DEBUG::2014-10-29 11:33:10,147::task::595::Storage.TaskManager.Task::(_updateState) Task=`96b89b91-79c3-4ded-aa48-0c752fe59a1c`::moving from state init -> state preparing >Thread-137861::INFO::2014-10-29 11:33:10,147::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137861::DEBUG::2014-10-29 11:33:10,164::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:33:10,165::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:10,166::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:10,166::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:10,166::__init__::232::IOProcess::(_processLogs) (203209) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:10,167::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203209) Queuing response >Thread-137861::DEBUG::2014-10-29 11:33:10,167::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137861::DEBUG::2014-10-29 11:33:10,168::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137861::INFO::2014-10-29 11:33:10,168::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137861::DEBUG::2014-10-29 11:33:10,169::task::1191::Storage.TaskManager.Task::(prepare) Task=`96b89b91-79c3-4ded-aa48-0c752fe59a1c`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137861::DEBUG::2014-10-29 11:33:10,169::task::595::Storage.TaskManager.Task::(_updateState) Task=`96b89b91-79c3-4ded-aa48-0c752fe59a1c`::moving from state preparing -> state finished >Thread-137861::DEBUG::2014-10-29 11:33:10,169::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137861::DEBUG::2014-10-29 11:33:10,169::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137861::DEBUG::2014-10-29 11:33:10,170::task::993::Storage.TaskManager.Task::(_decref) Task=`96b89b91-79c3-4ded-aa48-0c752fe59a1c`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:10,189::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:10,191::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137862::DEBUG::2014-10-29 11:33:10,195::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:10,197::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:10,199::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137863::DEBUG::2014-10-29 11:33:10,202::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137863::DEBUG::2014-10-29 11:33:10,205::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:33:10,220::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55062 >Detector thread::DEBUG::2014-10-29 11:33:10,221::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55062 >Detector thread::DEBUG::2014-10-29 11:33:10,221::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55062 >Detector thread::DEBUG::2014-10-29 11:33:10,221::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55062) >Thread-137864::DEBUG::2014-10-29 11:33:10,260::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137864::DEBUG::2014-10-29 11:33:10,261::task::595::Storage.TaskManager.Task::(_updateState) Task=`21f6ef67-5c32-4609-8af6-d9ba0f8703de`::moving from state init -> state preparing >Thread-137864::INFO::2014-10-29 11:33:10,261::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137864::DEBUG::2014-10-29 11:33:10,261::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137864::DEBUG::2014-10-29 11:33:10,262::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137864::DEBUG::2014-10-29 11:33:10,262::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137864::DEBUG::2014-10-29 11:33:10,262::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137864::DEBUG::2014-10-29 11:33:10,262::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137864::DEBUG::2014-10-29 11:33:10,263::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Detector thread::DEBUG::2014-10-29 11:33:10,292::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55063 >Detector thread::DEBUG::2014-10-29 11:33:10,294::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55063 >Detector thread::DEBUG::2014-10-29 11:33:10,294::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55063 >Detector thread::DEBUG::2014-10-29 11:33:10,295::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55063) >Thread-137865::DEBUG::2014-10-29 11:33:10,336::task::595::Storage.TaskManager.Task::(_updateState) Task=`8624b2d8-6f4f-4cae-8186-4430a3d577a0`::moving from state init -> state preparing >Thread-137865::INFO::2014-10-29 11:33:10,336::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137865::INFO::2014-10-29 11:33:10,337::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0012615', 'lastCheck': '8.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00067099', 'lastCheck': '8.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000822353', 'lastCheck': '9.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000489993', 'lastCheck': '9.4', 'valid': True}} >Thread-137865::DEBUG::2014-10-29 11:33:10,337::task::1191::Storage.TaskManager.Task::(prepare) Task=`8624b2d8-6f4f-4cae-8186-4430a3d577a0`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0012615', 'lastCheck': '8.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00067099', 'lastCheck': '8.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000822353', 'lastCheck': '9.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000489993', 'lastCheck': '9.4', 'valid': True}} >Thread-137865::DEBUG::2014-10-29 11:33:10,338::task::595::Storage.TaskManager.Task::(_updateState) Task=`8624b2d8-6f4f-4cae-8186-4430a3d577a0`::moving from state preparing -> state finished >Thread-137865::DEBUG::2014-10-29 11:33:10,338::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137865::DEBUG::2014-10-29 11:33:10,338::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137865::DEBUG::2014-10-29 11:33:10,338::task::993::Storage.TaskManager.Task::(_decref) Task=`8624b2d8-6f4f-4cae-8186-4430a3d577a0`::ref 0 aborting False >Thread-137864::DEBUG::2014-10-29 11:33:10,353::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137864::DEBUG::2014-10-29 11:33:10,353::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137864::DEBUG::2014-10-29 11:33:10,533::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137864::DEBUG::2014-10-29 11:33:10,534::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137864::DEBUG::2014-10-29 11:33:10,534::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137864::DEBUG::2014-10-29 11:33:10,535::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137864::DEBUG::2014-10-29 11:33:10,535::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137864::DEBUG::2014-10-29 11:33:10,536::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137864::DEBUG::2014-10-29 11:33:10,536::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137864::DEBUG::2014-10-29 11:33:10,536::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:33:10,541::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:10,547::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:10,548::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:10,548::__init__::232::IOProcess::(_processLogs) (203210) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:10,548::__init__::232::IOProcess::(_processLogs) (203210) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:10,549::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:10,550::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:10,550::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:10,550::__init__::232::IOProcess::(_processLogs) (203211) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:10,550::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:10,551::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:10,551::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:10,551::__init__::232::IOProcess::(_processLogs) (203212) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:10,551::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:10,552::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:10,552::__init__::232::IOProcess::(_processLogs) (203211) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:10,553::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:10,554::__init__::232::IOProcess::(_processLogs) (203213) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:10,556::__init__::232::IOProcess::(_processLogs) (203212) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:10,558::__init__::232::IOProcess::(_processLogs) (203213) Queuing response >Thread-137864::DEBUG::2014-10-29 11:33:10,566::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:33:10,567::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:10,567::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:10,567::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:10,568::__init__::232::IOProcess::(_processLogs) (203214) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:33:10,568::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203214) Queuing response >Thread-137864::DEBUG::2014-10-29 11:33:10,569::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:33:10,570::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:10,570::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:10,570::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:10,571::__init__::232::IOProcess::(_processLogs) (203215) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:33:10,572::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203215) Queuing response >Thread-137864::DEBUG::2014-10-29 11:33:10,572::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:33:10,574::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:10,575::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:10,575::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:10,576::__init__::232::IOProcess::(_processLogs) (203216) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:10,576::__init__::232::IOProcess::(_processLogs) (203216) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:10,576::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:10,577::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:10,577::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:10,577::__init__::232::IOProcess::(_processLogs) (203217) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:10,578::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203217) Queuing response >Thread-137864::DEBUG::2014-10-29 11:33:10,578::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-137864::INFO::2014-10-29 11:33:10,579::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137864::INFO::2014-10-29 11:33:10,579::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137864::INFO::2014-10-29 11:33:10,580::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:33:10,581::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:10,582::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:10,582::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:10,582::__init__::232::IOProcess::(_processLogs) (203218) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:33:10,583::__init__::232::IOProcess::(_processLogs) (203218) Queuing response >Thread-137864::DEBUG::2014-10-29 11:33:10,583::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137864::DEBUG::2014-10-29 11:33:10,585::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`35be5dad-4f72-422a-b28f-2678ace45b84`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137864::DEBUG::2014-10-29 11:33:10,585::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137864::DEBUG::2014-10-29 11:33:10,586::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137864::DEBUG::2014-10-29 11:33:10,586::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`35be5dad-4f72-422a-b28f-2678ace45b84`::Granted request >Thread-137864::DEBUG::2014-10-29 11:33:10,586::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`21f6ef67-5c32-4609-8af6-d9ba0f8703de`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137864::DEBUG::2014-10-29 11:33:10,587::task::993::Storage.TaskManager.Task::(_decref) Task=`21f6ef67-5c32-4609-8af6-d9ba0f8703de`::ref 1 aborting False >Thread-137864::INFO::2014-10-29 11:33:10,589::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137864::DEBUG::2014-10-29 11:33:10,590::task::1191::Storage.TaskManager.Task::(prepare) Task=`21f6ef67-5c32-4609-8af6-d9ba0f8703de`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137864::DEBUG::2014-10-29 11:33:10,590::task::595::Storage.TaskManager.Task::(_updateState) Task=`21f6ef67-5c32-4609-8af6-d9ba0f8703de`::moving from state preparing -> state finished >Thread-137864::DEBUG::2014-10-29 11:33:10,590::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137864::DEBUG::2014-10-29 11:33:10,591::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137864::DEBUG::2014-10-29 11:33:10,591::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137864::DEBUG::2014-10-29 11:33:10,591::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137864::DEBUG::2014-10-29 11:33:10,592::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137864::DEBUG::2014-10-29 11:33:10,592::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137864::DEBUG::2014-10-29 11:33:10,592::task::993::Storage.TaskManager.Task::(_decref) Task=`21f6ef67-5c32-4609-8af6-d9ba0f8703de`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:33:10,613::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55064 >Detector thread::DEBUG::2014-10-29 11:33:10,613::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55064 >Detector thread::DEBUG::2014-10-29 11:33:10,614::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55064 >Detector thread::DEBUG::2014-10-29 11:33:10,614::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55064) >Thread-137870::DEBUG::2014-10-29 11:33:10,653::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137870::DEBUG::2014-10-29 11:33:10,654::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ee83b8c-007c-43f4-ab28-a4828eaf7740`::moving from state init -> state preparing >Thread-137870::INFO::2014-10-29 11:33:10,654::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137870::INFO::2014-10-29 11:33:10,655::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0012615', 'lastCheck': '9.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00067099', 'lastCheck': '9.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000822353', 'lastCheck': '9.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000489993', 'lastCheck': '9.7', 'valid': True}} >Thread-137870::DEBUG::2014-10-29 11:33:10,655::task::1191::Storage.TaskManager.Task::(prepare) Task=`9ee83b8c-007c-43f4-ab28-a4828eaf7740`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0012615', 'lastCheck': '9.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00067099', 'lastCheck': '9.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000822353', 'lastCheck': '9.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000489993', 'lastCheck': '9.7', 'valid': True}} >Thread-137870::DEBUG::2014-10-29 11:33:10,655::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ee83b8c-007c-43f4-ab28-a4828eaf7740`::moving from state preparing -> state finished >Thread-137870::DEBUG::2014-10-29 11:33:10,655::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137870::DEBUG::2014-10-29 11:33:10,656::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137870::DEBUG::2014-10-29 11:33:10,656::task::993::Storage.TaskManager.Task::(_decref) Task=`9ee83b8c-007c-43f4-ab28-a4828eaf7740`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:33:10,953::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:10,953::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:10,953::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:10,954::__init__::232::IOProcess::(_processLogs) (203219) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:10,955::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203219) Queuing response >Thread-10269::DEBUG::2014-10-29 11:33:10,956::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:33:10,974::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00051522 s, 974 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:33:10,976::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:10,976::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:10,977::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:10,977::__init__::232::IOProcess::(_processLogs) (203220) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:10,979::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203220) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:11,165::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:11,167::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-179::DEBUG::2014-10-29 11:33:11,168::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:33:11,169::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:11,189::__init__::232::IOProcess::(_processLogs) (203221) Got request for method 'statvfs' >Thread-179::DEBUG::2014-10-29 11:33:11,192::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.00050111 s, 742 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:33:11,192::__init__::232::IOProcess::(_processLogs) (203221) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:11,195::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:11,195::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:11,195::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:11,196::__init__::232::IOProcess::(_processLogs) (203222) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:11,196::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203222) Queuing response >Detector thread::DEBUG::2014-10-29 11:33:11,202::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55065 >Detector thread::DEBUG::2014-10-29 11:33:11,203::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55065 >Detector thread::DEBUG::2014-10-29 11:33:11,203::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55065 >Detector thread::DEBUG::2014-10-29 11:33:11,204::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55065) >Thread-137871::DEBUG::2014-10-29 11:33:11,243::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137871::DEBUG::2014-10-29 11:33:11,244::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137871::DEBUG::2014-10-29 11:33:11,245::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.52', 'elapsedTime': '515023', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '3808877', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '83911', 'readRate': '0.00', 'truesize': '6010912768', 'writeRate': '40160.44'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.66', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:33:11,336::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55066 >Detector thread::DEBUG::2014-10-29 11:33:11,336::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55066 >Detector thread::DEBUG::2014-10-29 11:33:11,336::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55066 >Detector thread::DEBUG::2014-10-29 11:33:11,337::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55066) >Thread-137872::DEBUG::2014-10-29 11:33:11,376::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137872::DEBUG::2014-10-29 11:33:11,377::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137872::DEBUG::2014-10-29 11:33:11,396::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137872::DEBUG::2014-10-29 11:33:11,454::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '195', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '95', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-178::DEBUG::2014-10-29 11:33:11,466::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 9b5dff8d-f9a0-4e5c-8800-3a988fc12016 >Thread-17::DEBUG::2014-10-29 11:33:11,473::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:11,476::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:11,476::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:11,476::__init__::232::IOProcess::(_processLogs) (203223) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:11,477::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203223) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:11,480::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:11,481::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:11,487::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:11,490::__init__::232::IOProcess::(_processLogs) (203224) Got request for method 'statvfs' >Thread-33::DEBUG::2014-10-29 11:33:11,490::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:33:11,493::__init__::232::IOProcess::(_processLogs) (203224) Queuing response >Thread-33::DEBUG::2014-10-29 11:33:11,518::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000604506 s, 806 kB/s\n'; <rc> = 0 >Thread-178::DEBUG::2014-10-29 11:33:11,519::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016 >Thread-17::DEBUG::2014-10-29 11:33:11,519::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:11,523::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:11,524::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:11,524::__init__::232::IOProcess::(_processLogs) (203225) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:11,525::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203225) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:11,527::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:11,528::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:11,529::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:11,530::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:11,530::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:11,530::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:11,530::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:11,531::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:11,531::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:11,531::__init__::232::IOProcess::(_processLogs) (203226) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:11,531::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:11,532::__init__::232::IOProcess::(_processLogs) (203227) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:11,533::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:11,534::__init__::232::IOProcess::(_processLogs) (203228) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:11,535::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:11,535::__init__::232::IOProcess::(_processLogs) (203229) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:33:11,535::__init__::232::IOProcess::(_processLogs) (203226) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:11,535::__init__::232::IOProcess::(_processLogs) (203228) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:11,536::__init__::232::IOProcess::(_processLogs) (203227) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:11,536::__init__::232::IOProcess::(_processLogs) (203229) Queuing response >Thread-178::DEBUG::2014-10-29 11:33:11,539::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:33:11,541::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:11,542::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:11,543::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:11,543::__init__::232::IOProcess::(_processLogs) (203230) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:11,543::__init__::232::IOProcess::(_processLogs) (203230) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:11,544::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:11,544::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:11,545::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:11,546::__init__::232::IOProcess::(_processLogs) (203231) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:11,546::__init__::232::IOProcess::(_processLogs) (203231) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:11,546::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:11,546::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:11,547::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:11,547::__init__::232::IOProcess::(_processLogs) (203232) Got request for method 'readfile' >Thread-178::DEBUG::2014-10-29 11:33:11,548::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=nsednev_ovirt_3_5_HE_for_disks', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=Default', 'POOL_DOMAINS=9b5dff8d-f9a0-4e5c-8800-3a988fc12016:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=00000002-0002-0002-0002-000000000321', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_ovirt_3_5_HE_for_disks', 'ROLE=Master', 'SDUUID=9b5dff8d-f9a0-4e5c-8800-3a988fc12016', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=08256ef27d308c4f5bfe4a0974fd548f7d749489'] >Thread-17::DEBUG::2014-10-29 11:33:11,548::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203232) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:11,551::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:11,552::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:11,553::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:11,553::__init__::232::IOProcess::(_processLogs) (203233) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:11,554::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203233) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:11,555::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:11,557::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:11,557::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:11,558::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203234) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:11,559::__init__::232::IOProcess::(_processLogs) (203234) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:11,559::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:11,560::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:11,560::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:11,560::__init__::232::IOProcess::(_processLogs) (203235) Got request for method 'glob' >Thread-178::DEBUG::2014-10-29 11:33:11,561::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:33:11,561::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203235) Queuing response >Thread-178::INFO::2014-10-29 11:33:11,562::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9b5dff8d-f9a0-4e5c-8800-3a988fc12016_imageNS already registered >Thread-178::INFO::2014-10-29 11:33:11,563::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 9b5dff8d-f9a0-4e5c-8800-3a988fc12016_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:33:11,564::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:11,565::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:11,566::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:11,567::__init__::232::IOProcess::(_processLogs) (203236) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:33:11,568::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:33:11,569::__init__::232::IOProcess::(_processLogs) (203236) Queuing response >Thread-178::DEBUG::2014-10-29 11:33:11,586::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000580805 s, 875 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:33:11,588::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:11,588::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:11,588::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:11,588::__init__::232::IOProcess::(_processLogs) (203237) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:11,590::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203237) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:11,592::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:11,593::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:11,593::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:11,594::__init__::232::IOProcess::(_processLogs) (203238) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:11,594::__init__::232::IOProcess::(_processLogs) (203238) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:11,594::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:11,595::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:11,595::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:11,595::__init__::232::IOProcess::(_processLogs) (203239) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:11,596::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203239) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:11,597::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:11,598::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:11,599::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:11,600::__init__::232::IOProcess::(_processLogs) (203240) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:11,600::__init__::232::IOProcess::(_processLogs) (203240) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:12,521::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:12,523::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:12,526::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:13,219::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:13,222::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137877::DEBUG::2014-10-29 11:33:13,226::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:13,228::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:13,230::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137878::DEBUG::2014-10-29 11:33:13,233::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137878::DEBUG::2014-10-29 11:33:13,235::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:16,250::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:16,256::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137879::DEBUG::2014-10-29 11:33:16,265::task::595::Storage.TaskManager.Task::(_updateState) Task=`b7231a12-c20e-4468-9f47-30b97c7c6281`::moving from state init -> state preparing >Thread-137879::INFO::2014-10-29 11:33:16,267::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137879::INFO::2014-10-29 11:33:16,270::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580805', 'lastCheck': '4.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604506', 'lastCheck': '4.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050111', 'lastCheck': '5.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00051522', 'lastCheck': '5.3', 'valid': True}} >Thread-137879::DEBUG::2014-10-29 11:33:16,271::task::1191::Storage.TaskManager.Task::(prepare) Task=`b7231a12-c20e-4468-9f47-30b97c7c6281`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580805', 'lastCheck': '4.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604506', 'lastCheck': '4.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050111', 'lastCheck': '5.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00051522', 'lastCheck': '5.3', 'valid': True}} >Thread-137879::DEBUG::2014-10-29 11:33:16,272::task::595::Storage.TaskManager.Task::(_updateState) Task=`b7231a12-c20e-4468-9f47-30b97c7c6281`::moving from state preparing -> state finished >Thread-137879::DEBUG::2014-10-29 11:33:16,273::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137879::DEBUG::2014-10-29 11:33:16,274::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137879::DEBUG::2014-10-29 11:33:16,276::task::993::Storage.TaskManager.Task::(_decref) Task=`b7231a12-c20e-4468-9f47-30b97c7c6281`::ref 0 aborting False >Thread-137879::DEBUG::2014-10-29 11:33:16,354::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:16,380::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:16,385::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137880::DEBUG::2014-10-29 11:33:16,393::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137880::DEBUG::2014-10-29 11:33:16,406::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:17,531::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:17,532::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:17,533::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:19,457::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:19,464::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137881::DEBUG::2014-10-29 11:33:19,473::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:19,478::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:19,483::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137882::DEBUG::2014-10-29 11:33:19,491::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137882::DEBUG::2014-10-29 11:33:19,507::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:33:20,398::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55068 >Detector thread::DEBUG::2014-10-29 11:33:20,399::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55068 >Detector thread::DEBUG::2014-10-29 11:33:20,399::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55068 >Detector thread::DEBUG::2014-10-29 11:33:20,400::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55068) >Detector thread::DEBUG::2014-10-29 11:33:20,437::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55069 >Detector thread::DEBUG::2014-10-29 11:33:20,437::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55069 >Detector thread::DEBUG::2014-10-29 11:33:20,438::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55069 >Detector thread::DEBUG::2014-10-29 11:33:20,438::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55069) >Thread-137883::DEBUG::2014-10-29 11:33:20,442::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137883::DEBUG::2014-10-29 11:33:20,444::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137883::DEBUG::2014-10-29 11:33:20,444::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.52', 'elapsedTime': '515032', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '3808877', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '83911', 'readRate': '0.00', 'truesize': '6010912768', 'writeRate': '40160.44'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.86', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-137884::DEBUG::2014-10-29 11:33:20,478::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5a165ff-87e4-4f9d-9b53-1b872d487cb2`::moving from state init -> state preparing >Thread-137884::INFO::2014-10-29 11:33:20,479::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137884::INFO::2014-10-29 11:33:20,479::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580805', 'lastCheck': '8.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604506', 'lastCheck': '8.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050111', 'lastCheck': '9.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00051522', 'lastCheck': '9.5', 'valid': True}} >Thread-137884::DEBUG::2014-10-29 11:33:20,480::task::1191::Storage.TaskManager.Task::(prepare) Task=`e5a165ff-87e4-4f9d-9b53-1b872d487cb2`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580805', 'lastCheck': '8.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000604506', 'lastCheck': '8.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00050111', 'lastCheck': '9.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00051522', 'lastCheck': '9.5', 'valid': True}} >Thread-137884::DEBUG::2014-10-29 11:33:20,480::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5a165ff-87e4-4f9d-9b53-1b872d487cb2`::moving from state preparing -> state finished >Thread-137884::DEBUG::2014-10-29 11:33:20,480::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137884::DEBUG::2014-10-29 11:33:20,480::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137884::DEBUG::2014-10-29 11:33:20,481::task::993::Storage.TaskManager.Task::(_decref) Task=`e5a165ff-87e4-4f9d-9b53-1b872d487cb2`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:33:20,982::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:20,982::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:20,983::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:20,983::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203241) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:20,985::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203241) Queuing response >Thread-10269::DEBUG::2014-10-29 11:33:20,987::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:33:21,015::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.0079498 s, 63.1 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:33:21,017::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:21,018::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:21,018::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:21,019::__init__::232::IOProcess::(_processLogs) (203242) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:21,021::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203242) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:21,200::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:21,201::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:21,201::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:21,201::__init__::232::IOProcess::(_processLogs) (203243) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:21,203::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203243) Queuing response >Thread-179::DEBUG::2014-10-29 11:33:21,204::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:33:21,231::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.0074994 s, 49.6 kB/s\n'; <rc> = 0 >Detector thread::DEBUG::2014-10-29 11:33:21,235::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55072 >Detector thread::DEBUG::2014-10-29 11:33:21,235::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55072 >Detector thread::DEBUG::2014-10-29 11:33:21,236::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55072 >Detector thread::DEBUG::2014-10-29 11:33:21,237::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55072) >Thread-17::DEBUG::2014-10-29 11:33:21,238::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:21,241::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:21,242::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:21,242::__init__::232::IOProcess::(_processLogs) (203244) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:21,244::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203244) Queuing response >Thread-137885::DEBUG::2014-10-29 11:33:21,276::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137885::DEBUG::2014-10-29 11:33:21,277::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3d691de-9d4d-4598-96c8-ed1ee660fb3b`::moving from state init -> state preparing >Thread-137885::INFO::2014-10-29 11:33:21,277::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137885::DEBUG::2014-10-29 11:33:21,280::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:33:21,281::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:21,281::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:21,282::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:21,282::__init__::232::IOProcess::(_processLogs) (203245) Got request for method 'glob' >Thread-137885::DEBUG::2014-10-29 11:33:21,283::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:33:21,283::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203245) Queuing response >Thread-137885::DEBUG::2014-10-29 11:33:21,284::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137885::INFO::2014-10-29 11:33:21,285::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137885::DEBUG::2014-10-29 11:33:21,285::task::1191::Storage.TaskManager.Task::(prepare) Task=`d3d691de-9d4d-4598-96c8-ed1ee660fb3b`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137885::DEBUG::2014-10-29 11:33:21,286::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3d691de-9d4d-4598-96c8-ed1ee660fb3b`::moving from state preparing -> state finished >Thread-137885::DEBUG::2014-10-29 11:33:21,286::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137885::DEBUG::2014-10-29 11:33:21,286::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137885::DEBUG::2014-10-29 11:33:21,286::task::993::Storage.TaskManager.Task::(_decref) Task=`d3d691de-9d4d-4598-96c8-ed1ee660fb3b`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:33:21,335::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55073 >Detector thread::DEBUG::2014-10-29 11:33:21,335::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55073 >Detector thread::DEBUG::2014-10-29 11:33:21,336::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55073 >Detector thread::DEBUG::2014-10-29 11:33:21,336::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55073) >Thread-137886::DEBUG::2014-10-29 11:33:21,375::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137886::DEBUG::2014-10-29 11:33:21,376::task::595::Storage.TaskManager.Task::(_updateState) Task=`a27a2070-9a62-4486-b903-e3cd98ad9bf9`::moving from state init -> state preparing >Thread-137886::INFO::2014-10-29 11:33:21,376::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137886::DEBUG::2014-10-29 11:33:21,376::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137886::DEBUG::2014-10-29 11:33:21,377::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137886::DEBUG::2014-10-29 11:33:21,377::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137886::DEBUG::2014-10-29 11:33:21,377::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137886::DEBUG::2014-10-29 11:33:21,377::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137886::DEBUG::2014-10-29 11:33:21,378::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137886::DEBUG::2014-10-29 11:33:21,457::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137886::DEBUG::2014-10-29 11:33:21,458::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Detector thread::DEBUG::2014-10-29 11:33:21,504::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55074 >Detector thread::DEBUG::2014-10-29 11:33:21,505::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55074 >Detector thread::DEBUG::2014-10-29 11:33:21,506::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55074 >Detector thread::DEBUG::2014-10-29 11:33:21,507::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55074) >Thread-137887::DEBUG::2014-10-29 11:33:21,546::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137887::DEBUG::2014-10-29 11:33:21,550::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137887::DEBUG::2014-10-29 11:33:21,571::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:33:21,602::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:21,604::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:21,607::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:21,607::__init__::232::IOProcess::(_processLogs) (203246) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:21,608::__init__::232::IOProcess::(_processLogs) (203246) Queuing response >Thread-178::DEBUG::2014-10-29 11:33:21,608::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-137886::DEBUG::2014-10-29 11:33:21,654::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-178::DEBUG::2014-10-29 11:33:21,656::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.0160959 s, 31.6 kB/s\n'; <rc> = 0 >Thread-137886::DEBUG::2014-10-29 11:33:21,661::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-10-29 11:33:21,666::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-137886::DEBUG::2014-10-29 11:33:21,667::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137887::DEBUG::2014-10-29 11:33:21,667::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '178', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '78', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-17::DEBUG::2014-10-29 11:33:21,669::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137886::DEBUG::2014-10-29 11:33:21,673::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-10-29 11:33:21,673::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:21,676::__init__::232::IOProcess::(_processLogs) (203247) Got request for method 'statvfs' >Thread-137886::DEBUG::2014-10-29 11:33:21,677::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137886::DEBUG::2014-10-29 11:33:21,681::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137886::DEBUG::2014-10-29 11:33:21,685::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-10-29 11:33:21,687::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203247) Queuing response >Thread-137886::DEBUG::2014-10-29 11:33:21,690::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:33:21,693::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:21,696::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:21,701::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:21,705::__init__::232::IOProcess::(_processLogs) (203248) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:21,709::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203248) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:21,712::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:21,714::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:21,715::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:21,717::__init__::232::IOProcess::(_processLogs) (203249) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:21,721::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203249) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:21,725::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:21,726::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:21,728::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:21,729::__init__::232::IOProcess::(_processLogs) (203250) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:21,734::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203250) Queuing response >Thread-137886::DEBUG::2014-10-29 11:33:21,740::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:33:21,741::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:21,741::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:21,742::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:21,743::__init__::232::IOProcess::(_processLogs) (203251) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:21,743::__init__::232::IOProcess::(_processLogs) (203251) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:21,744::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:21,744::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:21,744::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:21,745::__init__::232::IOProcess::(_processLogs) (203252) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:21,746::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203252) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:21,747::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:21,747::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:21,747::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:21,747::__init__::232::IOProcess::(_processLogs) (203253) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:21,748::__init__::232::IOProcess::(_processLogs) (203253) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:21,749::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:21,750::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:21,750::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:21,750::__init__::232::IOProcess::(_processLogs) (203254) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:33:21,751::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203254) Queuing response >Thread-137886::DEBUG::2014-10-29 11:33:21,751::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:33:21,753::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:21,754::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:21,754::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:21,754::__init__::232::IOProcess::(_processLogs) (203255) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:21,754::__init__::232::IOProcess::(_processLogs) (203255) Queuing response >Thread-137886::DEBUG::2014-10-29 11:33:21,757::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:33:21,758::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:21,760::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:21,761::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:21,762::__init__::232::IOProcess::(_processLogs) (203256) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:33:21,762::__init__::232::IOProcess::(_processLogs) (203256) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:21,762::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:21,763::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:21,764::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:21,764::__init__::232::IOProcess::(_processLogs) (203257) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:21,764::__init__::232::IOProcess::(_processLogs) (203257) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:21,765::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:21,765::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:21,766::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:21,766::__init__::232::IOProcess::(_processLogs) (203258) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:21,767::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203258) Queuing response >Thread-137886::DEBUG::2014-10-29 11:33:21,767::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-137886::INFO::2014-10-29 11:33:21,768::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137886::INFO::2014-10-29 11:33:21,768::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137886::INFO::2014-10-29 11:33:21,769::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:33:21,771::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:21,772::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:21,772::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:21,772::__init__::232::IOProcess::(_processLogs) (203259) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:21,773::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203259) Queuing response >Thread-33::DEBUG::2014-10-29 11:33:21,775::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:33:21,792::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-137886::DEBUG::2014-10-29 11:33:21,793::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-33::DEBUG::2014-10-29 11:33:21,796::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000544886 s, 894 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:33:21,797::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:21,801::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:21,803::__init__::232::IOProcess::(_processLogs) (203260) Got request for method 'readfile' >Thread-137886::DEBUG::2014-10-29 11:33:21,805::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`bf086b07-9ca1-4e9b-ba3d-0e24822bfe1c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-17::DEBUG::2014-10-29 11:33:21,805::__init__::232::IOProcess::(_processLogs) (203260) Queuing response >Thread-137886::DEBUG::2014-10-29 11:33:21,807::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137886::DEBUG::2014-10-29 11:33:21,809::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-17::DEBUG::2014-10-29 11:33:21,810::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-137886::DEBUG::2014-10-29 11:33:21,811::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`bf086b07-9ca1-4e9b-ba3d-0e24822bfe1c`::Granted request >Thread-17::DEBUG::2014-10-29 11:33:21,812::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137886::DEBUG::2014-10-29 11:33:21,814::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a27a2070-9a62-4486-b903-e3cd98ad9bf9`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-17::DEBUG::2014-10-29 11:33:21,815::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-137886::DEBUG::2014-10-29 11:33:21,815::task::993::Storage.TaskManager.Task::(_decref) Task=`a27a2070-9a62-4486-b903-e3cd98ad9bf9`::ref 1 aborting False >Thread-17::DEBUG::2014-10-29 11:33:21,817::__init__::232::IOProcess::(_processLogs) (203261) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:21,824::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203261) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:21,828::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:21,830::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137886::INFO::2014-10-29 11:33:21,832::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-17::DEBUG::2014-10-29 11:33:21,833::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-137886::DEBUG::2014-10-29 11:33:21,833::task::1191::Storage.TaskManager.Task::(prepare) Task=`a27a2070-9a62-4486-b903-e3cd98ad9bf9`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-17::DEBUG::2014-10-29 11:33:21,835::__init__::232::IOProcess::(_processLogs) (203262) Got request for method 'access' >Thread-137886::DEBUG::2014-10-29 11:33:21,835::task::595::Storage.TaskManager.Task::(_updateState) Task=`a27a2070-9a62-4486-b903-e3cd98ad9bf9`::moving from state preparing -> state finished >Thread-137886::DEBUG::2014-10-29 11:33:21,836::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137886::DEBUG::2014-10-29 11:33:21,839::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17::DEBUG::2014-10-29 11:33:21,839::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203262) Queuing response >Thread-137886::DEBUG::2014-10-29 11:33:21,842::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-17::DEBUG::2014-10-29 11:33:21,843::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:21,844::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137886::DEBUG::2014-10-29 11:33:21,844::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-17::DEBUG::2014-10-29 11:33:21,846::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-137886::DEBUG::2014-10-29 11:33:21,846::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-17::DEBUG::2014-10-29 11:33:21,847::__init__::232::IOProcess::(_processLogs) (203263) Got request for method 'access' >Thread-137886::DEBUG::2014-10-29 11:33:21,848::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137886::DEBUG::2014-10-29 11:33:21,851::task::993::Storage.TaskManager.Task::(_decref) Task=`a27a2070-9a62-4486-b903-e3cd98ad9bf9`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:33:21,851::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203263) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:21,855::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:21,857::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:21,860::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:21,861::__init__::232::IOProcess::(_processLogs) (203264) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:21,862::__init__::232::IOProcess::(_processLogs) (203264) Queuing response >Detector thread::DEBUG::2014-10-29 11:33:21,887::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55075 >Detector thread::DEBUG::2014-10-29 11:33:21,888::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55075 >Detector thread::DEBUG::2014-10-29 11:33:21,889::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55075 >Detector thread::DEBUG::2014-10-29 11:33:21,889::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55075) >Thread-137892::DEBUG::2014-10-29 11:33:21,943::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137892::DEBUG::2014-10-29 11:33:21,948::task::595::Storage.TaskManager.Task::(_updateState) Task=`900d4a0d-a09d-498a-9c98-80b35e5daa7e`::moving from state init -> state preparing >Thread-137892::INFO::2014-10-29 11:33:21,949::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137892::INFO::2014-10-29 11:33:21,950::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0160959', 'lastCheck': '0.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544886', 'lastCheck': '0.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0074994', 'lastCheck': '0.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0079498', 'lastCheck': '0.9', 'valid': True}} >Thread-137892::DEBUG::2014-10-29 11:33:21,950::task::1191::Storage.TaskManager.Task::(prepare) Task=`900d4a0d-a09d-498a-9c98-80b35e5daa7e`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0160959', 'lastCheck': '0.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544886', 'lastCheck': '0.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0074994', 'lastCheck': '0.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0079498', 'lastCheck': '0.9', 'valid': True}} >Thread-137892::DEBUG::2014-10-29 11:33:21,951::task::595::Storage.TaskManager.Task::(_updateState) Task=`900d4a0d-a09d-498a-9c98-80b35e5daa7e`::moving from state preparing -> state finished >Thread-137892::DEBUG::2014-10-29 11:33:21,951::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137892::DEBUG::2014-10-29 11:33:21,951::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137892::DEBUG::2014-10-29 11:33:21,952::task::993::Storage.TaskManager.Task::(_decref) Task=`900d4a0d-a09d-498a-9c98-80b35e5daa7e`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:22,532::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:22,534::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137893::DEBUG::2014-10-29 11:33:22,538::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:22,544::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:22,544::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:22,550::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpcServer::DEBUG::2014-10-29 11:33:22,551::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:22,558::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137894::DEBUG::2014-10-29 11:33:22,561::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137894::DEBUG::2014-10-29 11:33:22,565::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-22::DEBUG::2014-10-29 11:33:22,604::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:25,579::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:25,582::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137895::DEBUG::2014-10-29 11:33:25,585::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:25,587::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:25,589::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137896::DEBUG::2014-10-29 11:33:25,593::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137896::DEBUG::2014-10-29 11:33:25,595::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:27,569::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:27,571::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:27,572::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:28,610::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:28,613::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137897::DEBUG::2014-10-29 11:33:28,616::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:28,619::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:28,620::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137898::DEBUG::2014-10-29 11:33:28,623::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137898::DEBUG::2014-10-29 11:33:28,626::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:33:30,556::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55076 >Detector thread::DEBUG::2014-10-29 11:33:30,556::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55076 >Detector thread::DEBUG::2014-10-29 11:33:30,556::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55076 >Detector thread::DEBUG::2014-10-29 11:33:30,557::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55076) >Thread-137899::DEBUG::2014-10-29 11:33:30,597::task::595::Storage.TaskManager.Task::(_updateState) Task=`eb7f538f-982e-41b0-9f28-6f8dba5efe6c`::moving from state init -> state preparing >Thread-137899::INFO::2014-10-29 11:33:30,597::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137899::INFO::2014-10-29 11:33:30,598::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0160959', 'lastCheck': '8.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544886', 'lastCheck': '8.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0074994', 'lastCheck': '9.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0079498', 'lastCheck': '9.6', 'valid': True}} >Thread-137899::DEBUG::2014-10-29 11:33:30,598::task::1191::Storage.TaskManager.Task::(prepare) Task=`eb7f538f-982e-41b0-9f28-6f8dba5efe6c`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0160959', 'lastCheck': '8.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544886', 'lastCheck': '8.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0074994', 'lastCheck': '9.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.0079498', 'lastCheck': '9.6', 'valid': True}} >Thread-137899::DEBUG::2014-10-29 11:33:30,599::task::595::Storage.TaskManager.Task::(_updateState) Task=`eb7f538f-982e-41b0-9f28-6f8dba5efe6c`::moving from state preparing -> state finished >Thread-137899::DEBUG::2014-10-29 11:33:30,599::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137899::DEBUG::2014-10-29 11:33:30,599::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137899::DEBUG::2014-10-29 11:33:30,599::task::993::Storage.TaskManager.Task::(_decref) Task=`eb7f538f-982e-41b0-9f28-6f8dba5efe6c`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:33:30,624::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55077 >Detector thread::DEBUG::2014-10-29 11:33:30,625::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55077 >Detector thread::DEBUG::2014-10-29 11:33:30,625::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55077 >Detector thread::DEBUG::2014-10-29 11:33:30,626::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55077) >Thread-137900::DEBUG::2014-10-29 11:33:30,665::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137900::DEBUG::2014-10-29 11:33:30,666::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137900::DEBUG::2014-10-29 11:33:30,667::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.84', 'elapsedTime': '515043', 'displayType': 'vnc', 'cpuSys': '1.00', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '3808877', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '83911', 'readRate': '0.00', 'truesize': '6010912768', 'writeRate': '40160.44'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.06', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-17::DEBUG::2014-10-29 11:33:31,023::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:31,024::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:31,024::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:31,024::__init__::232::IOProcess::(_processLogs) (203265) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:31,025::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203265) Queuing response >Thread-10269::DEBUG::2014-10-29 11:33:31,027::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:33:31,043::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00042767 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:33:31,045::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:31,046::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:31,048::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:31,049::__init__::232::IOProcess::(_processLogs) (203266) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:31,049::__init__::232::IOProcess::(_processLogs) (203266) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:31,257::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:31,258::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:31,258::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:31,258::__init__::232::IOProcess::(_processLogs) (203267) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:31,260::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203267) Queuing response >Thread-179::DEBUG::2014-10-29 11:33:31,261::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:33:31,277::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000486136 s, 765 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:33:31,278::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:31,279::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:31,279::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:31,279::__init__::232::IOProcess::(_processLogs) (203268) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:31,281::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203268) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:31,641::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:31,644::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137901::DEBUG::2014-10-29 11:33:31,648::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5af703f-3b8b-45e5-89d4-768f16c8c9a8`::moving from state init -> state preparing >Thread-137901::INFO::2014-10-29 11:33:31,649::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137901::INFO::2014-10-29 11:33:31,650::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0160959', 'lastCheck': '9.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544886', 'lastCheck': '9.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486136', 'lastCheck': '0.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00042767', 'lastCheck': '0.6', 'valid': True}} >Thread-137901::DEBUG::2014-10-29 11:33:31,650::task::1191::Storage.TaskManager.Task::(prepare) Task=`e5af703f-3b8b-45e5-89d4-768f16c8c9a8`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0160959', 'lastCheck': '9.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544886', 'lastCheck': '9.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486136', 'lastCheck': '0.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00042767', 'lastCheck': '0.6', 'valid': True}} >Thread-137901::DEBUG::2014-10-29 11:33:31,650::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5af703f-3b8b-45e5-89d4-768f16c8c9a8`::moving from state preparing -> state finished >Thread-137901::DEBUG::2014-10-29 11:33:31,650::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137901::DEBUG::2014-10-29 11:33:31,651::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137901::DEBUG::2014-10-29 11:33:31,651::task::993::Storage.TaskManager.Task::(_decref) Task=`e5af703f-3b8b-45e5-89d4-768f16c8c9a8`::ref 0 aborting False >Thread-137901::DEBUG::2014-10-29 11:33:31,672::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:31,706::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:31,708::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137902::DEBUG::2014-10-29 11:33:31,714::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137902::DEBUG::2014-10-29 11:33:31,716::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:33:31,760::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:31,762::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:31,763::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:31,763::__init__::232::IOProcess::(_processLogs) (203269) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:31,763::__init__::232::IOProcess::(_processLogs) (203269) Queuing response >Thread-178::DEBUG::2014-10-29 11:33:31,765::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:33:31,793::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000538584 s, 943 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:33:31,794::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:31,797::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:31,798::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:31,798::__init__::232::IOProcess::(_processLogs) (203270) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:31,799::__init__::232::IOProcess::(_processLogs) (203270) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:31,799::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:31,800::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:31,800::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:31,801::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203271) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:31,802::__init__::232::IOProcess::(_processLogs) (203271) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:31,802::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:31,803::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:31,804::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:31,804::__init__::232::IOProcess::(_processLogs) (203272) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:31,804::__init__::232::IOProcess::(_processLogs) (203272) Queuing response >Detector thread::DEBUG::2014-10-29 11:33:31,805::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55079 >Detector thread::DEBUG::2014-10-29 11:33:31,807::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55079 >Thread-17::DEBUG::2014-10-29 11:33:31,807::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Detector thread::DEBUG::2014-10-29 11:33:31,809::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55079 >Thread-17::DEBUG::2014-10-29 11:33:31,809::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Detector thread::DEBUG::2014-10-29 11:33:31,811::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55079) >Thread-17::DEBUG::2014-10-29 11:33:31,812::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:31,815::__init__::232::IOProcess::(_processLogs) (203273) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:31,815::__init__::232::IOProcess::(_processLogs) (203273) Queuing response >Thread-137903::DEBUG::2014-10-29 11:33:31,846::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137903::DEBUG::2014-10-29 11:33:31,848::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-17::DEBUG::2014-10-29 11:33:31,868::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-137903::DEBUG::2014-10-29 11:33:31,869::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:33:31,871::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:31,873::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:31,875::__init__::232::IOProcess::(_processLogs) (203274) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:31,883::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203274) Queuing response >Thread-33::DEBUG::2014-10-29 11:33:31,886::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:33:31,908::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000451871 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:33:31,913::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:31,914::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:31,915::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:31,915::__init__::232::IOProcess::(_processLogs) (203275) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:31,920::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203275) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:31,923::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:31,924::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:31,926::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:31,928::__init__::232::IOProcess::(_processLogs) (203276) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:31,932::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203276) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:31,937::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:31,938::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:31,943::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:31,945::__init__::232::IOProcess::(_processLogs) (203277) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:31,946::__init__::232::IOProcess::(_processLogs) (203277) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:31,949::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:31,951::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:31,952::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:31,952::__init__::232::IOProcess::(_processLogs) (203278) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:31,955::__init__::232::IOProcess::(_processLogs) (203278) Queuing response >Thread-137903::DEBUG::2014-10-29 11:33:31,990::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '142', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '41', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-29 11:33:32,526::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55081 >Detector thread::DEBUG::2014-10-29 11:33:32,527::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55081 >Detector thread::DEBUG::2014-10-29 11:33:32,527::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55081 >Detector thread::DEBUG::2014-10-29 11:33:32,528::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55081) >Thread-137904::DEBUG::2014-10-29 11:33:32,567::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137904::DEBUG::2014-10-29 11:33:32,568::task::595::Storage.TaskManager.Task::(_updateState) Task=`12a05dd8-7b1e-4211-a552-5b1f954fc8eb`::moving from state init -> state preparing >Thread-137904::INFO::2014-10-29 11:33:32,569::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:32,575::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:32,576::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:32,577::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137904::DEBUG::2014-10-29 11:33:32,584::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:33:32,585::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:32,585::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:32,585::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:32,586::__init__::232::IOProcess::(_processLogs) (203279) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:32,586::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203279) Queuing response >Thread-137904::DEBUG::2014-10-29 11:33:32,587::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137904::DEBUG::2014-10-29 11:33:32,588::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137904::INFO::2014-10-29 11:33:32,588::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137904::DEBUG::2014-10-29 11:33:32,589::task::1191::Storage.TaskManager.Task::(prepare) Task=`12a05dd8-7b1e-4211-a552-5b1f954fc8eb`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137904::DEBUG::2014-10-29 11:33:32,589::task::595::Storage.TaskManager.Task::(_updateState) Task=`12a05dd8-7b1e-4211-a552-5b1f954fc8eb`::moving from state preparing -> state finished >Thread-137904::DEBUG::2014-10-29 11:33:32,589::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137904::DEBUG::2014-10-29 11:33:32,590::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137904::DEBUG::2014-10-29 11:33:32,590::task::993::Storage.TaskManager.Task::(_decref) Task=`12a05dd8-7b1e-4211-a552-5b1f954fc8eb`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:33:32,633::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55082 >Detector thread::DEBUG::2014-10-29 11:33:32,633::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55082 >Detector thread::DEBUG::2014-10-29 11:33:32,634::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55082 >Detector thread::DEBUG::2014-10-29 11:33:32,634::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55082) >Thread-137905::DEBUG::2014-10-29 11:33:32,673::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137905::DEBUG::2014-10-29 11:33:32,674::task::595::Storage.TaskManager.Task::(_updateState) Task=`61cf5119-49b4-4af5-8c56-6514bcd53004`::moving from state init -> state preparing >Thread-137905::INFO::2014-10-29 11:33:32,674::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137905::DEBUG::2014-10-29 11:33:32,674::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137905::DEBUG::2014-10-29 11:33:32,675::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137905::DEBUG::2014-10-29 11:33:32,675::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137905::DEBUG::2014-10-29 11:33:32,675::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137905::DEBUG::2014-10-29 11:33:32,675::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137905::DEBUG::2014-10-29 11:33:32,676::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137905::DEBUG::2014-10-29 11:33:32,768::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137905::DEBUG::2014-10-29 11:33:32,768::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137905::DEBUG::2014-10-29 11:33:32,948::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137905::DEBUG::2014-10-29 11:33:32,949::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137905::DEBUG::2014-10-29 11:33:32,950::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137905::DEBUG::2014-10-29 11:33:32,950::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137905::DEBUG::2014-10-29 11:33:32,951::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137905::DEBUG::2014-10-29 11:33:32,951::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137905::DEBUG::2014-10-29 11:33:32,951::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137905::DEBUG::2014-10-29 11:33:32,952::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:33:32,959::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:32,961::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:32,962::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:32,962::__init__::232::IOProcess::(_processLogs) (203280) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:32,964::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203280) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:32,966::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:32,966::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:32,966::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:32,966::__init__::232::IOProcess::(_processLogs) (203281) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:32,967::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203281) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:32,969::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:32,970::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:32,972::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:32,975::__init__::232::IOProcess::(_processLogs) (203282) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:32,979::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203282) Queuing response >Thread-137905::DEBUG::2014-10-29 11:33:32,981::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:33:32,983::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:32,984::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:32,984::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:32,984::__init__::232::IOProcess::(_processLogs) (203283) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:32,985::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203283) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:32,985::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:32,986::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:32,986::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:32,986::__init__::232::IOProcess::(_processLogs) (203284) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:33:32,988::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203284) Queuing response >Thread-137905::DEBUG::2014-10-29 11:33:32,989::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:33:32,990::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:32,991::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:32,991::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:32,991::__init__::232::IOProcess::(_processLogs) (203285) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:33:32,992::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203285) Queuing response >Thread-137905::DEBUG::2014-10-29 11:33:32,993::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:33:32,995::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:32,995::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:32,995::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:32,995::__init__::232::IOProcess::(_processLogs) (203286) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:32,996::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203286) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:32,997::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:32,998::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:32,998::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:32,998::__init__::232::IOProcess::(_processLogs) (203287) Got request for method 'glob' >Thread-137905::DEBUG::2014-10-29 11:33:32,999::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:33:32,999::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203287) Queuing response >Thread-137905::INFO::2014-10-29 11:33:33,000::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137905::INFO::2014-10-29 11:33:33,001::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137905::INFO::2014-10-29 11:33:33,001::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:33:33,002::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:33,002::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:33,002::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:33,003::__init__::232::IOProcess::(_processLogs) (203288) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:33:33,004::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203288) Queuing response >Thread-137905::DEBUG::2014-10-29 11:33:33,004::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137905::DEBUG::2014-10-29 11:33:33,006::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`a5ab9ccc-232f-4a38-ba6f-48bbf637e832`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137905::DEBUG::2014-10-29 11:33:33,006::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137905::DEBUG::2014-10-29 11:33:33,007::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137905::DEBUG::2014-10-29 11:33:33,007::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`a5ab9ccc-232f-4a38-ba6f-48bbf637e832`::Granted request >Thread-137905::DEBUG::2014-10-29 11:33:33,008::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`61cf5119-49b4-4af5-8c56-6514bcd53004`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137905::DEBUG::2014-10-29 11:33:33,008::task::993::Storage.TaskManager.Task::(_decref) Task=`61cf5119-49b4-4af5-8c56-6514bcd53004`::ref 1 aborting False >Thread-137905::INFO::2014-10-29 11:33:33,011::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137905::DEBUG::2014-10-29 11:33:33,011::task::1191::Storage.TaskManager.Task::(prepare) Task=`61cf5119-49b4-4af5-8c56-6514bcd53004`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137905::DEBUG::2014-10-29 11:33:33,011::task::595::Storage.TaskManager.Task::(_updateState) Task=`61cf5119-49b4-4af5-8c56-6514bcd53004`::moving from state preparing -> state finished >Thread-137905::DEBUG::2014-10-29 11:33:33,012::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137905::DEBUG::2014-10-29 11:33:33,012::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137905::DEBUG::2014-10-29 11:33:33,012::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137905::DEBUG::2014-10-29 11:33:33,013::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137905::DEBUG::2014-10-29 11:33:33,013::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137905::DEBUG::2014-10-29 11:33:33,013::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137905::DEBUG::2014-10-29 11:33:33,013::task::993::Storage.TaskManager.Task::(_decref) Task=`61cf5119-49b4-4af5-8c56-6514bcd53004`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:33:33,034::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55083 >Detector thread::DEBUG::2014-10-29 11:33:33,035::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55083 >Detector thread::DEBUG::2014-10-29 11:33:33,035::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55083 >Detector thread::DEBUG::2014-10-29 11:33:33,036::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55083) >Thread-137910::DEBUG::2014-10-29 11:33:33,075::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137910::DEBUG::2014-10-29 11:33:33,076::task::595::Storage.TaskManager.Task::(_updateState) Task=`a68cbb8b-752f-407b-a514-edfc3e82a1a3`::moving from state init -> state preparing >Thread-137910::INFO::2014-10-29 11:33:33,076::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137910::INFO::2014-10-29 11:33:33,077::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538584', 'lastCheck': '1.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000451871', 'lastCheck': '1.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486136', 'lastCheck': '1.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00042767', 'lastCheck': '2.0', 'valid': True}} >Thread-137910::DEBUG::2014-10-29 11:33:33,077::task::1191::Storage.TaskManager.Task::(prepare) Task=`a68cbb8b-752f-407b-a514-edfc3e82a1a3`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538584', 'lastCheck': '1.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000451871', 'lastCheck': '1.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486136', 'lastCheck': '1.8', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00042767', 'lastCheck': '2.0', 'valid': True}} >Thread-137910::DEBUG::2014-10-29 11:33:33,077::task::595::Storage.TaskManager.Task::(_updateState) Task=`a68cbb8b-752f-407b-a514-edfc3e82a1a3`::moving from state preparing -> state finished >Thread-137910::DEBUG::2014-10-29 11:33:33,078::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137910::DEBUG::2014-10-29 11:33:33,078::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137910::DEBUG::2014-10-29 11:33:33,078::task::993::Storage.TaskManager.Task::(_decref) Task=`a68cbb8b-752f-407b-a514-edfc3e82a1a3`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:34,789::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:34,791::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137911::DEBUG::2014-10-29 11:33:34,794::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:34,796::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:34,798::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137912::DEBUG::2014-10-29 11:33:34,801::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137912::DEBUG::2014-10-29 11:33:34,803::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:33:35,215::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:37,585::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:37,586::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:37,588::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-22::DEBUG::2014-10-29 11:33:37,626::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:37,822::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:37,824::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137913::DEBUG::2014-10-29 11:33:37,828::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:37,830::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:37,832::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137914::DEBUG::2014-10-29 11:33:37,835::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137914::DEBUG::2014-10-29 11:33:37,837::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:33:40,685::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55084 >Detector thread::DEBUG::2014-10-29 11:33:40,686::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55084 >Detector thread::DEBUG::2014-10-29 11:33:40,687::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55084 >Detector thread::DEBUG::2014-10-29 11:33:40,687::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55084) >Thread-137915::DEBUG::2014-10-29 11:33:40,727::task::595::Storage.TaskManager.Task::(_updateState) Task=`28df55df-0ea0-4b78-b419-6d4a856f9d61`::moving from state init -> state preparing >Thread-137915::INFO::2014-10-29 11:33:40,727::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137915::INFO::2014-10-29 11:33:40,728::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538584', 'lastCheck': '8.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000451871', 'lastCheck': '8.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486136', 'lastCheck': '9.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00042767', 'lastCheck': '9.7', 'valid': True}} >Thread-137915::DEBUG::2014-10-29 11:33:40,728::task::1191::Storage.TaskManager.Task::(prepare) Task=`28df55df-0ea0-4b78-b419-6d4a856f9d61`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538584', 'lastCheck': '8.9', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000451871', 'lastCheck': '8.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486136', 'lastCheck': '9.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00042767', 'lastCheck': '9.7', 'valid': True}} >Thread-137915::DEBUG::2014-10-29 11:33:40,729::task::595::Storage.TaskManager.Task::(_updateState) Task=`28df55df-0ea0-4b78-b419-6d4a856f9d61`::moving from state preparing -> state finished >Thread-137915::DEBUG::2014-10-29 11:33:40,729::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137915::DEBUG::2014-10-29 11:33:40,729::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137915::DEBUG::2014-10-29 11:33:40,729::task::993::Storage.TaskManager.Task::(_decref) Task=`28df55df-0ea0-4b78-b419-6d4a856f9d61`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:33:40,809::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55085 >Detector thread::DEBUG::2014-10-29 11:33:40,810::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55085 >Detector thread::DEBUG::2014-10-29 11:33:40,810::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55085 >Detector thread::DEBUG::2014-10-29 11:33:40,810::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55085) >Thread-137916::DEBUG::2014-10-29 11:33:40,849::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137916::DEBUG::2014-10-29 11:33:40,851::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:40,852::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-137916::DEBUG::2014-10-29 11:33:40,856::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.03', 'elapsedTime': '515053', 'displayType': 'vnc', 'cpuSys': '1.07', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '3808877', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '83911', 'readRate': '0.00', 'truesize': '6010912768', 'writeRate': '40160.44'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.22', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpcServer::DEBUG::2014-10-29 11:33:40,861::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137917::DEBUG::2014-10-29 11:33:40,871::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:40,875::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:40,877::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137918::DEBUG::2014-10-29 11:33:40,881::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137918::DEBUG::2014-10-29 11:33:40,883::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:33:41,050::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:41,050::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:41,050::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:41,051::__init__::232::IOProcess::(_processLogs) (203289) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:41,051::__init__::232::IOProcess::(_processLogs) (203289) Queuing response >Thread-10269::DEBUG::2014-10-29 11:33:41,052::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:33:41,071::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000512745 s, 979 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:33:41,073::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:41,073::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:41,075::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:41,077::__init__::232::IOProcess::(_processLogs) (203290) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:41,077::__init__::232::IOProcess::(_processLogs) (203290) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:41,285::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:41,285::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:41,285::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:41,286::__init__::232::IOProcess::(_processLogs) (203291) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:41,287::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203291) Queuing response >Thread-179::DEBUG::2014-10-29 11:33:41,289::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:33:41,305::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000410522 s, 906 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:33:41,307::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:41,307::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:41,308::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:41,309::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203292) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:41,311::__init__::232::IOProcess::(_processLogs) (203292) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:41,819::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:41,819::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:41,819::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:41,820::__init__::232::IOProcess::(_processLogs) (203293) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:41,821::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203293) Queuing response >Thread-178::DEBUG::2014-10-29 11:33:41,823::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:33:41,840::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000494237 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:33:41,842::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:41,842::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:41,842::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:41,843::__init__::232::IOProcess::(_processLogs) (203294) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:41,844::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203294) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:41,846::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:41,847::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:41,847::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:41,848::__init__::232::IOProcess::(_processLogs) (203295) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:41,849::__init__::232::IOProcess::(_processLogs) (203295) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:41,849::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:41,850::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:41,850::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:41,851::__init__::232::IOProcess::(_processLogs) (203296) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:41,851::__init__::232::IOProcess::(_processLogs) (203296) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:41,852::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:41,852::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:41,853::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:41,854::__init__::232::IOProcess::(_processLogs) (203297) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:41,855::__init__::232::IOProcess::(_processLogs) (203297) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:41,961::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:41,962::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:41,963::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-33::DEBUG::2014-10-29 11:33:41,965::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:33:41,965::__init__::232::IOProcess::(_processLogs) (203298) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:41,983::__init__::232::IOProcess::(_processLogs) (203298) Queuing response >Thread-33::DEBUG::2014-10-29 11:33:41,985::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000596524 s, 816 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:33:41,986::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:41,987::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:41,988::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:41,990::__init__::232::IOProcess::(_processLogs) (203299) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:41,990::__init__::232::IOProcess::(_processLogs) (203299) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:41,991::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:41,991::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:41,992::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:41,992::__init__::232::IOProcess::(_processLogs) (203300) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:41,993::__init__::232::IOProcess::(_processLogs) (203300) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:41,993::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:41,994::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:41,995::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:41,995::__init__::232::IOProcess::(_processLogs) (203301) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:41,995::__init__::232::IOProcess::(_processLogs) (203301) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:41,996::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:41,996::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:41,997::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:41,997::__init__::232::IOProcess::(_processLogs) (203302) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:41,997::__init__::232::IOProcess::(_processLogs) (203302) Queuing response >Detector thread::DEBUG::2014-10-29 11:33:42,034::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55087 >Detector thread::DEBUG::2014-10-29 11:33:42,035::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55087 >Detector thread::DEBUG::2014-10-29 11:33:42,035::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55087 >Detector thread::DEBUG::2014-10-29 11:33:42,036::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55087) >Thread-137919::DEBUG::2014-10-29 11:33:42,075::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137919::DEBUG::2014-10-29 11:33:42,077::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137919::DEBUG::2014-10-29 11:33:42,097::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137919::DEBUG::2014-10-29 11:33:42,144::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '126', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '26', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:42,593::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:42,594::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:42,596::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:33:43,650::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55089 >Detector thread::DEBUG::2014-10-29 11:33:43,651::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55089 >Detector thread::DEBUG::2014-10-29 11:33:43,651::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55089 >Detector thread::DEBUG::2014-10-29 11:33:43,652::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55089) >Thread-137920::DEBUG::2014-10-29 11:33:43,691::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137920::DEBUG::2014-10-29 11:33:43,692::task::595::Storage.TaskManager.Task::(_updateState) Task=`a60c68af-3527-45fd-b838-2045c29af4d7`::moving from state init -> state preparing >Thread-137920::INFO::2014-10-29 11:33:43,692::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137920::DEBUG::2014-10-29 11:33:43,695::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:33:43,696::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:43,697::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:43,697::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:43,697::__init__::232::IOProcess::(_processLogs) (203303) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:43,698::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203303) Queuing response >Thread-137920::DEBUG::2014-10-29 11:33:43,699::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137920::DEBUG::2014-10-29 11:33:43,700::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137920::INFO::2014-10-29 11:33:43,700::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137920::DEBUG::2014-10-29 11:33:43,700::task::1191::Storage.TaskManager.Task::(prepare) Task=`a60c68af-3527-45fd-b838-2045c29af4d7`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137920::DEBUG::2014-10-29 11:33:43,701::task::595::Storage.TaskManager.Task::(_updateState) Task=`a60c68af-3527-45fd-b838-2045c29af4d7`::moving from state preparing -> state finished >Thread-137920::DEBUG::2014-10-29 11:33:43,701::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137920::DEBUG::2014-10-29 11:33:43,701::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137920::DEBUG::2014-10-29 11:33:43,701::task::993::Storage.TaskManager.Task::(_decref) Task=`a60c68af-3527-45fd-b838-2045c29af4d7`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:33:43,744::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55090 >Detector thread::DEBUG::2014-10-29 11:33:43,745::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55090 >Detector thread::DEBUG::2014-10-29 11:33:43,745::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55090 >Detector thread::DEBUG::2014-10-29 11:33:43,746::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55090) >Thread-137921::DEBUG::2014-10-29 11:33:43,785::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137921::DEBUG::2014-10-29 11:33:43,786::task::595::Storage.TaskManager.Task::(_updateState) Task=`b643263c-2c53-4f10-9a9c-4c231b2d25dc`::moving from state init -> state preparing >Thread-137921::INFO::2014-10-29 11:33:43,786::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137921::DEBUG::2014-10-29 11:33:43,786::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137921::DEBUG::2014-10-29 11:33:43,787::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137921::DEBUG::2014-10-29 11:33:43,787::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137921::DEBUG::2014-10-29 11:33:43,787::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137921::DEBUG::2014-10-29 11:33:43,787::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137921::DEBUG::2014-10-29 11:33:43,788::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137921::DEBUG::2014-10-29 11:33:43,880::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137921::DEBUG::2014-10-29 11:33:43,881::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:43,900::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:43,903::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137922::DEBUG::2014-10-29 11:33:43,907::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:43,909::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:43,911::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137923::DEBUG::2014-10-29 11:33:43,915::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137923::DEBUG::2014-10-29 11:33:43,918::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-137921::DEBUG::2014-10-29 11:33:44,050::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137921::DEBUG::2014-10-29 11:33:44,051::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137921::DEBUG::2014-10-29 11:33:44,052::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137921::DEBUG::2014-10-29 11:33:44,052::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137921::DEBUG::2014-10-29 11:33:44,052::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137921::DEBUG::2014-10-29 11:33:44,053::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137921::DEBUG::2014-10-29 11:33:44,053::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137921::DEBUG::2014-10-29 11:33:44,053::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:33:44,057::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:44,060::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:44,062::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:44,063::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203304) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:44,063::__init__::232::IOProcess::(_processLogs) (203304) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:44,064::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:44,065::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:44,065::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:44,066::__init__::232::IOProcess::(_processLogs) (203305) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:44,066::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203305) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:44,069::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:44,071::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:44,073::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:44,075::__init__::232::IOProcess::(_processLogs) (203306) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:44,079::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203306) Queuing response >Thread-137921::DEBUG::2014-10-29 11:33:44,081::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:33:44,083::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:44,084::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:44,085::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:44,085::__init__::232::IOProcess::(_processLogs) (203307) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:44,086::__init__::232::IOProcess::(_processLogs) (203307) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:44,086::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:44,086::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:44,087::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:44,087::__init__::232::IOProcess::(_processLogs) (203308) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:33:44,088::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203308) Queuing response >Thread-137921::DEBUG::2014-10-29 11:33:44,089::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:33:44,090::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:44,090::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:44,090::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:44,091::__init__::232::IOProcess::(_processLogs) (203309) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:33:44,092::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203309) Queuing response >Thread-137921::DEBUG::2014-10-29 11:33:44,092::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:33:44,094::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:44,095::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:44,095::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:44,096::__init__::232::IOProcess::(_processLogs) (203310) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:44,096::__init__::232::IOProcess::(_processLogs) (203310) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:44,096::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:44,097::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-137921::DEBUG::2014-10-29 11:33:44,097::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-137921::INFO::2014-10-29 11:33:44,099::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-17::DEBUG::2014-10-29 11:33:44,099::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-137921::INFO::2014-10-29 11:33:44,100::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:33:44,100::__init__::232::IOProcess::(_processLogs) (203311) Got request for method 'glob' >Thread-137921::INFO::2014-10-29 11:33:44,101::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:33:44,102::__init__::232::IOProcess::(_processLogs) (203311) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:44,104::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:44,104::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:44,104::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:44,104::__init__::232::IOProcess::(_processLogs) (203312) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:33:44,105::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203312) Queuing response >Thread-137921::DEBUG::2014-10-29 11:33:44,105::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137921::DEBUG::2014-10-29 11:33:44,108::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`c0406c11-70eb-4bf8-8d33-720efe428fe6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137921::DEBUG::2014-10-29 11:33:44,108::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137921::DEBUG::2014-10-29 11:33:44,108::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137921::DEBUG::2014-10-29 11:33:44,109::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`c0406c11-70eb-4bf8-8d33-720efe428fe6`::Granted request >Thread-137921::DEBUG::2014-10-29 11:33:44,109::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b643263c-2c53-4f10-9a9c-4c231b2d25dc`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137921::DEBUG::2014-10-29 11:33:44,110::task::993::Storage.TaskManager.Task::(_decref) Task=`b643263c-2c53-4f10-9a9c-4c231b2d25dc`::ref 1 aborting False >Thread-137921::INFO::2014-10-29 11:33:44,112::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137921::DEBUG::2014-10-29 11:33:44,113::task::1191::Storage.TaskManager.Task::(prepare) Task=`b643263c-2c53-4f10-9a9c-4c231b2d25dc`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137921::DEBUG::2014-10-29 11:33:44,113::task::595::Storage.TaskManager.Task::(_updateState) Task=`b643263c-2c53-4f10-9a9c-4c231b2d25dc`::moving from state preparing -> state finished >Thread-137921::DEBUG::2014-10-29 11:33:44,113::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137921::DEBUG::2014-10-29 11:33:44,113::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137921::DEBUG::2014-10-29 11:33:44,114::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137921::DEBUG::2014-10-29 11:33:44,114::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137921::DEBUG::2014-10-29 11:33:44,115::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137921::DEBUG::2014-10-29 11:33:44,115::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137921::DEBUG::2014-10-29 11:33:44,115::task::993::Storage.TaskManager.Task::(_decref) Task=`b643263c-2c53-4f10-9a9c-4c231b2d25dc`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:33:44,137::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55091 >Detector thread::DEBUG::2014-10-29 11:33:44,138::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55091 >Detector thread::DEBUG::2014-10-29 11:33:44,139::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55091 >Detector thread::DEBUG::2014-10-29 11:33:44,139::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55091) >Thread-137928::DEBUG::2014-10-29 11:33:44,178::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137928::DEBUG::2014-10-29 11:33:44,179::task::595::Storage.TaskManager.Task::(_updateState) Task=`cecf8551-481e-4a31-b839-c48250ca7067`::moving from state init -> state preparing >Thread-137928::INFO::2014-10-29 11:33:44,179::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137928::INFO::2014-10-29 11:33:44,180::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494237', 'lastCheck': '2.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596524', 'lastCheck': '2.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410522', 'lastCheck': '2.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000512745', 'lastCheck': '3.1', 'valid': True}} >Thread-137928::DEBUG::2014-10-29 11:33:44,180::task::1191::Storage.TaskManager.Task::(prepare) Task=`cecf8551-481e-4a31-b839-c48250ca7067`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494237', 'lastCheck': '2.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596524', 'lastCheck': '2.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410522', 'lastCheck': '2.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000512745', 'lastCheck': '3.1', 'valid': True}} >Thread-137928::DEBUG::2014-10-29 11:33:44,180::task::595::Storage.TaskManager.Task::(_updateState) Task=`cecf8551-481e-4a31-b839-c48250ca7067`::moving from state preparing -> state finished >Thread-137928::DEBUG::2014-10-29 11:33:44,180::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137928::DEBUG::2014-10-29 11:33:44,181::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137928::DEBUG::2014-10-29 11:33:44,181::task::993::Storage.TaskManager.Task::(_decref) Task=`cecf8551-481e-4a31-b839-c48250ca7067`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:46,944::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:46,950::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137929::DEBUG::2014-10-29 11:33:46,960::task::595::Storage.TaskManager.Task::(_updateState) Task=`07f4c8fe-689a-4552-92b3-1d7a7623e919`::moving from state init -> state preparing >Thread-137929::INFO::2014-10-29 11:33:46,961::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137929::INFO::2014-10-29 11:33:46,964::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494237', 'lastCheck': '5.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596524', 'lastCheck': '5.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410522', 'lastCheck': '5.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000512745', 'lastCheck': '5.9', 'valid': True}} >Thread-137929::DEBUG::2014-10-29 11:33:46,966::task::1191::Storage.TaskManager.Task::(prepare) Task=`07f4c8fe-689a-4552-92b3-1d7a7623e919`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494237', 'lastCheck': '5.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596524', 'lastCheck': '5.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410522', 'lastCheck': '5.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000512745', 'lastCheck': '5.9', 'valid': True}} >Thread-137929::DEBUG::2014-10-29 11:33:46,967::task::595::Storage.TaskManager.Task::(_updateState) Task=`07f4c8fe-689a-4552-92b3-1d7a7623e919`::moving from state preparing -> state finished >Thread-137929::DEBUG::2014-10-29 11:33:46,968::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137929::DEBUG::2014-10-29 11:33:46,969::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137929::DEBUG::2014-10-29 11:33:46,970::task::993::Storage.TaskManager.Task::(_decref) Task=`07f4c8fe-689a-4552-92b3-1d7a7623e919`::ref 0 aborting False >Thread-137929::DEBUG::2014-10-29 11:33:47,051::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:47,075::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:47,077::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137930::DEBUG::2014-10-29 11:33:47,080::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137930::DEBUG::2014-10-29 11:33:47,082::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:47,603::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:47,604::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:47,607::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:50,153::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:50,155::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137931::DEBUG::2014-10-29 11:33:50,159::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:50,161::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:50,163::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137932::DEBUG::2014-10-29 11:33:50,166::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137932::DEBUG::2014-10-29 11:33:50,168::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:33:50,791::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55092 >Detector thread::DEBUG::2014-10-29 11:33:50,791::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55092 >Detector thread::DEBUG::2014-10-29 11:33:50,792::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55092 >Detector thread::DEBUG::2014-10-29 11:33:50,792::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55092) >Thread-137933::DEBUG::2014-10-29 11:33:50,832::task::595::Storage.TaskManager.Task::(_updateState) Task=`78ffea17-cc3f-4c61-89bb-7f0f141d5730`::moving from state init -> state preparing >Thread-137933::INFO::2014-10-29 11:33:50,832::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137933::INFO::2014-10-29 11:33:50,833::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494237', 'lastCheck': '9.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596524', 'lastCheck': '8.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410522', 'lastCheck': '9.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000512745', 'lastCheck': '9.8', 'valid': True}} >Thread-137933::DEBUG::2014-10-29 11:33:50,833::task::1191::Storage.TaskManager.Task::(prepare) Task=`78ffea17-cc3f-4c61-89bb-7f0f141d5730`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000494237', 'lastCheck': '9.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596524', 'lastCheck': '8.8', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410522', 'lastCheck': '9.5', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000512745', 'lastCheck': '9.8', 'valid': True}} >Thread-137933::DEBUG::2014-10-29 11:33:50,833::task::595::Storage.TaskManager.Task::(_updateState) Task=`78ffea17-cc3f-4c61-89bb-7f0f141d5730`::moving from state preparing -> state finished >Thread-137933::DEBUG::2014-10-29 11:33:50,834::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137933::DEBUG::2014-10-29 11:33:50,834::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137933::DEBUG::2014-10-29 11:33:50,834::task::993::Storage.TaskManager.Task::(_decref) Task=`78ffea17-cc3f-4c61-89bb-7f0f141d5730`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:33:51,019::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55093 >Detector thread::DEBUG::2014-10-29 11:33:51,020::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55093 >Detector thread::DEBUG::2014-10-29 11:33:51,020::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55093 >Detector thread::DEBUG::2014-10-29 11:33:51,021::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55093) >Thread-137934::DEBUG::2014-10-29 11:33:51,059::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137934::DEBUG::2014-10-29 11:33:51,060::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137934::DEBUG::2014-10-29 11:33:51,061::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.03', 'elapsedTime': '515063', 'displayType': 'vnc', 'cpuSys': '1.07', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '3808877', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '83911', 'readRate': '0.00', 'truesize': '6010912768', 'writeRate': '40160.44'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.43', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-17::DEBUG::2014-10-29 11:33:51,078::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:51,078::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:51,078::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:51,079::__init__::232::IOProcess::(_processLogs) (203313) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:51,080::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203313) Queuing response >Thread-10269::DEBUG::2014-10-29 11:33:51,080::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:33:51,098::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000502245 s, 1000 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:33:51,100::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:51,101::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:51,101::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:51,101::__init__::232::IOProcess::(_processLogs) (203314) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:51,103::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203314) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:51,313::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:51,314::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:51,314::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:51,314::__init__::232::IOProcess::(_processLogs) (203315) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:51,316::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203315) Queuing response >Thread-179::DEBUG::2014-10-29 11:33:51,317::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:33:51,335::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000809722 s, 459 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:33:51,337::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:51,337::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:51,337::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:51,338::__init__::232::IOProcess::(_processLogs) (203316) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:51,339::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203316) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:51,856::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:51,856::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:51,856::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:51,857::__init__::232::IOProcess::(_processLogs) (203317) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:51,858::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203317) Queuing response >Thread-178::DEBUG::2014-10-29 11:33:51,859::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:33:51,877::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000489989 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:33:51,879::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:51,879::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:51,879::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:51,880::__init__::232::IOProcess::(_processLogs) (203318) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:51,880::__init__::232::IOProcess::(_processLogs) (203318) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:51,882::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:51,882::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:51,883::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:51,883::__init__::232::IOProcess::(_processLogs) (203319) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:51,884::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203319) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:51,885::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:51,886::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:51,887::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:51,887::__init__::232::IOProcess::(_processLogs) (203320) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:51,888::__init__::232::IOProcess::(_processLogs) (203320) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:51,888::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:51,888::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:51,889::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:51,890::__init__::232::IOProcess::(_processLogs) (203321) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:51,891::__init__::232::IOProcess::(_processLogs) (203321) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:51,999::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:52,000::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:52,000::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:52,000::__init__::232::IOProcess::(_processLogs) (203322) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:52,002::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203322) Queuing response >Thread-33::DEBUG::2014-10-29 11:33:52,003::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:33:52,020::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000486868 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:33:52,022::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:52,022::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:52,024::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:52,025::__init__::232::IOProcess::(_processLogs) (203323) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:33:52,025::__init__::232::IOProcess::(_processLogs) (203323) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:52,026::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:52,027::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:52,028::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:52,028::__init__::232::IOProcess::(_processLogs) (203324) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:52,028::__init__::232::IOProcess::(_processLogs) (203324) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:52,029::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:52,030::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:52,030::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:52,030::__init__::232::IOProcess::(_processLogs) (203325) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:52,031::__init__::232::IOProcess::(_processLogs) (203325) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:52,031::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:52,032::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:52,033::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:52,034::__init__::232::IOProcess::(_processLogs) (203326) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:52,034::__init__::232::IOProcess::(_processLogs) (203326) Queuing response >Detector thread::DEBUG::2014-10-29 11:33:52,188::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55095 >Detector thread::DEBUG::2014-10-29 11:33:52,189::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55095 >Detector thread::DEBUG::2014-10-29 11:33:52,189::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55095 >Detector thread::DEBUG::2014-10-29 11:33:52,190::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55095) >Thread-137935::DEBUG::2014-10-29 11:33:52,228::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137935::DEBUG::2014-10-29 11:33:52,230::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137935::DEBUG::2014-10-29 11:33:52,250::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137935::DEBUG::2014-10-29 11:33:52,296::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '111', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '11', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:52,615::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:52,616::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:52,618::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-22::DEBUG::2014-10-29 11:33:52,631::task::595::Storage.TaskManager.Task::(_updateState) Task=`dec819df-3160-415f-ba7a-80d827bee63a`::moving from state init -> state preparing >Thread-22::INFO::2014-10-29 11:33:52,631::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='b11dd682-40ca-4fc0-9a0b-a66235206ecb', volUUID='ee6d6a47-55dc-4e65-b901-8cc6c64438ca', options=None) >Thread-17::DEBUG::2014-10-29 11:33:52,633::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:52,633::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:52,634::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:52,634::__init__::232::IOProcess::(_processLogs) (203327) Got request for method 'stat' >Thread-17::DEBUG::2014-10-29 11:33:52,634::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203327) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:52,636::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:52,638::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-22::INFO::2014-10-29 11:33:52,638::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6010929152', 'apparentsize': '26843545600'} >Thread-17::DEBUG::2014-10-29 11:33:52,639::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-22::DEBUG::2014-10-29 11:33:52,639::task::1191::Storage.TaskManager.Task::(prepare) Task=`dec819df-3160-415f-ba7a-80d827bee63a`::finished: {'truesize': '6010929152', 'apparentsize': '26843545600'} >Thread-22::DEBUG::2014-10-29 11:33:52,641::task::595::Storage.TaskManager.Task::(_updateState) Task=`dec819df-3160-415f-ba7a-80d827bee63a`::moving from state preparing -> state finished >Thread-22::DEBUG::2014-10-29 11:33:52,641::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17::DEBUG::2014-10-29 11:33:52,641::__init__::232::IOProcess::(_processLogs) (203328) Got request for method 'stat' >Thread-22::DEBUG::2014-10-29 11:33:52,642::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17::DEBUG::2014-10-29 11:33:52,643::__init__::232::IOProcess::(_processLogs) (203328) Queuing response >Thread-22::DEBUG::2014-10-29 11:33:52,643::task::993::Storage.TaskManager.Task::(_decref) Task=`dec819df-3160-415f-ba7a-80d827bee63a`::ref 0 aborting False >Thread-22::DEBUG::2014-10-29 11:33:52,717::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:53,203::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:53,206::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137936::DEBUG::2014-10-29 11:33:53,209::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:53,212::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:53,214::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137937::DEBUG::2014-10-29 11:33:53,217::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137937::DEBUG::2014-10-29 11:33:53,219::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:33:54,762::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55097 >Detector thread::DEBUG::2014-10-29 11:33:54,765::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55097 >Detector thread::DEBUG::2014-10-29 11:33:54,766::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55097 >Detector thread::DEBUG::2014-10-29 11:33:54,766::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55097) >Thread-137938::DEBUG::2014-10-29 11:33:54,803::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137938::DEBUG::2014-10-29 11:33:54,803::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ec164ee-324b-441a-b69e-00b67f9faf9d`::moving from state init -> state preparing >Thread-137938::INFO::2014-10-29 11:33:54,804::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137938::DEBUG::2014-10-29 11:33:54,811::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:33:54,812::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:54,812::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:54,812::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:54,812::__init__::232::IOProcess::(_processLogs) (203329) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:54,813::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203329) Queuing response >Thread-137938::DEBUG::2014-10-29 11:33:54,814::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137938::DEBUG::2014-10-29 11:33:54,815::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137938::INFO::2014-10-29 11:33:54,815::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137938::DEBUG::2014-10-29 11:33:54,815::task::1191::Storage.TaskManager.Task::(prepare) Task=`2ec164ee-324b-441a-b69e-00b67f9faf9d`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137938::DEBUG::2014-10-29 11:33:54,816::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ec164ee-324b-441a-b69e-00b67f9faf9d`::moving from state preparing -> state finished >Thread-137938::DEBUG::2014-10-29 11:33:54,816::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137938::DEBUG::2014-10-29 11:33:54,816::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137938::DEBUG::2014-10-29 11:33:54,816::task::993::Storage.TaskManager.Task::(_decref) Task=`2ec164ee-324b-441a-b69e-00b67f9faf9d`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:33:54,860::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55098 >Detector thread::DEBUG::2014-10-29 11:33:54,860::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55098 >Detector thread::DEBUG::2014-10-29 11:33:54,860::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55098 >Detector thread::DEBUG::2014-10-29 11:33:54,861::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55098) >Thread-137939::DEBUG::2014-10-29 11:33:54,900::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137939::DEBUG::2014-10-29 11:33:54,900::task::595::Storage.TaskManager.Task::(_updateState) Task=`686964d5-327f-4ea4-9fef-b1b49a3cd100`::moving from state init -> state preparing >Thread-137939::INFO::2014-10-29 11:33:54,901::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137939::DEBUG::2014-10-29 11:33:54,901::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137939::DEBUG::2014-10-29 11:33:54,901::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137939::DEBUG::2014-10-29 11:33:54,902::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137939::DEBUG::2014-10-29 11:33:54,902::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137939::DEBUG::2014-10-29 11:33:54,902::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137939::DEBUG::2014-10-29 11:33:54,903::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137939::DEBUG::2014-10-29 11:33:55,001::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137939::DEBUG::2014-10-29 11:33:55,002::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137939::DEBUG::2014-10-29 11:33:55,185::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137939::DEBUG::2014-10-29 11:33:55,186::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137939::DEBUG::2014-10-29 11:33:55,187::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137939::DEBUG::2014-10-29 11:33:55,187::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137939::DEBUG::2014-10-29 11:33:55,187::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137939::DEBUG::2014-10-29 11:33:55,188::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137939::DEBUG::2014-10-29 11:33:55,188::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137939::DEBUG::2014-10-29 11:33:55,189::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:33:55,196::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:55,199::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:55,199::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:55,199::__init__::232::IOProcess::(_processLogs) (203330) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:55,200::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203330) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:55,202::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:55,202::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:55,202::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:55,202::__init__::232::IOProcess::(_processLogs) (203331) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:55,203::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203331) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:55,205::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:55,207::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:55,208::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:55,210::__init__::232::IOProcess::(_processLogs) (203332) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:55,214::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203332) Queuing response >Thread-137939::DEBUG::2014-10-29 11:33:55,216::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:33:55,218::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:55,219::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:55,219::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:55,220::__init__::232::IOProcess::(_processLogs) (203333) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:33:55,220::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203333) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:55,222::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:55,222::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:55,222::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:55,223::__init__::232::IOProcess::(_processLogs) (203334) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:33:55,224::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203334) Queuing response >Thread-137939::DEBUG::2014-10-29 11:33:55,224::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:33:55,226::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:55,227::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:55,227::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:55,227::__init__::232::IOProcess::(_processLogs) (203335) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:33:55,228::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203335) Queuing response >Thread-137939::DEBUG::2014-10-29 11:33:55,228::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:33:55,230::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:55,231::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:55,232::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:55,232::__init__::232::IOProcess::(_processLogs) (203336) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:33:55,233::__init__::232::IOProcess::(_processLogs) (203336) Queuing response >Thread-17::DEBUG::2014-10-29 11:33:55,233::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:55,233::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:55,234::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:55,234::__init__::232::IOProcess::(_processLogs) (203337) Got request for method 'glob' >Thread-137939::DEBUG::2014-10-29 11:33:55,235::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:33:55,235::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203337) Queuing response >Thread-137939::INFO::2014-10-29 11:33:55,236::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137939::INFO::2014-10-29 11:33:55,237::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137939::INFO::2014-10-29 11:33:55,237::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:33:55,238::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:33:55,238::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:33:55,238::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:33:55,239::__init__::232::IOProcess::(_processLogs) (203338) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:33:55,239::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203338) Queuing response >Thread-137939::DEBUG::2014-10-29 11:33:55,240::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137939::DEBUG::2014-10-29 11:33:55,242::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`e93289bc-af6b-4f22-833a-0821f836d1a7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137939::DEBUG::2014-10-29 11:33:55,242::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137939::DEBUG::2014-10-29 11:33:55,243::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137939::DEBUG::2014-10-29 11:33:55,243::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`e93289bc-af6b-4f22-833a-0821f836d1a7`::Granted request >Thread-137939::DEBUG::2014-10-29 11:33:55,243::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`686964d5-327f-4ea4-9fef-b1b49a3cd100`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137939::DEBUG::2014-10-29 11:33:55,244::task::993::Storage.TaskManager.Task::(_decref) Task=`686964d5-327f-4ea4-9fef-b1b49a3cd100`::ref 1 aborting False >Thread-137939::INFO::2014-10-29 11:33:55,246::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137939::DEBUG::2014-10-29 11:33:55,247::task::1191::Storage.TaskManager.Task::(prepare) Task=`686964d5-327f-4ea4-9fef-b1b49a3cd100`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137939::DEBUG::2014-10-29 11:33:55,247::task::595::Storage.TaskManager.Task::(_updateState) Task=`686964d5-327f-4ea4-9fef-b1b49a3cd100`::moving from state preparing -> state finished >Thread-137939::DEBUG::2014-10-29 11:33:55,247::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137939::DEBUG::2014-10-29 11:33:55,248::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137939::DEBUG::2014-10-29 11:33:55,248::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137939::DEBUG::2014-10-29 11:33:55,248::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137939::DEBUG::2014-10-29 11:33:55,248::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137939::DEBUG::2014-10-29 11:33:55,249::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137939::DEBUG::2014-10-29 11:33:55,250::task::993::Storage.TaskManager.Task::(_decref) Task=`686964d5-327f-4ea4-9fef-b1b49a3cd100`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:33:55,271::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55099 >Detector thread::DEBUG::2014-10-29 11:33:55,272::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55099 >Detector thread::DEBUG::2014-10-29 11:33:55,272::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55099 >Detector thread::DEBUG::2014-10-29 11:33:55,272::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55099) >Thread-137944::DEBUG::2014-10-29 11:33:55,311::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137944::DEBUG::2014-10-29 11:33:55,311::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc14aca0-4e41-4606-a602-d91e311f3108`::moving from state init -> state preparing >Thread-137944::INFO::2014-10-29 11:33:55,312::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137944::INFO::2014-10-29 11:33:55,312::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489989', 'lastCheck': '3.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486868', 'lastCheck': '3.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000809722', 'lastCheck': '4.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000502245', 'lastCheck': '4.2', 'valid': True}} >Thread-137944::DEBUG::2014-10-29 11:33:55,313::task::1191::Storage.TaskManager.Task::(prepare) Task=`dc14aca0-4e41-4606-a602-d91e311f3108`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489989', 'lastCheck': '3.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486868', 'lastCheck': '3.3', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000809722', 'lastCheck': '4.0', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000502245', 'lastCheck': '4.2', 'valid': True}} >Thread-137944::DEBUG::2014-10-29 11:33:55,313::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc14aca0-4e41-4606-a602-d91e311f3108`::moving from state preparing -> state finished >Thread-137944::DEBUG::2014-10-29 11:33:55,313::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137944::DEBUG::2014-10-29 11:33:55,314::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137944::DEBUG::2014-10-29 11:33:55,314::task::993::Storage.TaskManager.Task::(_decref) Task=`dc14aca0-4e41-4606-a602-d91e311f3108`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:56,233::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:56,235::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137945::DEBUG::2014-10-29 11:33:56,238::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:56,240::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:56,242::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137946::DEBUG::2014-10-29 11:33:56,245::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137946::DEBUG::2014-10-29 11:33:56,248::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:57,625::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:57,627::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:33:57,630::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:59,265::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:59,267::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137947::DEBUG::2014-10-29 11:33:59,270::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:33:59,272::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:33:59,274::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137948::DEBUG::2014-10-29 11:33:59,277::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137948::DEBUG::2014-10-29 11:33:59,279::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:34:00,896::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55100 >Detector thread::DEBUG::2014-10-29 11:34:00,897::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55100 >Detector thread::DEBUG::2014-10-29 11:34:00,897::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55100 >Detector thread::DEBUG::2014-10-29 11:34:00,898::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55100) >Thread-137949::DEBUG::2014-10-29 11:34:00,937::task::595::Storage.TaskManager.Task::(_updateState) Task=`267db62f-2de6-459b-83df-f03a57abe047`::moving from state init -> state preparing >Thread-137949::INFO::2014-10-29 11:34:00,937::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137949::INFO::2014-10-29 11:34:00,938::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489989', 'lastCheck': '9.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486868', 'lastCheck': '8.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000809722', 'lastCheck': '9.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000502245', 'lastCheck': '9.8', 'valid': True}} >Thread-137949::DEBUG::2014-10-29 11:34:00,938::task::1191::Storage.TaskManager.Task::(prepare) Task=`267db62f-2de6-459b-83df-f03a57abe047`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000489989', 'lastCheck': '9.0', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000486868', 'lastCheck': '8.9', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000809722', 'lastCheck': '9.6', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000502245', 'lastCheck': '9.8', 'valid': True}} >Thread-137949::DEBUG::2014-10-29 11:34:00,939::task::595::Storage.TaskManager.Task::(_updateState) Task=`267db62f-2de6-459b-83df-f03a57abe047`::moving from state preparing -> state finished >Thread-137949::DEBUG::2014-10-29 11:34:00,939::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137949::DEBUG::2014-10-29 11:34:00,939::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137949::DEBUG::2014-10-29 11:34:00,939::task::993::Storage.TaskManager.Task::(_decref) Task=`267db62f-2de6-459b-83df-f03a57abe047`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:34:01,106::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:01,106::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:01,107::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:01,107::__init__::232::IOProcess::(_processLogs) (203339) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:01,108::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203339) Queuing response >Thread-10269::DEBUG::2014-10-29 11:34:01,110::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:34:01,127::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000492737 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:34:01,129::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:01,129::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:01,129::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:01,130::__init__::232::IOProcess::(_processLogs) (203340) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:01,131::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203340) Queuing response >Detector thread::DEBUG::2014-10-29 11:34:01,215::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55101 >Detector thread::DEBUG::2014-10-29 11:34:01,215::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55101 >Detector thread::DEBUG::2014-10-29 11:34:01,215::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55101 >Detector thread::DEBUG::2014-10-29 11:34:01,216::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55101) >Thread-137950::DEBUG::2014-10-29 11:34:01,255::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137950::DEBUG::2014-10-29 11:34:01,257::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137950::DEBUG::2014-10-29 11:34:01,258::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.72', 'elapsedTime': '515073', 'displayType': 'vnc', 'cpuSys': '0.66', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '2872789', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '56315', 'readRate': '0.00', 'truesize': '6010929152', 'writeRate': '35405.51'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.54', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-17::DEBUG::2014-10-29 11:34:01,342::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:01,342::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:01,344::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:01,344::__init__::232::IOProcess::(_processLogs) (203341) Got request for method 'statvfs' >Detector thread::DEBUG::2014-10-29 11:34:01,345::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55102 >Thread-17::DEBUG::2014-10-29 11:34:01,348::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203341) Queuing response >Detector thread::DEBUG::2014-10-29 11:34:01,349::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55102 >Thread-179::DEBUG::2014-10-29 11:34:01,351::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Detector thread::DEBUG::2014-10-29 11:34:01,351::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55102 >Detector thread::DEBUG::2014-10-29 11:34:01,371::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55102) >Thread-179::DEBUG::2014-10-29 11:34:01,375::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000860082 s, 433 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:34:01,380::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:01,381::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:01,383::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:01,384::__init__::232::IOProcess::(_processLogs) (203342) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:01,384::__init__::232::IOProcess::(_processLogs) (203342) Queuing response >Thread-137951::DEBUG::2014-10-29 11:34:01,387::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137951::DEBUG::2014-10-29 11:34:01,390::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137951::DEBUG::2014-10-29 11:34:01,409::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137951::DEBUG::2014-10-29 11:34:01,454::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '195', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '95', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-17::DEBUG::2014-10-29 11:34:01,892::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:01,892::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:01,894::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:01,896::__init__::232::IOProcess::(_processLogs) (203343) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:34:01,896::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:34:01,897::__init__::232::IOProcess::(_processLogs) (203343) Queuing response >Thread-178::DEBUG::2014-10-29 11:34:01,915::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000505546 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:34:01,917::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:01,917::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:01,918::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:01,918::__init__::232::IOProcess::(_processLogs) (203344) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:01,920::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203344) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:01,921::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:01,921::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:01,922::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:01,922::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203345) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:01,923::__init__::232::IOProcess::(_processLogs) (203345) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:01,924::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:01,924::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:01,924::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:01,925::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203346) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:01,926::__init__::232::IOProcess::(_processLogs) (203346) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:01,926::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:01,927::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:01,927::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:01,928::__init__::232::IOProcess::(_processLogs) (203347) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:01,929::__init__::232::IOProcess::(_processLogs) (203347) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:02,034::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:02,034::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:02,036::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:02,037::__init__::232::IOProcess::(_processLogs) (203348) Got request for method 'statvfs' >Thread-33::DEBUG::2014-10-29 11:34:02,037::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:34:02,039::__init__::232::IOProcess::(_processLogs) (203348) Queuing response >Thread-33::DEBUG::2014-10-29 11:34:02,056::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000503171 s, 968 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:34:02,058::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:02,058::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:02,060::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:02,061::__init__::232::IOProcess::(_processLogs) (203349) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:02,061::__init__::232::IOProcess::(_processLogs) (203349) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:02,062::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:02,062::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:02,063::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:02,064::__init__::232::IOProcess::(_processLogs) (203350) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:02,064::__init__::232::IOProcess::(_processLogs) (203350) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:02,065::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:02,065::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:02,065::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:02,065::__init__::232::IOProcess::(_processLogs) (203351) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:02,066::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203351) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:02,067::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:02,067::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:02,068::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:02,068::__init__::232::IOProcess::(_processLogs) (203352) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:02,069::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203352) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:02,295::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:34:02,297::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137952::DEBUG::2014-10-29 11:34:02,302::task::595::Storage.TaskManager.Task::(_updateState) Task=`bcd572db-3e4b-4886-9d76-92759fb82602`::moving from state init -> state preparing >Thread-137952::INFO::2014-10-29 11:34:02,302::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137952::INFO::2014-10-29 11:34:02,303::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505546', 'lastCheck': '0.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503171', 'lastCheck': '0.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000860082', 'lastCheck': '0.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492737', 'lastCheck': '1.2', 'valid': True}} >Thread-137952::DEBUG::2014-10-29 11:34:02,303::task::1191::Storage.TaskManager.Task::(prepare) Task=`bcd572db-3e4b-4886-9d76-92759fb82602`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505546', 'lastCheck': '0.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503171', 'lastCheck': '0.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000860082', 'lastCheck': '0.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492737', 'lastCheck': '1.2', 'valid': True}} >Thread-137952::DEBUG::2014-10-29 11:34:02,303::task::595::Storage.TaskManager.Task::(_updateState) Task=`bcd572db-3e4b-4886-9d76-92759fb82602`::moving from state preparing -> state finished >Thread-137952::DEBUG::2014-10-29 11:34:02,304::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137952::DEBUG::2014-10-29 11:34:02,304::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137952::DEBUG::2014-10-29 11:34:02,304::task::993::Storage.TaskManager.Task::(_decref) Task=`bcd572db-3e4b-4886-9d76-92759fb82602`::ref 0 aborting False >Thread-137952::DEBUG::2014-10-29 11:34:02,325::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:02,348::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:34:02,350::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137953::DEBUG::2014-10-29 11:34:02,353::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137953::DEBUG::2014-10-29 11:34:02,355::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:02,637::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:02,639::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:02,642::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-10-29 11:34:05,260::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:05,438::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:34:05,441::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137954::DEBUG::2014-10-29 11:34:05,446::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:05,448::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:34:05,450::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137955::DEBUG::2014-10-29 11:34:05,454::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137955::DEBUG::2014-10-29 11:34:05,456::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:34:05,916::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55105 >Detector thread::DEBUG::2014-10-29 11:34:05,916::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55105 >Detector thread::DEBUG::2014-10-29 11:34:05,917::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55105 >Detector thread::DEBUG::2014-10-29 11:34:05,917::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55105) >Thread-137956::DEBUG::2014-10-29 11:34:05,957::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137956::DEBUG::2014-10-29 11:34:05,958::task::595::Storage.TaskManager.Task::(_updateState) Task=`176ea46b-72ac-4c5d-9a30-9c48742f9ae4`::moving from state init -> state preparing >Thread-137956::INFO::2014-10-29 11:34:05,959::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137956::DEBUG::2014-10-29 11:34:05,961::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:34:05,962::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:05,963::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:05,963::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:05,963::__init__::232::IOProcess::(_processLogs) (203353) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:34:05,965::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203353) Queuing response >Thread-137956::DEBUG::2014-10-29 11:34:05,966::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137956::DEBUG::2014-10-29 11:34:05,966::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137956::INFO::2014-10-29 11:34:05,966::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137956::DEBUG::2014-10-29 11:34:05,967::task::1191::Storage.TaskManager.Task::(prepare) Task=`176ea46b-72ac-4c5d-9a30-9c48742f9ae4`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137956::DEBUG::2014-10-29 11:34:05,967::task::595::Storage.TaskManager.Task::(_updateState) Task=`176ea46b-72ac-4c5d-9a30-9c48742f9ae4`::moving from state preparing -> state finished >Thread-137956::DEBUG::2014-10-29 11:34:05,967::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137956::DEBUG::2014-10-29 11:34:05,967::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137956::DEBUG::2014-10-29 11:34:05,968::task::993::Storage.TaskManager.Task::(_decref) Task=`176ea46b-72ac-4c5d-9a30-9c48742f9ae4`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:34:06,011::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55106 >Detector thread::DEBUG::2014-10-29 11:34:06,011::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55106 >Detector thread::DEBUG::2014-10-29 11:34:06,012::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55106 >Detector thread::DEBUG::2014-10-29 11:34:06,012::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55106) >Thread-137957::DEBUG::2014-10-29 11:34:06,051::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137957::DEBUG::2014-10-29 11:34:06,052::task::595::Storage.TaskManager.Task::(_updateState) Task=`a87eab90-6f93-415b-b606-8b670588b014`::moving from state init -> state preparing >Thread-137957::INFO::2014-10-29 11:34:06,052::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137957::DEBUG::2014-10-29 11:34:06,052::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137957::DEBUG::2014-10-29 11:34:06,053::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137957::DEBUG::2014-10-29 11:34:06,053::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137957::DEBUG::2014-10-29 11:34:06,053::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137957::DEBUG::2014-10-29 11:34:06,053::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137957::DEBUG::2014-10-29 11:34:06,054::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137957::DEBUG::2014-10-29 11:34:06,146::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137957::DEBUG::2014-10-29 11:34:06,147::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137957::DEBUG::2014-10-29 11:34:06,323::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137957::DEBUG::2014-10-29 11:34:06,324::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137957::DEBUG::2014-10-29 11:34:06,324::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137957::DEBUG::2014-10-29 11:34:06,324::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137957::DEBUG::2014-10-29 11:34:06,325::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137957::DEBUG::2014-10-29 11:34:06,325::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137957::DEBUG::2014-10-29 11:34:06,325::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137957::DEBUG::2014-10-29 11:34:06,326::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:34:06,333::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:06,335::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:06,335::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:06,336::__init__::232::IOProcess::(_processLogs) (203354) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:34:06,337::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203354) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:06,341::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:06,342::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:06,344::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:06,346::__init__::232::IOProcess::(_processLogs) (203355) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:34:06,347::__init__::232::IOProcess::(_processLogs) (203355) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:06,349::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:06,351::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:06,353::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-137957::DEBUG::2014-10-29 11:34:06,353::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:34:06,356::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203356) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:34:06,357::__init__::232::IOProcess::(_processLogs) (203356) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:06,358::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:06,358::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:06,358::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:06,359::__init__::232::IOProcess::(_processLogs) (203357) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:34:06,360::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203357) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:06,360::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:06,361::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:06,361::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:06,361::__init__::232::IOProcess::(_processLogs) (203358) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:34:06,362::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203358) Queuing response >Thread-137957::DEBUG::2014-10-29 11:34:06,363::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:34:06,365::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:06,365::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:06,365::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:06,366::__init__::232::IOProcess::(_processLogs) (203359) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:34:06,367::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203359) Queuing response >Thread-137957::DEBUG::2014-10-29 11:34:06,367::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:34:06,369::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:06,369::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:06,370::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:06,370::__init__::232::IOProcess::(_processLogs) (203360) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:06,371::__init__::232::IOProcess::(_processLogs) (203360) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:06,371::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:06,372::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-137957::DEBUG::2014-10-29 11:34:06,372::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:34:06,372::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-137957::INFO::2014-10-29 11:34:06,373::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137957::INFO::2014-10-29 11:34:06,375::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-17::DEBUG::2014-10-29 11:34:06,374::__init__::232::IOProcess::(_processLogs) (203361) Got request for method 'glob' >Thread-137957::INFO::2014-10-29 11:34:06,376::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:34:06,377::__init__::232::IOProcess::(_processLogs) (203361) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:06,378::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:06,378::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:06,379::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:06,379::__init__::232::IOProcess::(_processLogs) (203362) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:34:06,380::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203362) Queuing response >Thread-137957::DEBUG::2014-10-29 11:34:06,380::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137957::DEBUG::2014-10-29 11:34:06,382::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`15b4d5bd-2067-4bf8-8a50-bef17b9e52b3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137957::DEBUG::2014-10-29 11:34:06,382::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137957::DEBUG::2014-10-29 11:34:06,383::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137957::DEBUG::2014-10-29 11:34:06,383::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`15b4d5bd-2067-4bf8-8a50-bef17b9e52b3`::Granted request >Thread-137957::DEBUG::2014-10-29 11:34:06,384::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a87eab90-6f93-415b-b606-8b670588b014`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137957::DEBUG::2014-10-29 11:34:06,384::task::993::Storage.TaskManager.Task::(_decref) Task=`a87eab90-6f93-415b-b606-8b670588b014`::ref 1 aborting False >Thread-137957::INFO::2014-10-29 11:34:06,387::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137957::DEBUG::2014-10-29 11:34:06,387::task::1191::Storage.TaskManager.Task::(prepare) Task=`a87eab90-6f93-415b-b606-8b670588b014`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137957::DEBUG::2014-10-29 11:34:06,388::task::595::Storage.TaskManager.Task::(_updateState) Task=`a87eab90-6f93-415b-b606-8b670588b014`::moving from state preparing -> state finished >Thread-137957::DEBUG::2014-10-29 11:34:06,388::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137957::DEBUG::2014-10-29 11:34:06,388::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137957::DEBUG::2014-10-29 11:34:06,389::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137957::DEBUG::2014-10-29 11:34:06,389::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137957::DEBUG::2014-10-29 11:34:06,389::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137957::DEBUG::2014-10-29 11:34:06,389::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137957::DEBUG::2014-10-29 11:34:06,390::task::993::Storage.TaskManager.Task::(_decref) Task=`a87eab90-6f93-415b-b606-8b670588b014`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:34:06,412::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55107 >Detector thread::DEBUG::2014-10-29 11:34:06,413::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55107 >Detector thread::DEBUG::2014-10-29 11:34:06,413::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55107 >Detector thread::DEBUG::2014-10-29 11:34:06,413::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55107) >Thread-137962::DEBUG::2014-10-29 11:34:06,452::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137962::DEBUG::2014-10-29 11:34:06,453::task::595::Storage.TaskManager.Task::(_updateState) Task=`073b2e9a-e980-424a-8e93-576a8fb4da87`::moving from state init -> state preparing >Thread-137962::INFO::2014-10-29 11:34:06,453::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137962::INFO::2014-10-29 11:34:06,454::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505546', 'lastCheck': '4.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503171', 'lastCheck': '4.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000860082', 'lastCheck': '5.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492737', 'lastCheck': '5.3', 'valid': True}} >Thread-137962::DEBUG::2014-10-29 11:34:06,454::task::1191::Storage.TaskManager.Task::(prepare) Task=`073b2e9a-e980-424a-8e93-576a8fb4da87`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505546', 'lastCheck': '4.5', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503171', 'lastCheck': '4.4', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000860082', 'lastCheck': '5.1', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492737', 'lastCheck': '5.3', 'valid': True}} >Thread-137962::DEBUG::2014-10-29 11:34:06,455::task::595::Storage.TaskManager.Task::(_updateState) Task=`073b2e9a-e980-424a-8e93-576a8fb4da87`::moving from state preparing -> state finished >Thread-137962::DEBUG::2014-10-29 11:34:06,455::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137962::DEBUG::2014-10-29 11:34:06,455::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137962::DEBUG::2014-10-29 11:34:06,456::task::993::Storage.TaskManager.Task::(_decref) Task=`073b2e9a-e980-424a-8e93-576a8fb4da87`::ref 0 aborting False >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:07,650::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:07,651::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:07,653::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-22::DEBUG::2014-10-29 11:34:07,756::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:08,489::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:34:08,491::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137963::DEBUG::2014-10-29 11:34:08,495::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:08,498::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:34:08,499::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137964::DEBUG::2014-10-29 11:34:08,503::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137964::DEBUG::2014-10-29 11:34:08,505::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:34:10,413::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55108 >Detector thread::DEBUG::2014-10-29 11:34:10,414::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55108 >Detector thread::DEBUG::2014-10-29 11:34:10,414::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55108 >Detector thread::DEBUG::2014-10-29 11:34:10,414::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55108) >Thread-137965::DEBUG::2014-10-29 11:34:10,453::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137965::DEBUG::2014-10-29 11:34:10,454::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137965::DEBUG::2014-10-29 11:34:10,455::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '6.10', 'elapsedTime': '515082', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '2872789', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '56315', 'readRate': '0.00', 'truesize': '6010929152', 'writeRate': '35405.51'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.70', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Detector thread::DEBUG::2014-10-29 11:34:11,005::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55110 >Detector thread::DEBUG::2014-10-29 11:34:11,005::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55110 >Detector thread::DEBUG::2014-10-29 11:34:11,006::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55110 >Detector thread::DEBUG::2014-10-29 11:34:11,006::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55110) >Thread-137966::DEBUG::2014-10-29 11:34:11,046::task::595::Storage.TaskManager.Task::(_updateState) Task=`43100031-d192-4099-9a39-eb6ea014aede`::moving from state init -> state preparing >Thread-137966::INFO::2014-10-29 11:34:11,046::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137966::INFO::2014-10-29 11:34:11,047::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505546', 'lastCheck': '9.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503171', 'lastCheck': '9.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000860082', 'lastCheck': '9.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492737', 'lastCheck': '9.9', 'valid': True}} >Thread-137966::DEBUG::2014-10-29 11:34:11,047::task::1191::Storage.TaskManager.Task::(prepare) Task=`43100031-d192-4099-9a39-eb6ea014aede`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505546', 'lastCheck': '9.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000503171', 'lastCheck': '9.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000860082', 'lastCheck': '9.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000492737', 'lastCheck': '9.9', 'valid': True}} >Thread-137966::DEBUG::2014-10-29 11:34:11,048::task::595::Storage.TaskManager.Task::(_updateState) Task=`43100031-d192-4099-9a39-eb6ea014aede`::moving from state preparing -> state finished >Thread-137966::DEBUG::2014-10-29 11:34:11,048::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137966::DEBUG::2014-10-29 11:34:11,048::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137966::DEBUG::2014-10-29 11:34:11,048::task::993::Storage.TaskManager.Task::(_decref) Task=`43100031-d192-4099-9a39-eb6ea014aede`::ref 0 aborting False >Thread-17::DEBUG::2014-10-29 11:34:11,134::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:11,134::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:11,135::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:11,135::__init__::232::IOProcess::(_processLogs) (203363) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:11,137::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203363) Queuing response >Thread-10269::DEBUG::2014-10-29 11:34:11,138::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:34:11,155::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000418821 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:34:11,157::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:11,158::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:11,158::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:11,158::__init__::232::IOProcess::(_processLogs) (203364) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:11,158::__init__::232::IOProcess::(_processLogs) (203364) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:11,389::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:11,389::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:11,389::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:11,390::__init__::232::IOProcess::(_processLogs) (203365) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:11,391::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203365) Queuing response >Thread-179::DEBUG::2014-10-29 11:34:11,392::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:34:11,411::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000413557 s, 900 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:34:11,413::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:11,414::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:11,415::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:11,416::__init__::232::IOProcess::(_processLogs) (203366) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:11,417::__init__::232::IOProcess::(_processLogs) (203366) Queuing response >Detector thread::DEBUG::2014-10-29 11:34:11,503::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55111 >Detector thread::DEBUG::2014-10-29 11:34:11,504::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55111 >Detector thread::DEBUG::2014-10-29 11:34:11,504::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55111 >Detector thread::DEBUG::2014-10-29 11:34:11,505::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55111) >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:11,520::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:34:11,523::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137968::DEBUG::2014-10-29 11:34:11,526::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:11,529::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:34:11,530::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137969::DEBUG::2014-10-29 11:34:11,534::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137969::DEBUG::2014-10-29 11:34:11,536::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-137967::DEBUG::2014-10-29 11:34:11,546::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137967::DEBUG::2014-10-29 11:34:11,548::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137967::DEBUG::2014-10-29 11:34:11,568::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137967::DEBUG::2014-10-29 11:34:11,616::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '179', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '79', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-17::DEBUG::2014-10-29 11:34:11,930::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:11,930::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:11,932::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:11,933::__init__::232::IOProcess::(_processLogs) (203367) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:34:11,934::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:34:11,935::__init__::232::IOProcess::(_processLogs) (203367) Queuing response >Thread-178::DEBUG::2014-10-29 11:34:11,953::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000544375 s, 933 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:34:11,955::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:11,956::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:11,958::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:11,958::__init__::232::IOProcess::(_processLogs) (203368) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:11,958::__init__::232::IOProcess::(_processLogs) (203368) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:11,959::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:11,960::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:11,960::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:11,961::__init__::232::IOProcess::(_processLogs) (203369) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:11,961::__init__::232::IOProcess::(_processLogs) (203369) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:11,961::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:11,962::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:11,962::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:11,962::__init__::232::IOProcess::(_processLogs) (203370) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:11,963::__init__::232::IOProcess::(_processLogs) (203370) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:11,964::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:11,965::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:11,965::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:11,967::__init__::232::IOProcess::(_processLogs) (203371) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:11,967::__init__::232::IOProcess::(_processLogs) (203371) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:12,071::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:12,071::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:12,071::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:12,071::__init__::232::IOProcess::(_processLogs) (203372) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:12,073::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203372) Queuing response >Thread-33::DEBUG::2014-10-29 11:34:12,074::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:34:12,093::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000523061 s, 931 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:34:12,094::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:12,095::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:12,095::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:12,097::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203373) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:12,098::__init__::232::IOProcess::(_processLogs) (203373) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:12,099::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:12,099::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:12,099::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:12,099::__init__::232::IOProcess::(_processLogs) (203374) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:12,100::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203374) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:12,101::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:12,101::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:12,102::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:12,102::__init__::232::IOProcess::(_processLogs) (203375) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:12,102::__init__::232::IOProcess::(_processLogs) (203375) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:12,103::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:12,103::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:12,104::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:12,104::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203376) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:12,105::__init__::232::IOProcess::(_processLogs) (203376) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:12,661::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:12,662::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:12,663::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:14,551::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:34:14,554::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137970::DEBUG::2014-10-29 11:34:14,558::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:14,561::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:34:14,563::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137971::DEBUG::2014-10-29 11:34:14,567::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137971::DEBUG::2014-10-29 11:34:14,569::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:34:17,045::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55113 >Detector thread::DEBUG::2014-10-29 11:34:17,049::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55113 >Detector thread::DEBUG::2014-10-29 11:34:17,049::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55113 >Detector thread::DEBUG::2014-10-29 11:34:17,050::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55113) >Thread-137972::DEBUG::2014-10-29 11:34:17,087::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137972::DEBUG::2014-10-29 11:34:17,088::task::595::Storage.TaskManager.Task::(_updateState) Task=`cae336b4-6c29-4b17-a74c-39f3cf40b507`::moving from state init -> state preparing >Thread-137972::INFO::2014-10-29 11:34:17,089::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137972::DEBUG::2014-10-29 11:34:17,094::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:34:17,095::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:17,096::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:17,096::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:17,096::__init__::232::IOProcess::(_processLogs) (203377) Got request for method 'glob' >Thread-137972::DEBUG::2014-10-29 11:34:17,097::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-17::DEBUG::2014-10-29 11:34:17,097::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203377) Queuing response >Thread-137972::DEBUG::2014-10-29 11:34:17,099::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137972::INFO::2014-10-29 11:34:17,100::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137972::DEBUG::2014-10-29 11:34:17,100::task::1191::Storage.TaskManager.Task::(prepare) Task=`cae336b4-6c29-4b17-a74c-39f3cf40b507`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137972::DEBUG::2014-10-29 11:34:17,100::task::595::Storage.TaskManager.Task::(_updateState) Task=`cae336b4-6c29-4b17-a74c-39f3cf40b507`::moving from state preparing -> state finished >Thread-137972::DEBUG::2014-10-29 11:34:17,101::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137972::DEBUG::2014-10-29 11:34:17,101::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137972::DEBUG::2014-10-29 11:34:17,101::task::993::Storage.TaskManager.Task::(_decref) Task=`cae336b4-6c29-4b17-a74c-39f3cf40b507`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:34:17,147::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55114 >Detector thread::DEBUG::2014-10-29 11:34:17,148::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55114 >Detector thread::DEBUG::2014-10-29 11:34:17,148::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55114 >Detector thread::DEBUG::2014-10-29 11:34:17,149::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55114) >Thread-137973::DEBUG::2014-10-29 11:34:17,187::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137973::DEBUG::2014-10-29 11:34:17,187::task::595::Storage.TaskManager.Task::(_updateState) Task=`267522f1-d539-4450-9a18-a674ea2b02d8`::moving from state init -> state preparing >Thread-137973::INFO::2014-10-29 11:34:17,188::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137973::DEBUG::2014-10-29 11:34:17,188::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137973::DEBUG::2014-10-29 11:34:17,188::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137973::DEBUG::2014-10-29 11:34:17,189::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137973::DEBUG::2014-10-29 11:34:17,189::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137973::DEBUG::2014-10-29 11:34:17,189::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137973::DEBUG::2014-10-29 11:34:17,190::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137973::DEBUG::2014-10-29 11:34:17,281::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137973::DEBUG::2014-10-29 11:34:17,282::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137973::DEBUG::2014-10-29 11:34:17,460::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137973::DEBUG::2014-10-29 11:34:17,461::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137973::DEBUG::2014-10-29 11:34:17,461::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137973::DEBUG::2014-10-29 11:34:17,461::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137973::DEBUG::2014-10-29 11:34:17,462::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137973::DEBUG::2014-10-29 11:34:17,462::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137973::DEBUG::2014-10-29 11:34:17,463::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137973::DEBUG::2014-10-29 11:34:17,463::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:34:17,471::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:17,473::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:17,473::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:17,473::__init__::232::IOProcess::(_processLogs) (203378) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:34:17,475::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203378) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:17,476::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:17,476::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:17,476::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:17,477::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:17,477::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:17,479::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:17,481::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:17,483::__init__::232::IOProcess::(_processLogs) (203379) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:34:17,484::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:17,485::__init__::232::IOProcess::(_processLogs) (203380) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:34:17,487::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:17,488::__init__::232::IOProcess::(_processLogs) (203381) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:34:17,490::__init__::232::IOProcess::(_processLogs) (203380) Queuing response >Thread-137973::DEBUG::2014-10-29 11:34:17,492::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:34:17,492::__init__::232::IOProcess::(_processLogs) (203379) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:17,494::__init__::232::IOProcess::(_processLogs) (203381) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:17,496::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:17,496::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:17,496::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:17,497::__init__::232::IOProcess::(_processLogs) (203382) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:34:17,497::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203382) Queuing response >Thread-137973::DEBUG::2014-10-29 11:34:17,498::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:34:17,499::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:17,499::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:17,499::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:17,500::__init__::232::IOProcess::(_processLogs) (203383) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:34:17,501::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203383) Queuing response >Thread-137973::DEBUG::2014-10-29 11:34:17,501::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:34:17,503::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:17,503::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:17,504::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:17,505::__init__::232::IOProcess::(_processLogs) (203384) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:17,505::__init__::232::IOProcess::(_processLogs) (203384) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:17,505::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:17,506::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:17,506::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:17,506::__init__::232::IOProcess::(_processLogs) (203385) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:34:17,507::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203385) Queuing response >Thread-137973::DEBUG::2014-10-29 11:34:17,507::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-137973::INFO::2014-10-29 11:34:17,508::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137973::INFO::2014-10-29 11:34:17,509::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137973::INFO::2014-10-29 11:34:17,509::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:34:17,510::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:17,510::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:17,510::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:17,511::__init__::232::IOProcess::(_processLogs) (203386) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:34:17,511::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203386) Queuing response >Thread-137973::DEBUG::2014-10-29 11:34:17,512::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137973::DEBUG::2014-10-29 11:34:17,514::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`aa8a1b49-3a08-4620-98fb-7c8f0e835a02`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137973::DEBUG::2014-10-29 11:34:17,514::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137973::DEBUG::2014-10-29 11:34:17,515::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137973::DEBUG::2014-10-29 11:34:17,515::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`aa8a1b49-3a08-4620-98fb-7c8f0e835a02`::Granted request >Thread-137973::DEBUG::2014-10-29 11:34:17,516::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`267522f1-d539-4450-9a18-a674ea2b02d8`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137973::DEBUG::2014-10-29 11:34:17,516::task::993::Storage.TaskManager.Task::(_decref) Task=`267522f1-d539-4450-9a18-a674ea2b02d8`::ref 1 aborting False >Thread-137973::INFO::2014-10-29 11:34:17,519::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137973::DEBUG::2014-10-29 11:34:17,519::task::1191::Storage.TaskManager.Task::(prepare) Task=`267522f1-d539-4450-9a18-a674ea2b02d8`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137973::DEBUG::2014-10-29 11:34:17,519::task::595::Storage.TaskManager.Task::(_updateState) Task=`267522f1-d539-4450-9a18-a674ea2b02d8`::moving from state preparing -> state finished >Thread-137973::DEBUG::2014-10-29 11:34:17,519::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137973::DEBUG::2014-10-29 11:34:17,520::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137973::DEBUG::2014-10-29 11:34:17,520::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137973::DEBUG::2014-10-29 11:34:17,520::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137973::DEBUG::2014-10-29 11:34:17,521::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137973::DEBUG::2014-10-29 11:34:17,521::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137973::DEBUG::2014-10-29 11:34:17,521::task::993::Storage.TaskManager.Task::(_decref) Task=`267522f1-d539-4450-9a18-a674ea2b02d8`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:34:17,542::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55115 >Detector thread::DEBUG::2014-10-29 11:34:17,543::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55115 >Detector thread::DEBUG::2014-10-29 11:34:17,543::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55115 >Detector thread::DEBUG::2014-10-29 11:34:17,544::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55115) >Thread-137978::DEBUG::2014-10-29 11:34:17,582::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:17,583::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-137978::DEBUG::2014-10-29 11:34:17,585::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc6d86df-5092-48df-a3d6-b759f696cc65`::moving from state init -> state preparing >Thread-137978::INFO::2014-10-29 11:34:17,588::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137978::INFO::2014-10-29 11:34:17,589::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544375', 'lastCheck': '5.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523061', 'lastCheck': '5.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000413557', 'lastCheck': '6.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000418821', 'lastCheck': '6.4', 'valid': True}} >Thread-137978::DEBUG::2014-10-29 11:34:17,590::task::1191::Storage.TaskManager.Task::(prepare) Task=`cc6d86df-5092-48df-a3d6-b759f696cc65`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544375', 'lastCheck': '5.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523061', 'lastCheck': '5.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000413557', 'lastCheck': '6.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000418821', 'lastCheck': '6.4', 'valid': True}} >Thread-137978::DEBUG::2014-10-29 11:34:17,590::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc6d86df-5092-48df-a3d6-b759f696cc65`::moving from state preparing -> state finished >Thread-137978::DEBUG::2014-10-29 11:34:17,590::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137978::DEBUG::2014-10-29 11:34:17,590::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137978::DEBUG::2014-10-29 11:34:17,591::task::993::Storage.TaskManager.Task::(_decref) Task=`cc6d86df-5092-48df-a3d6-b759f696cc65`::ref 0 aborting False >JsonRpcServer::DEBUG::2014-10-29 11:34:17,593::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137979::DEBUG::2014-10-29 11:34:17,597::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d6fcfb4-46cb-4948-a8c2-1965733fcbc3`::moving from state init -> state preparing >Thread-137979::INFO::2014-10-29 11:34:17,597::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137979::INFO::2014-10-29 11:34:17,598::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544375', 'lastCheck': '5.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523061', 'lastCheck': '5.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000413557', 'lastCheck': '6.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000418821', 'lastCheck': '6.4', 'valid': True}} >Thread-137979::DEBUG::2014-10-29 11:34:17,598::task::1191::Storage.TaskManager.Task::(prepare) Task=`6d6fcfb4-46cb-4948-a8c2-1965733fcbc3`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544375', 'lastCheck': '5.6', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523061', 'lastCheck': '5.5', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000413557', 'lastCheck': '6.2', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000418821', 'lastCheck': '6.4', 'valid': True}} >Thread-137979::DEBUG::2014-10-29 11:34:17,599::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d6fcfb4-46cb-4948-a8c2-1965733fcbc3`::moving from state preparing -> state finished >Thread-137979::DEBUG::2014-10-29 11:34:17,599::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137979::DEBUG::2014-10-29 11:34:17,599::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137979::DEBUG::2014-10-29 11:34:17,599::task::993::Storage.TaskManager.Task::(_decref) Task=`6d6fcfb4-46cb-4948-a8c2-1965733fcbc3`::ref 0 aborting False >Thread-137979::DEBUG::2014-10-29 11:34:17,641::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:17,671::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:17,673::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpcServer::DEBUG::2014-10-29 11:34:17,680::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:17,683::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:17,686::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137980::DEBUG::2014-10-29 11:34:17,690::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137980::DEBUG::2014-10-29 11:34:17,694::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:34:20,608::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55116 >Detector thread::DEBUG::2014-10-29 11:34:20,609::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55116 >Detector thread::DEBUG::2014-10-29 11:34:20,609::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55116 >Detector thread::DEBUG::2014-10-29 11:34:20,610::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55116) >Thread-137981::DEBUG::2014-10-29 11:34:20,648::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-137981::DEBUG::2014-10-29 11:34:20,649::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137981::DEBUG::2014-10-29 11:34:20,650::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '6.10', 'elapsedTime': '515093', 'displayType': 'vnc', 'cpuSys': '0.86', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '2872789', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '56315', 'readRate': '0.00', 'truesize': '6010929152', 'writeRate': '35405.51'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '1.89', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:20,748::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:34:20,751::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137982::DEBUG::2014-10-29 11:34:20,754::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:20,757::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:34:20,758::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137983::DEBUG::2014-10-29 11:34:20,762::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137983::DEBUG::2014-10-29 11:34:20,765::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:34:21,120::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55118 >Detector thread::DEBUG::2014-10-29 11:34:21,120::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55118 >Detector thread::DEBUG::2014-10-29 11:34:21,121::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55118 >Detector thread::DEBUG::2014-10-29 11:34:21,121::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55118) >Thread-137984::DEBUG::2014-10-29 11:34:21,162::task::595::Storage.TaskManager.Task::(_updateState) Task=`b68946ac-1dc3-4f5e-b9a9-f285c8b5b1fb`::moving from state init -> state preparing >Thread-17::DEBUG::2014-10-29 11:34:21,163::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-137984::INFO::2014-10-29 11:34:21,164::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-17::DEBUG::2014-10-29 11:34:21,165::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:21,166::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:21,167::__init__::232::IOProcess::(_processLogs) (203387) Got request for method 'statvfs' >Thread-137984::INFO::2014-10-29 11:34:21,168::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544375', 'lastCheck': '9.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523061', 'lastCheck': '9.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000413557', 'lastCheck': '9.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000418821', 'lastCheck': '10.0', 'valid': True}} >Thread-137984::DEBUG::2014-10-29 11:34:21,169::task::1191::Storage.TaskManager.Task::(prepare) Task=`b68946ac-1dc3-4f5e-b9a9-f285c8b5b1fb`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544375', 'lastCheck': '9.2', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000523061', 'lastCheck': '9.1', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000413557', 'lastCheck': '9.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000418821', 'lastCheck': '10.0', 'valid': True}} >Thread-137984::DEBUG::2014-10-29 11:34:21,171::task::595::Storage.TaskManager.Task::(_updateState) Task=`b68946ac-1dc3-4f5e-b9a9-f285c8b5b1fb`::moving from state preparing -> state finished >Thread-17::DEBUG::2014-10-29 11:34:21,173::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203387) Queuing response >Thread-137984::DEBUG::2014-10-29 11:34:21,174::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10269::DEBUG::2014-10-29 11:34:21,175::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-137984::DEBUG::2014-10-29 11:34:21,176::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137984::DEBUG::2014-10-29 11:34:21,193::task::993::Storage.TaskManager.Task::(_decref) Task=`b68946ac-1dc3-4f5e-b9a9-f285c8b5b1fb`::ref 0 aborting False >Thread-10269::DEBUG::2014-10-29 11:34:21,196::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.00060923 s, 824 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:34:21,201::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:21,203::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:21,205::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:21,206::__init__::232::IOProcess::(_processLogs) (203388) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:21,209::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203388) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:21,419::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:21,419::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:21,419::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:21,420::__init__::232::IOProcess::(_processLogs) (203389) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:21,421::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203389) Queuing response >Thread-179::DEBUG::2014-10-29 11:34:21,422::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:34:21,440::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000487489 s, 763 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:34:21,441::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:21,442::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:21,442::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:21,444::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203390) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:21,445::__init__::232::IOProcess::(_processLogs) (203390) Queuing response >Detector thread::DEBUG::2014-10-29 11:34:21,664::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55119 >Detector thread::DEBUG::2014-10-29 11:34:21,665::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55119 >Detector thread::DEBUG::2014-10-29 11:34:21,665::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55119 >Detector thread::DEBUG::2014-10-29 11:34:21,666::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55119) >Thread-137985::DEBUG::2014-10-29 11:34:21,705::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137985::DEBUG::2014-10-29 11:34:21,707::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137985::DEBUG::2014-10-29 11:34:21,727::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-137985::DEBUG::2014-10-29 11:34:21,774::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '163', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '63', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-17::DEBUG::2014-10-29 11:34:21,968::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:21,969::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:21,969::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:21,969::__init__::232::IOProcess::(_processLogs) (203391) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:21,971::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203391) Queuing response >Thread-178::DEBUG::2014-10-29 11:34:21,972::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:34:21,991::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.00042532 s, 1.2 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:34:21,993::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:21,994::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:21,996::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:21,996::__init__::232::IOProcess::(_processLogs) (203392) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:21,996::__init__::232::IOProcess::(_processLogs) (203392) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:21,997::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:21,997::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:21,997::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:21,998::__init__::232::IOProcess::(_processLogs) (203393) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:21,998::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203393) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:22,000::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:22,000::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:22,000::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:22,001::__init__::232::IOProcess::(_processLogs) (203394) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:22,001::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203394) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:22,002::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:22,002::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:22,002::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:22,003::__init__::232::IOProcess::(_processLogs) (203395) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:22,004::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203395) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:22,107::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:22,108::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:22,108::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:22,108::__init__::232::IOProcess::(_processLogs) (203396) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:22,109::__init__::232::IOProcess::(_processLogs) (203396) Queuing response >Thread-33::DEBUG::2014-10-29 11:34:22,109::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-33::DEBUG::2014-10-29 11:34:22,126::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000471191 s, 1.0 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:34:22,128::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:22,129::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:22,129::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:22,129::__init__::232::IOProcess::(_processLogs) (203397) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:22,131::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203397) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:22,133::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:22,133::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:22,133::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:22,134::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203398) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:22,135::__init__::232::IOProcess::(_processLogs) (203398) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:22,135::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:22,136::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:22,136::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:22,137::__init__::232::IOProcess::(_processLogs) (203399) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:22,137::__init__::232::IOProcess::(_processLogs) (203399) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:22,138::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:22,138::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:22,138::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:22,139::__init__::232::IOProcess::(_processLogs) (203400) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:22,139::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203400) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:22,699::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:22,700::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:22,702::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-22::DEBUG::2014-10-29 11:34:22,780::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:23,786::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:34:23,789::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137986::DEBUG::2014-10-29 11:34:23,793::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:23,795::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:34:23,797::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137987::DEBUG::2014-10-29 11:34:23,800::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137987::DEBUG::2014-10-29 11:34:23,802::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:26,816::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:34:26,818::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137988::DEBUG::2014-10-29 11:34:26,821::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:26,823::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:34:26,825::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137989::DEBUG::2014-10-29 11:34:26,828::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137989::DEBUG::2014-10-29 11:34:26,830::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:27,709::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:27,710::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:27,713::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Detector thread::DEBUG::2014-10-29 11:34:28,195::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55121 >Detector thread::DEBUG::2014-10-29 11:34:28,196::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55121 >Detector thread::DEBUG::2014-10-29 11:34:28,196::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55121 >Detector thread::DEBUG::2014-10-29 11:34:28,197::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55121) >Thread-137990::DEBUG::2014-10-29 11:34:28,236::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137990::DEBUG::2014-10-29 11:34:28,237::task::595::Storage.TaskManager.Task::(_updateState) Task=`90fdaba3-4f3c-4276-8868-90d20fcfa327`::moving from state init -> state preparing >Thread-137990::INFO::2014-10-29 11:34:28,238::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-137990::DEBUG::2014-10-29 11:34:28,241::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:34:28,242::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:28,242::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:28,242::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:28,243::__init__::232::IOProcess::(_processLogs) (203401) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:34:28,244::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203401) Queuing response >Thread-137990::DEBUG::2014-10-29 11:34:28,246::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-137990::DEBUG::2014-10-29 11:34:28,246::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-137990::INFO::2014-10-29 11:34:28,247::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137990::DEBUG::2014-10-29 11:34:28,247::task::1191::Storage.TaskManager.Task::(prepare) Task=`90fdaba3-4f3c-4276-8868-90d20fcfa327`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-137990::DEBUG::2014-10-29 11:34:28,247::task::595::Storage.TaskManager.Task::(_updateState) Task=`90fdaba3-4f3c-4276-8868-90d20fcfa327`::moving from state preparing -> state finished >Thread-137990::DEBUG::2014-10-29 11:34:28,247::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137990::DEBUG::2014-10-29 11:34:28,248::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137990::DEBUG::2014-10-29 11:34:28,248::task::993::Storage.TaskManager.Task::(_decref) Task=`90fdaba3-4f3c-4276-8868-90d20fcfa327`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:34:28,295::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55122 >Detector thread::DEBUG::2014-10-29 11:34:28,296::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55122 >Detector thread::DEBUG::2014-10-29 11:34:28,296::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55122 >Detector thread::DEBUG::2014-10-29 11:34:28,296::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55122) >Thread-137991::DEBUG::2014-10-29 11:34:28,335::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137991::DEBUG::2014-10-29 11:34:28,336::task::595::Storage.TaskManager.Task::(_updateState) Task=`e042b6ab-970d-4b61-9b1a-4118d3069d87`::moving from state init -> state preparing >Thread-137991::INFO::2014-10-29 11:34:28,336::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-137991::DEBUG::2014-10-29 11:34:28,337::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-137991::DEBUG::2014-10-29 11:34:28,337::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137991::DEBUG::2014-10-29 11:34:28,337::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-137991::DEBUG::2014-10-29 11:34:28,337::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-137991::DEBUG::2014-10-29 11:34:28,338::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-137991::DEBUG::2014-10-29 11:34:28,338::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-137991::DEBUG::2014-10-29 11:34:28,431::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-137991::DEBUG::2014-10-29 11:34:28,432::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-137991::DEBUG::2014-10-29 11:34:28,601::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-137991::DEBUG::2014-10-29 11:34:28,603::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137991::DEBUG::2014-10-29 11:34:28,603::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137991::DEBUG::2014-10-29 11:34:28,604::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137991::DEBUG::2014-10-29 11:34:28,604::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137991::DEBUG::2014-10-29 11:34:28,604::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-137991::DEBUG::2014-10-29 11:34:28,605::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-137991::DEBUG::2014-10-29 11:34:28,605::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:34:28,612::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:28,614::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:28,614::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:28,614::__init__::232::IOProcess::(_processLogs) (203402) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:34:28,615::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203402) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:28,620::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:28,622::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:28,624::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:28,625::__init__::232::IOProcess::(_processLogs) (203403) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:34:28,627::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:28,629::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:28,630::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-137991::DEBUG::2014-10-29 11:34:28,631::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:34:28,632::__init__::232::IOProcess::(_processLogs) (203404) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:34:28,634::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:28,634::__init__::232::IOProcess::(_processLogs) (203403) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:28,634::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:28,635::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:28,635::__init__::232::IOProcess::(_processLogs) (203405) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:34:28,635::__init__::232::IOProcess::(_processLogs) (203404) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:28,635::__init__::232::IOProcess::(_processLogs) (203405) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:28,637::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:28,637::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:28,638::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:28,638::__init__::232::IOProcess::(_processLogs) (203406) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:34:28,639::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203406) Queuing response >Thread-137991::DEBUG::2014-10-29 11:34:28,640::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:34:28,641::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:28,641::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:28,641::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:28,642::__init__::232::IOProcess::(_processLogs) (203407) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:34:28,643::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203407) Queuing response >Thread-137991::DEBUG::2014-10-29 11:34:28,643::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:34:28,645::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:28,646::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:28,646::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:28,646::__init__::232::IOProcess::(_processLogs) (203408) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:28,647::__init__::232::IOProcess::(_processLogs) (203408) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:28,647::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:28,648::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:28,648::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:28,648::__init__::232::IOProcess::(_processLogs) (203409) Got request for method 'glob' >Thread-137991::DEBUG::2014-10-29 11:34:28,649::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-17::DEBUG::2014-10-29 11:34:28,649::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203409) Queuing response >Thread-137991::INFO::2014-10-29 11:34:28,650::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-137991::INFO::2014-10-29 11:34:28,651::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-137991::INFO::2014-10-29 11:34:28,651::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:34:28,652::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:28,652::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:28,653::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:28,653::__init__::232::IOProcess::(_processLogs) (203410) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:34:28,654::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203410) Queuing response >Thread-137991::DEBUG::2014-10-29 11:34:28,654::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-137991::DEBUG::2014-10-29 11:34:28,656::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`6e60f30a-3fe3-46ba-85b2-85e12b7a3c29`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-137991::DEBUG::2014-10-29 11:34:28,656::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-137991::DEBUG::2014-10-29 11:34:28,657::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-137991::DEBUG::2014-10-29 11:34:28,657::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`6e60f30a-3fe3-46ba-85b2-85e12b7a3c29`::Granted request >Thread-137991::DEBUG::2014-10-29 11:34:28,658::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e042b6ab-970d-4b61-9b1a-4118d3069d87`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-137991::DEBUG::2014-10-29 11:34:28,658::task::993::Storage.TaskManager.Task::(_decref) Task=`e042b6ab-970d-4b61-9b1a-4118d3069d87`::ref 1 aborting False >Thread-137991::INFO::2014-10-29 11:34:28,661::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137991::DEBUG::2014-10-29 11:34:28,661::task::1191::Storage.TaskManager.Task::(prepare) Task=`e042b6ab-970d-4b61-9b1a-4118d3069d87`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-137991::DEBUG::2014-10-29 11:34:28,661::task::595::Storage.TaskManager.Task::(_updateState) Task=`e042b6ab-970d-4b61-9b1a-4118d3069d87`::moving from state preparing -> state finished >Thread-137991::DEBUG::2014-10-29 11:34:28,662::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-137991::DEBUG::2014-10-29 11:34:28,662::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137991::DEBUG::2014-10-29 11:34:28,662::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-137991::DEBUG::2014-10-29 11:34:28,663::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-137991::DEBUG::2014-10-29 11:34:28,663::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-137991::DEBUG::2014-10-29 11:34:28,663::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-137991::DEBUG::2014-10-29 11:34:28,663::task::993::Storage.TaskManager.Task::(_decref) Task=`e042b6ab-970d-4b61-9b1a-4118d3069d87`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:34:28,686::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55123 >Detector thread::DEBUG::2014-10-29 11:34:28,686::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55123 >Detector thread::DEBUG::2014-10-29 11:34:28,687::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55123 >Detector thread::DEBUG::2014-10-29 11:34:28,687::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55123) >Thread-137996::DEBUG::2014-10-29 11:34:28,726::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-137996::DEBUG::2014-10-29 11:34:28,727::task::595::Storage.TaskManager.Task::(_updateState) Task=`a65f51be-3ae5-489f-9fa9-c5d7ab6c53b9`::moving from state init -> state preparing >Thread-137996::INFO::2014-10-29 11:34:28,727::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137996::INFO::2014-10-29 11:34:28,728::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00042532', 'lastCheck': '6.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471191', 'lastCheck': '6.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487489', 'lastCheck': '7.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00060923', 'lastCheck': '7.5', 'valid': True}} >Thread-137996::DEBUG::2014-10-29 11:34:28,728::task::1191::Storage.TaskManager.Task::(prepare) Task=`a65f51be-3ae5-489f-9fa9-c5d7ab6c53b9`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00042532', 'lastCheck': '6.7', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471191', 'lastCheck': '6.6', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487489', 'lastCheck': '7.3', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00060923', 'lastCheck': '7.5', 'valid': True}} >Thread-137996::DEBUG::2014-10-29 11:34:28,728::task::595::Storage.TaskManager.Task::(_updateState) Task=`a65f51be-3ae5-489f-9fa9-c5d7ab6c53b9`::moving from state preparing -> state finished >Thread-137996::DEBUG::2014-10-29 11:34:28,728::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137996::DEBUG::2014-10-29 11:34:28,729::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137996::DEBUG::2014-10-29 11:34:28,729::task::993::Storage.TaskManager.Task::(_decref) Task=`a65f51be-3ae5-489f-9fa9-c5d7ab6c53b9`::ref 0 aborting False >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:29,848::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:34:29,850::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137997::DEBUG::2014-10-29 11:34:29,853::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:29,856::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:34:29,858::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137998::DEBUG::2014-10-29 11:34:29,861::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-137998::DEBUG::2014-10-29 11:34:29,863::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:34:30,263::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55124 >Detector thread::DEBUG::2014-10-29 11:34:30,264::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55124 >Detector thread::DEBUG::2014-10-29 11:34:30,264::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55124 >Detector thread::DEBUG::2014-10-29 11:34:30,264::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55124) >Thread-137999::DEBUG::2014-10-29 11:34:30,304::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ea77a2b-b916-4f14-9a0d-dd75f3a06bbc`::moving from state init -> state preparing >Thread-137999::INFO::2014-10-29 11:34:30,304::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-137999::INFO::2014-10-29 11:34:30,305::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00042532', 'lastCheck': '8.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471191', 'lastCheck': '8.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487489', 'lastCheck': '8.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00060923', 'lastCheck': '9.1', 'valid': True}} >Thread-137999::DEBUG::2014-10-29 11:34:30,305::task::1191::Storage.TaskManager.Task::(prepare) Task=`6ea77a2b-b916-4f14-9a0d-dd75f3a06bbc`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00042532', 'lastCheck': '8.3', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000471191', 'lastCheck': '8.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000487489', 'lastCheck': '8.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00060923', 'lastCheck': '9.1', 'valid': True}} >Thread-137999::DEBUG::2014-10-29 11:34:30,305::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ea77a2b-b916-4f14-9a0d-dd75f3a06bbc`::moving from state preparing -> state finished >Thread-137999::DEBUG::2014-10-29 11:34:30,306::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137999::DEBUG::2014-10-29 11:34:30,306::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137999::DEBUG::2014-10-29 11:34:30,306::task::993::Storage.TaskManager.Task::(_decref) Task=`6ea77a2b-b916-4f14-9a0d-dd75f3a06bbc`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:34:30,804::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55125 >Detector thread::DEBUG::2014-10-29 11:34:30,804::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55125 >Detector thread::DEBUG::2014-10-29 11:34:30,805::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55125 >Detector thread::DEBUG::2014-10-29 11:34:30,805::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55125) >Thread-138000::DEBUG::2014-10-29 11:34:30,844::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-138000::DEBUG::2014-10-29 11:34:30,845::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-138000::DEBUG::2014-10-29 11:34:30,846::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '8.92', 'elapsedTime': '515103', 'displayType': 'vnc', 'cpuSys': '1.06', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '2872789', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '56315', 'readRate': '0.00', 'truesize': '6010929152', 'writeRate': '35405.51'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.06', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-17::DEBUG::2014-10-29 11:34:31,212::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:31,212::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:31,213::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:31,213::__init__::232::IOProcess::(_processLogs) (203411) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:31,215::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203411) Queuing response >Thread-10269::DEBUG::2014-10-29 11:34:31,215::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:34:31,235::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000445837 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:34:31,237::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:31,237::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:31,237::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:31,238::__init__::232::IOProcess::(_processLogs) (203412) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:31,238::__init__::232::IOProcess::(_processLogs) (203412) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:31,448::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:31,449::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:31,451::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-179::DEBUG::2014-10-29 11:34:31,451::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:34:31,467::__init__::232::IOProcess::(_processLogs) (203413) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:31,468::__init__::232::IOProcess::(_processLogs) (203413) Queuing response >Thread-179::DEBUG::2014-10-29 11:34:31,469::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000505539 s, 736 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:34:31,470::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:31,471::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:31,471::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:31,471::__init__::232::IOProcess::(_processLogs) (203414) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:31,473::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203414) Queuing response >Detector thread::DEBUG::2014-10-29 11:34:31,823::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55127 >Detector thread::DEBUG::2014-10-29 11:34:31,824::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55127 >Detector thread::DEBUG::2014-10-29 11:34:31,824::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55127 >Detector thread::DEBUG::2014-10-29 11:34:31,825::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55127) >Thread-138001::DEBUG::2014-10-29 11:34:31,863::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-138001::DEBUG::2014-10-29 11:34:31,865::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-138001::DEBUG::2014-10-29 11:34:31,884::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-138001::DEBUG::2014-10-29 11:34:31,932::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '148', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '48', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-17::DEBUG::2014-10-29 11:34:32,005::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:32,006::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:32,006::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:32,006::__init__::232::IOProcess::(_processLogs) (203415) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:32,007::__init__::232::IOProcess::(_processLogs) (203415) Queuing response >Thread-178::DEBUG::2014-10-29 11:34:32,008::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-178::DEBUG::2014-10-29 11:34:32,025::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000535216 s, 949 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:34:32,027::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:32,028::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:32,028::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:32,028::__init__::232::IOProcess::(_processLogs) (203416) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:32,028::__init__::232::IOProcess::(_processLogs) (203416) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:32,031::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:32,032::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:32,032::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:32,033::__init__::232::IOProcess::(_processLogs) (203417) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:32,033::__init__::232::IOProcess::(_processLogs) (203417) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:32,033::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:32,034::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:32,035::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:32,035::__init__::232::IOProcess::(_processLogs) (203418) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:32,035::__init__::232::IOProcess::(_processLogs) (203418) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:32,036::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:32,037::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:32,037::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:32,038::__init__::232::IOProcess::(_processLogs) (203419) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:32,039::__init__::232::IOProcess::(_processLogs) (203419) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:32,141::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:32,142::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:32,143::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-33::DEBUG::2014-10-29 11:34:32,144::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:34:32,144::__init__::232::IOProcess::(_processLogs) (203420) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:32,161::__init__::232::IOProcess::(_processLogs) (203420) Queuing response >Thread-33::DEBUG::2014-10-29 11:34:32,163::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000564542 s, 863 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:34:32,164::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:32,165::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:32,166::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:32,168::__init__::232::IOProcess::(_processLogs) (203421) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:32,168::__init__::232::IOProcess::(_processLogs) (203421) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:32,169::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:32,169::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:32,170::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:32,170::__init__::232::IOProcess::(_processLogs) (203422) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:32,171::__init__::232::IOProcess::(_processLogs) (203422) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:32,171::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:32,171::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:32,172::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:32,172::__init__::232::IOProcess::(_processLogs) (203423) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:32,173::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203423) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:32,174::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:32,174::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:32,174::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:32,174::__init__::232::IOProcess::(_processLogs) (203424) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:32,175::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203424) Queuing response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:32,720::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:32,722::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:32,725::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:32,877::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:34:32,879::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-138002::DEBUG::2014-10-29 11:34:32,884::task::595::Storage.TaskManager.Task::(_updateState) Task=`87180c5d-8da8-44d7-a964-77dd31abe2aa`::moving from state init -> state preparing >Thread-138002::INFO::2014-10-29 11:34:32,884::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-138002::INFO::2014-10-29 11:34:32,885::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535216', 'lastCheck': '0.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564542', 'lastCheck': '0.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505539', 'lastCheck': '1.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000445837', 'lastCheck': '1.6', 'valid': True}} >Thread-138002::DEBUG::2014-10-29 11:34:32,885::task::1191::Storage.TaskManager.Task::(prepare) Task=`87180c5d-8da8-44d7-a964-77dd31abe2aa`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535216', 'lastCheck': '0.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564542', 'lastCheck': '0.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505539', 'lastCheck': '1.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000445837', 'lastCheck': '1.6', 'valid': True}} >Thread-138002::DEBUG::2014-10-29 11:34:32,885::task::595::Storage.TaskManager.Task::(_updateState) Task=`87180c5d-8da8-44d7-a964-77dd31abe2aa`::moving from state preparing -> state finished >Thread-138002::DEBUG::2014-10-29 11:34:32,885::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-138002::DEBUG::2014-10-29 11:34:32,886::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-138002::DEBUG::2014-10-29 11:34:32,886::task::993::Storage.TaskManager.Task::(_decref) Task=`87180c5d-8da8-44d7-a964-77dd31abe2aa`::ref 0 aborting False >Thread-138002::DEBUG::2014-10-29 11:34:32,908::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:32,930::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:34:32,932::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-138003::DEBUG::2014-10-29 11:34:32,935::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-138003::DEBUG::2014-10-29 11:34:32,938::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >VM Channels Listener::DEBUG::2014-10-29 11:34:35,294::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 37. >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:35,987::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:34:35,989::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-138004::DEBUG::2014-10-29 11:34:35,993::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:35,995::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:34:35,997::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-138005::DEBUG::2014-10-29 11:34:36,001::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-138005::DEBUG::2014-10-29 11:34:36,004::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:37,732::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:37,733::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:37,735::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-22::DEBUG::2014-10-29 11:34:37,801::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:39,024::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:34:39,030::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-138006::DEBUG::2014-10-29 11:34:39,034::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:39,037::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:34:39,040::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-138007::DEBUG::2014-10-29 11:34:39,045::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-138007::DEBUG::2014-10-29 11:34:39,048::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-29 11:34:39,311::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55129 >Detector thread::DEBUG::2014-10-29 11:34:39,313::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55129 >Detector thread::DEBUG::2014-10-29 11:34:39,314::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55129 >Detector thread::DEBUG::2014-10-29 11:34:39,314::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55129) >Thread-138008::DEBUG::2014-10-29 11:34:39,352::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-138008::DEBUG::2014-10-29 11:34:39,353::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c1ecd57-107c-4af3-82d3-3ba862cb66d0`::moving from state init -> state preparing >Thread-138008::INFO::2014-10-29 11:34:39,353::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='a8c099ef-7545-43f0-903c-ffc2f5d53c94', conList=[{'port': '', 'connection': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '3', 'password': '******', 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}], options=None) >Thread-138008::DEBUG::2014-10-29 11:34:39,357::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5 >Thread-17::DEBUG::2014-10-29 11:34:39,358::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:39,358::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:39,358::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:39,359::__init__::232::IOProcess::(_processLogs) (203425) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:34:39,360::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203425) Queuing response >Thread-138008::DEBUG::2014-10-29 11:34:39,361::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'4947d23c-ad94-4423-bd14-e4e810b9b84d',) >Thread-138008::DEBUG::2014-10-29 11:34:39,361::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {9b5dff8d-f9a0-4e5c-8800-3a988fc12016: storage.nfsSD.findDomain, 4947d23c-ad94-4423-bd14-e4e810b9b84d: storage.nfsSD.findDomain, 38dc6c98-2b6a-45c0-b765-c5ce685415f9: storage.nfsSD.findDomain, de096187-36e2-44e5-b8db-a9b67c3960de: storage.nfsSD.findDomain} >Thread-138008::INFO::2014-10-29 11:34:39,361::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-138008::DEBUG::2014-10-29 11:34:39,362::task::1191::Storage.TaskManager.Task::(prepare) Task=`7c1ecd57-107c-4af3-82d3-3ba862cb66d0`::finished: {'statuslist': [{'status': 0, 'id': 'bf1296e6-0de9-49c1-ad9a-89a6a3db5e44'}]} >Thread-138008::DEBUG::2014-10-29 11:34:39,362::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c1ecd57-107c-4af3-82d3-3ba862cb66d0`::moving from state preparing -> state finished >Thread-138008::DEBUG::2014-10-29 11:34:39,362::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-138008::DEBUG::2014-10-29 11:34:39,363::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-138008::DEBUG::2014-10-29 11:34:39,363::task::993::Storage.TaskManager.Task::(_decref) Task=`7c1ecd57-107c-4af3-82d3-3ba862cb66d0`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:34:39,406::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55130 >Detector thread::DEBUG::2014-10-29 11:34:39,406::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55130 >Detector thread::DEBUG::2014-10-29 11:34:39,407::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55130 >Detector thread::DEBUG::2014-10-29 11:34:39,407::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55130) >Thread-138009::DEBUG::2014-10-29 11:34:39,446::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-138009::DEBUG::2014-10-29 11:34:39,446::task::595::Storage.TaskManager.Task::(_updateState) Task=`414b26f2-9fc4-4b09-ab93-87a777a5e877`::moving from state init -> state preparing >Thread-138009::INFO::2014-10-29 11:34:39,447::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='4947d23c-ad94-4423-bd14-e4e810b9b84d', options=None) >Thread-138009::DEBUG::2014-10-29 11:34:39,447::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-138009::DEBUG::2014-10-29 11:34:39,447::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-138009::DEBUG::2014-10-29 11:34:39,448::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-138009::DEBUG::2014-10-29 11:34:39,448::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-138009::DEBUG::2014-10-29 11:34:39,448::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-138009::DEBUG::2014-10-29 11:34:39,449::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-138009::DEBUG::2014-10-29 11:34:39,547::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-138009::DEBUG::2014-10-29 11:34:39,548::multipath::113::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-138009::DEBUG::2014-10-29 11:34:39,715::multipath::113::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-138009::DEBUG::2014-10-29 11:34:39,716::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-138009::DEBUG::2014-10-29 11:34:39,716::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-138009::DEBUG::2014-10-29 11:34:39,717::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-138009::DEBUG::2014-10-29 11:34:39,717::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-138009::DEBUG::2014-10-29 11:34:39,717::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-138009::DEBUG::2014-10-29 11:34:39,718::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-138009::DEBUG::2014-10-29 11:34:39,718::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-10-29 11:34:39,726::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:39,728::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:39,729::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:39,729::__init__::232::IOProcess::(_processLogs) (203426) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:34:39,730::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203426) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:39,732::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:39,732::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:39,732::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:39,732::__init__::232::IOProcess::(_processLogs) (203427) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:34:39,733::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:39,733::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:39,733::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:39,734::__init__::232::IOProcess::(_processLogs) (203428) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:34:39,734::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203427) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:39,736::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:39,738::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:39,739::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:39,740::__init__::232::IOProcess::(_processLogs) (203429) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:34:39,743::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203429) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:39,745::__init__::232::IOProcess::(_processLogs) (203428) Queuing response >Thread-138009::DEBUG::2014-10-29 11:34:39,749::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:34:39,751::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:39,751::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:39,752::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:39,752::__init__::232::IOProcess::(_processLogs) (203430) Got request for method 'touch' >Thread-17::DEBUG::2014-10-29 11:34:39,752::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203430) Queuing response >Thread-138009::DEBUG::2014-10-29 11:34:39,753::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-17::DEBUG::2014-10-29 11:34:39,754::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:39,755::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:39,755::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:39,755::__init__::232::IOProcess::(_processLogs) (203431) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:34:39,756::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203431) Queuing response >Thread-138009::DEBUG::2014-10-29 11:34:39,756::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-17::DEBUG::2014-10-29 11:34:39,758::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:39,759::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:39,760::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:39,760::__init__::232::IOProcess::(_processLogs) (203432) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:39,760::__init__::232::IOProcess::(_processLogs) (203432) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:39,761::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:39,761::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:39,761::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:39,762::__init__::232::IOProcess::(_processLogs) (203433) Got request for method 'glob' >Thread-17::DEBUG::2014-10-29 11:34:39,762::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203433) Queuing response >Thread-138009::DEBUG::2014-10-29 11:34:39,763::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-138009::INFO::2014-10-29 11:34:39,763::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_imageNS already registered >Thread-138009::INFO::2014-10-29 11:34:39,764::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 4947d23c-ad94-4423-bd14-e4e810b9b84d_volumeNS already registered >Thread-138009::INFO::2014-10-29 11:34:39,764::fileSD::341::Storage.StorageDomain::(validate) sdUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d >Thread-17::DEBUG::2014-10-29 11:34:39,765::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:39,765::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:39,765::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:39,766::__init__::232::IOProcess::(_processLogs) (203434) Got request for method 'readfile' >Thread-17::DEBUG::2014-10-29 11:34:39,767::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203434) Queuing response >Thread-138009::DEBUG::2014-10-29 11:34:39,767::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=4947d23c-ad94-4423-bd14-e4e810b9b84d:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=a8c099ef-7545-43f0-903c-ffc2f5d53c94', 'REMOTE_PATH=10.35.160.108:/RHEV/nsednev_HE_3_5', 'ROLE=Master', 'SDUUID=4947d23c-ad94-4423-bd14-e4e810b9b84d', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=e52600c5106250f1ac3e80ed6dd446d8bbebd7dc'] >Thread-138009::DEBUG::2014-10-29 11:34:39,769::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`c4aa70c0-08f3-4bda-a5dd-3208d0dd2214`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-138009::DEBUG::2014-10-29 11:34:39,769::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' for lock type 'shared' >Thread-138009::DEBUG::2014-10-29 11:34:39,770::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free. Now locking as 'shared' (1 active user) >Thread-138009::DEBUG::2014-10-29 11:34:39,770::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d`ReqID=`c4aa70c0-08f3-4bda-a5dd-3208d0dd2214`::Granted request >Thread-138009::DEBUG::2014-10-29 11:34:39,771::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`414b26f2-9fc4-4b09-ab93-87a777a5e877`::_resourcesAcquired: Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d (shared) >Thread-138009::DEBUG::2014-10-29 11:34:39,771::task::993::Storage.TaskManager.Task::(_decref) Task=`414b26f2-9fc4-4b09-ab93-87a777a5e877`::ref 1 aborting False >Thread-138009::INFO::2014-10-29 11:34:39,774::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-138009::DEBUG::2014-10-29 11:34:39,774::task::1191::Storage.TaskManager.Task::(prepare) Task=`414b26f2-9fc4-4b09-ab93-87a777a5e877`::finished: {'info': {'uuid': u'4947d23c-ad94-4423-bd14-e4e810b9b84d', 'version': '3', 'role': 'Master', 'remotePath': '10.35.160.108:/RHEV/nsednev_HE_3_5', 'type': 'NFS', 'class': 'Data', 'pool': ['a8c099ef-7545-43f0-903c-ffc2f5d53c94'], 'name': 'hosted_storage'}} >Thread-138009::DEBUG::2014-10-29 11:34:39,774::task::595::Storage.TaskManager.Task::(_updateState) Task=`414b26f2-9fc4-4b09-ab93-87a777a5e877`::moving from state preparing -> state finished >Thread-138009::DEBUG::2014-10-29 11:34:39,775::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d': < ResourceRef 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', isValid: 'True' obj: 'None'>} >Thread-138009::DEBUG::2014-10-29 11:34:39,775::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-138009::DEBUG::2014-10-29 11:34:39,775::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' >Thread-138009::DEBUG::2014-10-29 11:34:39,776::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' (0 active users) >Thread-138009::DEBUG::2014-10-29 11:34:39,776::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d' is free, finding out if anyone is waiting for it. >Thread-138009::DEBUG::2014-10-29 11:34:39,776::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.4947d23c-ad94-4423-bd14-e4e810b9b84d', Clearing records. >Thread-138009::DEBUG::2014-10-29 11:34:39,777::task::993::Storage.TaskManager.Task::(_decref) Task=`414b26f2-9fc4-4b09-ab93-87a777a5e877`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:34:39,797::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55131 >Detector thread::DEBUG::2014-10-29 11:34:39,797::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55131 >Detector thread::DEBUG::2014-10-29 11:34:39,798::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55131 >Detector thread::DEBUG::2014-10-29 11:34:39,798::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55131) >Thread-138014::DEBUG::2014-10-29 11:34:39,837::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-138014::DEBUG::2014-10-29 11:34:39,837::task::595::Storage.TaskManager.Task::(_updateState) Task=`cbe43b68-c5ef-4161-a04a-0dba5e6f2692`::moving from state init -> state preparing >Thread-138014::INFO::2014-10-29 11:34:39,838::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-138014::INFO::2014-10-29 11:34:39,838::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535216', 'lastCheck': '7.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564542', 'lastCheck': '7.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505539', 'lastCheck': '8.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000445837', 'lastCheck': '8.6', 'valid': True}} >Thread-138014::DEBUG::2014-10-29 11:34:39,839::task::1191::Storage.TaskManager.Task::(prepare) Task=`cbe43b68-c5ef-4161-a04a-0dba5e6f2692`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535216', 'lastCheck': '7.8', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564542', 'lastCheck': '7.7', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505539', 'lastCheck': '8.4', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000445837', 'lastCheck': '8.6', 'valid': True}} >Thread-138014::DEBUG::2014-10-29 11:34:39,839::task::595::Storage.TaskManager.Task::(_updateState) Task=`cbe43b68-c5ef-4161-a04a-0dba5e6f2692`::moving from state preparing -> state finished >Thread-138014::DEBUG::2014-10-29 11:34:39,839::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-138014::DEBUG::2014-10-29 11:34:39,839::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-138014::DEBUG::2014-10-29 11:34:39,840::task::993::Storage.TaskManager.Task::(_decref) Task=`cbe43b68-c5ef-4161-a04a-0dba5e6f2692`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:34:40,382::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55132 >Detector thread::DEBUG::2014-10-29 11:34:40,382::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55132 >Detector thread::DEBUG::2014-10-29 11:34:40,383::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55132 >Detector thread::DEBUG::2014-10-29 11:34:40,383::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55132) >Thread-138015::DEBUG::2014-10-29 11:34:40,423::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ef5ad67-6846-41aa-9239-cc5066664569`::moving from state init -> state preparing >Thread-138015::INFO::2014-10-29 11:34:40,423::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-138015::INFO::2014-10-29 11:34:40,424::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535216', 'lastCheck': '8.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564542', 'lastCheck': '8.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505539', 'lastCheck': '8.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000445837', 'lastCheck': '9.2', 'valid': True}} >Thread-138015::DEBUG::2014-10-29 11:34:40,424::task::1191::Storage.TaskManager.Task::(prepare) Task=`6ef5ad67-6846-41aa-9239-cc5066664569`::finished: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000535216', 'lastCheck': '8.4', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564542', 'lastCheck': '8.2', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000505539', 'lastCheck': '8.9', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000445837', 'lastCheck': '9.2', 'valid': True}} >Thread-138015::DEBUG::2014-10-29 11:34:40,425::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ef5ad67-6846-41aa-9239-cc5066664569`::moving from state preparing -> state finished >Thread-138015::DEBUG::2014-10-29 11:34:40,425::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-138015::DEBUG::2014-10-29 11:34:40,425::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-138015::DEBUG::2014-10-29 11:34:40,425::task::993::Storage.TaskManager.Task::(_decref) Task=`6ef5ad67-6846-41aa-9239-cc5066664569`::ref 0 aborting False >Detector thread::DEBUG::2014-10-29 11:34:40,995::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55133 >Detector thread::DEBUG::2014-10-29 11:34:40,996::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55133 >Detector thread::DEBUG::2014-10-29 11:34:40,996::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55133 >Detector thread::DEBUG::2014-10-29 11:34:40,997::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55133) >Thread-138016::DEBUG::2014-10-29 11:34:41,035::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('657d61d0-b150-4837-91ad-5b3548f99899',) {} >Thread-138016::DEBUG::2014-10-29 11:34:41,036::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-138016::DEBUG::2014-10-29 11:34:41,037::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'displayInfo': [{'tlsPort': '-1', 'ipAddress': '0', 'type': 'vnc', 'port': u'5900'}], 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '14098', 'session': 'Unknown', 'vmType': 'kvm', 'timeOffset': '0', 'balloonInfo': {'balloon_max': '4194304', 'balloon_target': '0', 'balloon_cur': '4194304', 'balloon_min': '0'}, 'pauseCode': 'NOERR', 'network': {u'vnet0': {'macAddr': '00:16:3E:7B:BB:BB', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmJobs': {}, 'cpuUser': '5.83', 'elapsedTime': '515113', 'displayType': 'vnc', 'cpuSys': '0.40', 'appsList': [], 'vcpuCount': '2', 'clientIp': '', 'hash': '-8120462708515815632', 'vmId': '657d61d0-b150-4837-91ad-5b3548f99899', 'displayIp': '0', 'vcpuPeriod': 100000L, 'displayPort': u'5900', 'vcpuQuota': '-1', 'kvmEnable': 'true', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '26843545600', 'writeLatency': '2872789', 'imageID': 'b11dd682-40ca-4fc0-9a0b-a66235206ecb', 'flushLatency': '56315', 'readRate': '0.00', 'truesize': '6010929152', 'writeRate': '35405.51'}, u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.23', 'username': 'Unknown', 'status': 'Up', 'guestCPUCount': -1, 'guestIPs': '', 'displaySecurePort': '-1'}]} >Thread-17::DEBUG::2014-10-29 11:34:41,241::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:41,241::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:41,241::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:41,242::__init__::232::IOProcess::(_processLogs) (203435) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:41,243::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203435) Queuing response >Thread-10269::DEBUG::2014-10-29 11:34:41,245::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev-iso-domain/de096187-36e2-44e5-b8db-a9b67c3960de/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10269::DEBUG::2014-10-29 11:34:41,263::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n502 bytes (502 B) copied, 0.000517873 s, 969 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:34:41,265::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:41,266::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:41,268::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:41,269::__init__::232::IOProcess::(_processLogs) (203436) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:41,269::__init__::232::IOProcess::(_processLogs) (203436) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:41,476::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:41,477::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:41,477::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:41,477::__init__::232::IOProcess::(_processLogs) (203437) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:41,479::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203437) Queuing response >Thread-179::DEBUG::2014-10-29 11:34:41,480::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__rhevm__3__5__second__SD/38dc6c98-2b6a-45c0-b765-c5ce685415f9/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-179::DEBUG::2014-10-29 11:34:41,497::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n372 bytes (372 B) copied, 0.000496418 s, 749 kB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:34:41,499::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:41,500::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:41,500::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:41,500::__init__::232::IOProcess::(_processLogs) (203438) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:41,500::__init__::232::IOProcess::(_processLogs) (203438) Queuing response >Detector thread::DEBUG::2014-10-29 11:34:41,973::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:55135 >Detector thread::DEBUG::2014-10-29 11:34:41,974::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:55135 >Detector thread::DEBUG::2014-10-29 11:34:41,974::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:55135 >Detector thread::DEBUG::2014-10-29 11:34:41,975::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 55135) >Thread-138017::DEBUG::2014-10-29 11:34:42,014::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-138017::DEBUG::2014-10-29 11:34:42,016::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-138017::DEBUG::2014-10-29 11:34:42,036::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:34:42,042::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:42,043::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:42,047::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:42,049::__init__::232::IOProcess::(_processLogs) (203439) Got request for method 'statvfs' >Thread-178::DEBUG::2014-10-29 11:34:42,049::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__ovirt__3__5__HE__for__disks/9b5dff8d-f9a0-4e5c-8800-3a988fc12016/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:34:42,065::__init__::232::IOProcess::(_processLogs) (203439) Queuing response >Thread-178::DEBUG::2014-10-29 11:34:42,075::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n508 bytes (508 B) copied, 0.000577929 s, 879 kB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:42,077::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-17::DEBUG::2014-10-29 11:34:42,084::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >JsonRpcServer::DEBUG::2014-10-29 11:34:42,087::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:34:42,090::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:42,094::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:42,097::__init__::232::IOProcess::(_processLogs) (203440) Got request for method 'statvfs' >Thread-138018::DEBUG::2014-10-29 11:34:42,106::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:34:42,111::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203440) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:42,118::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:42,118::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-17::DEBUG::2014-10-29 11:34:42,121::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:42,124::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:42,127::__init__::232::IOProcess::(_processLogs) (203441) Got request for method 'access' >JsonRpcServer::DEBUG::2014-10-29 11:34:42,128::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-29 11:34:42,131::__init__::232::IOProcess::(_processLogs) (203441) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:42,142::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-138019::DEBUG::2014-10-29 11:34:42,143::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-17::DEBUG::2014-10-29 11:34:42,144::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:42,147::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:42,154::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203442) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:42,157::__init__::232::IOProcess::(_processLogs) (203442) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:42,162::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:42,165::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:42,167::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:42,169::__init__::232::IOProcess::(_processLogs) (203443) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:42,171::__init__::232::IOProcess::(_processLogs) (203443) Queuing response >Thread-138019::DEBUG::2014-10-29 11:34:42,173::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-17::DEBUG::2014-10-29 11:34:42,182::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:42,184::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:42,186::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:42,188::__init__::232::IOProcess::(_processLogs) (203444) Got request for method 'statvfs' >Thread-33::DEBUG::2014-10-29 11:34:42,187::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/10.35.160.108:_RHEV_nsednev__HE__3__5/4947d23c-ad94-4423-bd14-e4e810b9b84d/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-17::DEBUG::2014-10-29 11:34:42,190::__init__::232::IOProcess::(_processLogs) (203444) Queuing response >Thread-33::DEBUG::2014-10-29 11:34:42,213::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n487 bytes (487 B) copied, 0.000447998 s, 1.1 MB/s\n'; <rc> = 0 >Thread-17::DEBUG::2014-10-29 11:34:42,218::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:42,219::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:42,221::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:42,223::__init__::232::IOProcess::(_processLogs) (203445) Got request for method 'statvfs' >Thread-17::DEBUG::2014-10-29 11:34:42,229::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|(203445) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:42,233::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:42,235::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:42,236::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:42,237::__init__::232::IOProcess::(_processLogs) (203446) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:42,239::__init__::232::IOProcess::(_processLogs) (203446) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:42,245::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:42,247::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:42,249::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:42,251::__init__::232::IOProcess::(_processLogs) (203447) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:42,252::__init__::232::IOProcess::(_processLogs) (203447) Queuing response >Thread-17::DEBUG::2014-10-29 11:34:42,263::__init__::232::IOProcess::(_processLogs) Extracting request information.DEBUG|(null)|Receiving request... >Thread-17::DEBUG::2014-10-29 11:34:42,266::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-17::DEBUG::2014-10-29 11:34:42,283::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-17::DEBUG::2014-10-29 11:34:42,285::__init__::232::IOProcess::(_processLogs) (203448) Got request for method 'access' >Thread-17::DEBUG::2014-10-29 11:34:42,286::__init__::232::IOProcess::(_processLogs) (203448) Queuing response >Thread-138017::DEBUG::2014-10-29 11:34:42,288::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8'}], 'FC': []}, 'packages2': {'kernel': {'release': '504.el6.x86_64', 'buildtime': 1410821795.0, 'version': '2.6.32'}, 'spice-server': {'release': '11.el6', 'buildtime': 1407406843L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1413902785L, 'version': '4.16.7.1'}, 'qemu-kvm': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'libvirt': {'release': '46.el6_6.1', 'buildtime': 1413406796L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.448.el6', 'buildtime': 1411764164L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6_5', 'buildtime': 1405326775L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5310 @ 1.60GHz', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'gateway': '10.35.103.254', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0', 'vnet0']}}, 'bridges': {'rhevm': {'addr': '10.35.103.12', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['10.35.103.12/24'], 'ipv6gateway': '::', 'gateway': '10.35.103.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '115', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a64123499', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a64123499', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '14', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0', 'vnet0']}}, 'uuid': 'AEFA9F8F-A3EB-3AA5-A112-12FA3AEF464F', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {'UUID': 'f630aaf0-5a13-4790-a31a-52be707ec4e0', 'DHCP_HOSTNAME': 'blue-vdsc.qa.lab.tlv.redhat.com', 'NM_CONTROLLED': 'yes', 'HWADDR': '00:1A:64:12:34:9B', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:9b', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'DEVICE': 'eth0', 'HWADDR': '00:1a:64:12:34:99', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'rhevm'}, 'ipv6addrs': ['fe80::21a:64ff:fe12:3499/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:64:12:34:99', 'speed': 1000}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,tm2,ssse3,cx16,xtpr,pdcm,dca,lahf_lm,dts,tpr_shadow,model_Conroe,model_coreduo,model_core2duo,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:dfa0dda2bfb8', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '7872', 'cpuSpeed': '1600.002', 'numaNodes': {u'0': {'totalMemory': '7872', 'cpus': [0, 1, 2, 3]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.6.0', u'pc', u'rhel6.5.0', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.6.0.2.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:42,742::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:42,743::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:42,746::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:45,196::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:34:45,199::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-138020::DEBUG::2014-10-29 11:34:45,203::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:45,205::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:34:45,208::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-138021::DEBUG::2014-10-29 11:34:45,211::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >Thread-138021::DEBUG::2014-10-29 11:34:45,213::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:47,753::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:47,754::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >GuestMonitor-HostedEngine::DEBUG::2014-10-29 11:34:47,756::vm::486::vm.Vm::(_getUserCpuTuneInfo) vmId=`657d61d0-b150-4837-91ad-5b3548f99899`::Domain Metadata is not set >JsonRpc (StompReactor)::DEBUG::2014-10-29 11:34:48,227::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-29 11:34:48,229::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-138022::DEBUG::2014-10-29 11:34:48,232::task::595::Storage.TaskManager.Task::(_updateState) Task=`b7604427-c3a9-484c-b92b-f826c14aaee4`::moving from state init -> state preparing >Thread-138022::INFO::2014-10-29 11:34:48,233::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-138022::INFO::2014-10-29 11:34:48,233::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'9b5dff8d-f9a0-4e5c-8800-3a988fc12016': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000577929', 'lastCheck': '6.1', 'valid': True}, '4947d23c-ad94-4423-bd14-e4e810b9b84d': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000447998', 'lastCheck': '6.0', 'valid': True}, u'38dc6c98-2b6a-45c0-b765-c5ce685415f9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000496418', 'lastCheck': '6.7', 'valid': True}, u'de096187-36e2-44e5-b8db-a9b67c3960de': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000517873', 'lastCheck': '7.0', 'valid': True}} >